Rare find

llm-multi-backend-container. Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap

github.com/bjodah/llm-multi-backend-container

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.