llm-router. Intelligent LLM request router with priority queues, multi-model routing, circuit breakers, and semantic caching

github.com/TjTheDj2011/llm-router

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.