loraplex. A simple L7 proxy for vLLM that manages LoRA adapter storage via NVMe, routes requests, and pins workloads to nodes

github.com/shayonj/loraplex

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.