Rare find

photon_infer. A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching

github.com/lumia431/photon_infer

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.