Rare find

Sparse-vLLM. A sparse-first inference engine (sparsevllm). It also contains DeltaKV compressor training + evaluation tooling (deltakv).

github.com/CURRENTF/Sparse-vLLM

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.