Kitty. Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.

github.com/Summer-Summer/Kitty

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.