Rare find

duo-attention. [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads

github.com/mit-han-lab/duo-attention

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.