Tetris. Tetris optimizes the total throughput of batch speculative decoding in multi-request settings by strategically selecting draft tokens for verification.

github.com/ZhaoxuanWu/Tetris

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.