Rare find

vmlx. vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!

github.com/jjang-ai/vmlx

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.