Rare find

shimmy. ⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

github.com/Michael-A-Kuykendall/shimmy

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.