willow-inference-server. Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS

github.com/aantonop/willow-inference-server

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.