mlx-router. An OpenAI-compatible inference server optimized for Apple Silicon. Hot-swap between MLX models, stream responses in real-time, process images and PDFs, and integrate with any OpenAI client.

github.com/henrybravo/mlx-router

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.