mlx-manager. An optimized MLX (Apple Silicon Metal) Server for running local LLMs with higher performance inference using KV cache, batching, and parallel processing. Easy to configure UI and support for both OpenAI and Anthropic protocols

github.com/tumma72/mlx-manager

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.