mlx-openai-server. A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.

github.com/josefprusa/mlx-openai-server

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.