Rare find

vllm-mlx. OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.

github.com/waybarrios/vllm-mlx

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.