tiny-llm. A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

github.com/ekzhang/tiny-llm

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.