Gemma-4-31B-MTP-vLLM-Server. A production-minded FastAPI sidecar for serving Gemma 4 31B on vLLM with Gemma 4 Multi-Token Prediction (MTP) speculative decoding.

github.com/alicankiraz1/Gemma-4-31B-MTP-vLLM-Server

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.