Rare find

ome. Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

github.com/ome-projects/ome

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.