modal-aphro-inference. Serverless LLM Inference with Aphrodite and Tensorize on Modal

github.com/nyxkrage/modal-aphro-inference

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.