inferflow. Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

github.com/tencent-ailab/inferflow

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.