MI-optimize. mi-optimize is a versatile tool designed for the quantization and evaluation of large language models (LLMs). The library's seamless integration of various quantization methods and evaluation techniques empowers users to customize their approaches according to specific requirements and constraints, providing a high level of flexibility.

github.com/TsingmaoAI/MI-optimize

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.