LLM-quantization-basic. 包括对称动态/静态量化,量化感知,8bit量化,QLoRA4bit量化的示例代码

github.com/sea-abc/LLM-quantization-basic

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.