Awesome-Knowledge-Distillation-of-LLMs. This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". It includes KD Algorithms (Labeling, Self-Knowledge, Self-Rewarding, SFT, etc.) leveraging data augmentation or synthesis for getting knowledge, Skill Distillation (e.g. instruction following), and specialized applications (law, healthcare).

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.