Rare find

DSKD. Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same-tokenizer and cross-tokenizer LLM distillation.

github.com/songmzhang/DSKD

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.