roymiles

VkD. [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections

VeLoRA. [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections

Simple-Recipe-Distillation. [AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation

ITRD. [BMVC 2022] Information Theoretic Representation Distillation

diffusion-stitching. Stitching Noisy Diffusion Thoughts for Better Reasoning

hardnet-tensorflow. HardNet implementation in Tensorflow.

buggy-project. C++

fpga-bnn. C++

buggy-server. Python

roymiles.github.io. CSS

machine-learning-gui. C++

sdl-game-engine. C

tensor-networks. Python

torchdistill. A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆23 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.

consumer-brain-wave-interface. Consumer brain wave interface

cms-client. JavaScript framework to interact with the server side CMS

style-transfer-server. Python

cms-server. PHP