Tri Dao

flash-attention-wheels. C++

zoo. Python

leastsquares. CS 240H final project

trlx. A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

pytorch-lightning. The lightweight PyTorch wrapper for ML researchers. Scale your models. Write less boilerplate