I am third-year Ph.D. candidate, advised by Prof. @yuanli2333
FSDP-Training. Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA
LinB203.github.io. personal website
LinB203.
