Decent-DP. A PyTorch extension that facilitates decentralized data parallel training. [ICLR'25] From Promise to Practice: Realizing High-performance Decentralized Training.

github.com/WangZesen/Decent-DP

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.