DeepGradientCompression. It is implementation of Research paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING". Deep gradient compression is a technique by which the gradients are compressed before they are being sent. This approach greatly reduces the communication bandwidth and thus improves multi node training.

github.com/Tejalsjsu/DeepGradientCompression

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.