Rare find

gdGPT. Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

github.com/CoinCheung/gdGPT

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.