numpygrad. GPT-2 train from scratch in pure NumPy, verified against PyTorch. I have written a blog explaining all the math. Check out the website.https://x.com/HarshalsinghCN/status/2055154124535287829?s=20

github.com/harrrshall/numpygrad

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.