gpt-neo. An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.

github.com/miolini/gpt-neo

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.