Pretraining-T5-PyTorch-Lightning. Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.

github.com/manueldeprada/Pretraining-T5-PyTorch-Lightning

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.