Rare find

llm-datasets. A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.

github.com/malteos/llm-datasets

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.