wikidl. WikiDL is an efficient wikipedia data dump downloader for researchers. It uses multiprocessing for maxing out the bandwidth and CPUs, and is friendly with task schedulers like Slurm.

github.com/lilingxi01/wikidl

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.