DataPipes. Working examples of how to load different types of data for machine learning.

sebastianraschka.com/blog/2022/datapipes.html

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

June 2022
  • place sharder after shuffler
  • sharding
  • fix link
  • datapipe code
  • Update README.md
  • Update README.md
  • some final updates
  • remove len
  • shuffle
  • update 3
  • add precommit hooks
  • set up precommit hook
  • basic dataset and dataloader
  • obtain the dataset nb
  • Initial commit