PyTorch Memory Optimizer. Code examples showing how to train large AI models without running out of computer memory.

lightning.ai/pages/community/tutorial/pytorch-memory-vit-llm

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

July 2023
  • update overview figure
  • add vit32 experiments
  • add vit32 experiments
  • Update requirements.txt including datasets
June 2023
  • overview
  • add 11 as another bonus
  • cleanup
  • bigbird experiments
  • sync
  • sync
  • Initial commit