Rare find

MinGPT. A clean, simple version of GPT you can actually read and understand.

github.com/karpathy/minGPT

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

January 2023
  • Update README.md
August 2022
  • Merge pull request #84 from ericjang/master
  • Add setup.py to allow mingpt to be used as a third-party library
July 2022
  • Merge pull request #83 from mishig25/patch-1
  • Use XOR operator `^` for checking assertion `type_given XOR params_gi…
  • Merge pull request #82 from neverix/patch-1
  • Fix README.md typo
  • Merge pull request #81 from luigidisotto/callbacks-optimizer
  • Add optimizer to Trainer's self for callbacks.
  • use a bit more extended example that has my last name too because nic…
  • add a full example into the script as well
  • Merge pull request #78 from nat/patch-1
  • Typos
  • adjust the readme docs to reflect bpe changes
  • add a refactored BPE encoder from openai. Basically I dont super trus…
  • few added todo notes to readme
  • refactor sequence generation into the model and match the huggingface…
  • small typo fixes in readme
  • quick docs on some planned todos
  • make generation script into a notebook, makes much more sense that wa…