Learn Transformers. Course materials for understanding how AI reads and understands text.

github.com/jamescalam/transformers

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

October 2021
  • Update README.md
  • Merge pull request #10 from captnTardigrade/main
  • limit the output of tokens list to 10 indices
September 2021
  • Update README.md
  • Merge pull request #8 from jamescalam/dependabot/pip/tensorflow-2.5.1
August 2021
  • Bump tensorflow from 2.5.0 to 2.5.1
  • fixed true/predicted output
  • fixed typo that swapped true/predicted values
June 2021
  • added notebook for further training pre-existing filiberto model
  • finished code for training filiberto italian roberta model
  • updated bert from scratch for roBERTa model
  • added bert from scratch pipeline and training
  • added new section for training models from scratch
  • added MIT license
  • Merge pull request #4 from ilangurudev/patch-1
  • Adding ipykernel to requirements.txt
  • removed PyTorch from env due to cross-OS and CUDA complexities
  • added course link
May 2021
  • added instructions for installing kernel in Jupyter
  • updated yaml