Rare find
Reformer. A faster way to run AI language models that handles longer text without running out of memory.
github.com/lucidrains/reformer-pytorch
Vaya's read on this project
Problem, audience, market, and the verdict — sign in to see it.
Updates
June 2023
- Merge pull request #151 from lucidrains/dependabot/pip/pretraining/tr…
- Bump transformers from 2.4.1 to 4.30.0 in /pretraining
June 2022
- Merge pull request #150 from lucidrains/dependabot/pip/pretraining/nu…
- Bump numpy from 1.18.1 to 1.22.0 in /pretraining
November 2021
- Release —1.4.4
- make sure rotary embedding positions are cast to same type as qk
August 2021
- Release —1.4.3
- update flag for turning on axial positional embedding and update readme
May 2021
- Release —1.4.2
- remove unused keyword argument on Reformer class
- Release —1.4.1
- make sure rotary embeddings is only applied to original sequence in t…
April 2021
- Release —1.4.0
- add and default to rotary positional embeddings
March 2021
- Release —1.2.6
- new paper suggests that feedforwards needs to be present
February 2021
- Release —1.2.5
- release
- Merge pull request #129 from maclandrol/dev
- replace bug in layer norm
December 2020
- update readme
- Release —1.2.4
- Update setup.py
- Update reformer_enc_dec.py
November 2020
- Release —1.2.3
- bump
- Merge pull request #121 from wangyu1997/dev
- small fix
- handle the overlap problem in hash vector without rehash
- Release —1.2.2