Rare find

MinGRU. A simpler, faster AI neural network building block for sequence processing.

github.com/lucidrains/minGRU-pytorch

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

December 2025
  • ask antigravity to update scripts to use accelerate
March 2025
  • Release —0.2.1
  • 0.2.1
  • Merge pull request #19 from mvecdigonul/main
  • dropout is added to minLM
  • fixed assertion to correctly handle cached hidden states for conv layers
February 2025
  • Merge pull request #18 from mbrotos/patch-1
  • Fix minLM import
  • Release —0.2.0
  • release minLSTM from @mbrotos and allow for easy usage in language mo…
  • Merge pull request #17 from mbrotos/main
  • Create minLSTM.py
December 2024
  • Release —0.1.1
  • seeing a clear benefit when letting token / head specialize. let some…
  • Release —0.1.0
  • explore hybrid design
November 2024
  • Release —0.0.14
  • address https://github.com/lucidrains/minGRU-pytorch/issues/12
October 2024
  • Merge pull request #5 from KTibow/patch-1
  • link to yannic
  • Release —0.0.12
  • address https://github.com/lucidrains/minGRU-pytorch/issues/9
  • Update printing in train.py
  • final commit
  • Release —0.0.11
  • address https://github.com/lucidrains/minGRU-pytorch/issues/4
  • Release —0.0.10
  • Release —0.0.8
  • address https://github.com/lucidrains/minGRU-pytorch/issues/3
  • Release —0.0.7