Rare find

Titans. A memory system that lets AI models remember and use long documents without running out of space.

github.com/lucidrains/titans-pytorch

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

July 2026
  • address an issue with an experimental idea for the edge case of sampl…
June 2026
  • remove github
  • Merge pull request #60 from thehalleyyoung/fix/demo-return-kv-cache
  • Pass return_kv_cache=True in nested/implicit attention demos
February 2026
  • Release —0.5.3
  • incorporate storing of memories with lookahead values, finding from S…
January 2026
  • Release —0.5.1
  • turns out there is a bug with neural memory cache state misalignment …
  • Release —0.5.0
  • mHC from deepseek
  • Release —0.4.25
  • address https://github.com/lucidrains/titans-pytorch/issues/56
  • Release —0.4.24
December 2025
  • address https://github.com/lucidrains/titans-pytorch/issues/53
  • Release —0.4.23
  • make experiment script uv runnable - uv should just become the defaul…
  • agree with Yannic's critiques
November 2025
  • Release —0.4.22
  • make sure nested attn converges
  • Release —0.4.21
  • quick fix
  • throw out yet another idea
  • Release —0.4.20
  • tweak
  • actually add the script..
  • Release —0.4.19
  • enwik8 for implicit mlp attn
  • maybe key rmsnorm for implicit mlp attention
  • cleanup improv
  • close the connection