Rare find

iTransformer. AI model that predicts future values in time series data using attention networks.

github.com/lucidrains/iTransformer

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

June 2025
  • Release —0.8.1
  • 0.8.1
  • Merge pull request #37 from 2JS/main
  • fix forward returning dict on single prediction
December 2024
  • Release —0.8.0
  • change to prenorm and adopt hyper connections
  • Release —0.7.0
  • add value residual learning
May 2024
  • Release —0.6.0
  • receiving reports of instability when scaling up with the SiLU based …
January 2024
  • Release —0.5.5
  • address https://github.com/lucidrains/iTransformer/issues/22
  • Release —0.5.4
  • address https://github.com/lucidrains/iTransformer/issues/21
  • Release —0.5.3
  • remove underperforming variant
  • Release —0.5.2
  • address https://github.com/lucidrains/iTransformer/issues/20
December 2023
  • Release —0.5.1
  • latest pytorch
  • cite
  • Release —0.5.0
  • add a gateloop block for 2d itransformer, time axis
November 2023
  • patch
  • address https://github.com/lucidrains/iTransformer/issues/18
  • address https://github.com/lucidrains/iTransformer/issues/17
  • finish last thought with the repository. will revisit attention for t…
  • add iTransformer with fourier tokens
  • another shower thought
  • Merge pull request #16 from lucidrains/revin-turn-off-learned-affine