Rare find

Q-Transformer. Train robots from recorded experience without real-world trial and error.

github.com/lucidrains/q-transformer
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

June 2025
  • readme
May 2025
  • Release —0.4.5
  • add dual critics to treat overestimation issue
February 2025
  • cleanup a little
  • Release —0.4.3
  • address https://github.com/lucidrains/q-transformer/issues/17
  • Release —0.4.2
  • for classification, the q value used in bellman must be transformed f…
  • Release —0.4.1
  • dog food a binary version
  • make sure classification loss works e2e
  • Release —0.4.0
  • allow for classification loss using bce, with histogram loss applied …
  • let the q-robotic-transformer output raw logits, in preparation to su…
  • Release —0.3.3
  • use x-transformers for attend function, in preparation to build upon …
  • use unit offset trick from ohad rubin and remove optimizer parameter …
  • some cleanup
  • Release —0.3.1
  • address https://github.com/lucidrains/q-transformer/issues/16
January 2025
  • Release —0.3.0
  • hyperconnect the transformers, ready to resume work on model free app…
December 2024
  • link to paper
November 2024
  • fix pytest
  • Release —0.2.2
  • get ready to expand on this work
October 2024
  • Release —0.2.1
  • update to latest cfg lib with latest research finding + fix a warning
August 2024
  • add regenerative regularization and cite
  • actually remove all traces of torchtyping and add sentencepiece