Rare find

Robotic Transformer. AI model that teaches robots to follow instructions from video and text.

github.com/lucidrains/robotic-transformer-pytorch
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

October 2024
  • Release —0.2.3
  • update to latest cfg library with better higher guidance
September 2024
  • Release —0.2.2
  • more informative error message
December 2023
  • Release —0.2.1
  • able to pass in text that has already been pre-embedded, for perf
  • Release —0.2.0
  • update dep, make sure cfg still works
November 2023
  • Release —0.1.1
  • bump
  • Revert "take a step towards eventual q-transformer support"
  • Revert "add an assert"
  • add an assert
  • take a step towards eventual q-transformer support
October 2023
  • Release —0.1.0
  • give the attention ability to noop
September 2023
  • Release —0.0.19
  • cleanup
  • Release —0.0.18
  • Release —0.0.17
  • 0.0.17
  • Merge pull request #5 from Dominique-Yiu/main
  • probably bug here
March 2023
  • Release —0.0.16
  • enforce latest classifier free guidance repo version
  • allow for cross attention based conditioning to text
December 2022
  • add adaptive layernorms for feedforward in transformer as well
  • add adaptive layernorm text conditioning for attention layers in RT-1
  • stress test classifier free guidance package
  • add a 1d sinusoidal positional embedding before last transformer