Rare find

Large World Model. An AI model that understands long videos and books together.

largeworldmodel.github.io

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

October 2024
  • pin for future tokenizer
  • Merge branch 'main' of github.com:LargeWorldModel/lwm into main
  • updates
August 2024
  • raise an exception of max_sequence_length is smaller than the input s…
  • Fix inference
July 2024
  • use scan to control remat
  • update ringattention version
June 2024
  • simplify code with importing ringattention
  • switch to autotokenizer for simplicity
May 2024
  • updated jax version
  • Fix ring attention inference GPU issue
March 2024
  • Add data and sharding docs
February 2024
  • Added PyTorch sampling script + more detailed descriptions for runnin…
  • Add needle haystack data script
  • Merge pull request #26 from ruslanmustafin/main
  • Enforce RGB
  • Update better default mesh_dim for inference scripts
  • Update better default mesh_dim
  • Updated docs and instructions
  • enforce RGB when reading images