Rare find

SoundStorm. Generate complete audio clips in parallel instead of one piece at a time.

github.com/lucidrains/soundstorm-pytorch
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

April 2025
  • Release —0.6.1
  • first attention layer does not have value residual mixing
  • Release —0.6.0
  • after all this time, a group (in korea?) finally trained a very succe…
October 2024
  • Release —0.5.0
  • add value residual learning, given people are interested in this agai…
September 2024
  • Release —0.4.11
  • fix torch autocast warning and cleanup
  • Release —0.4.10
  • address https://github.com/lucidrains/soundstorm-pytorch/issues/40
  • Release —0.4.9
  • address https://github.com/lucidrains/soundstorm-pytorch/issues/37
  • Release —0.4.8
  • 0.4.8
  • address https://github.com/lucidrains/soundstorm-pytorch/issues/36 again
  • Release —0.4.7
  • address https://github.com/lucidrains/soundstorm-pytorch/issues/36
  • Release —0.4.6
  • address https://github.com/lucidrains/soundstorm-pytorch/issues/35
  • Release —0.4.5
May 2024
  • 0.4.3
  • Merge pull request #33 from osehmathias/patch-1
  • update: replace @beartype any with Any in ConformerWrapper
February 2024
  • address https://github.com/lucidrains/soundstorm-pytorch/issues/29
  • potential fix for an issue in generate, identified by @Jiang-Stan htt…
December 2023
  • successfully trained by a few groups, so I've heard
  • add gateloop layer
  • quick fix
November 2023
  • address potential issue with ds conv, thanks to @Jiang-Stan https://g…
September 2023
  • fix readme