Rare find

Spear TTS. Turn text into speech that sounds like different people.

github.com/lucidrains/spear-tts-pytorch
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

October 2023
  • Release —0.4.8
  • patch
  • Merge pull request #11 from KonstantineGoudz/main
  • use cuda to generate audio - text data set
  • Release —0.4.7
  • omit the wav2vec parameters from optimizers
  • Release —0.4.6
  • make sure wav2vec is done in eval mode and without gradients
  • Release —0.4.5
  • address https://github.com/lucidrains/spear-tts-pytorch/pull/9
  • Release —0.4.4
  • quick fix for spec decoding
September 2023
  • cleanup
  • Release —0.4.3
  • fix default topk sampling filter threshold
  • Release —0.4.2
  • Update setup.py
  • Merge pull request #8 from lucasnewman/fix-validation
  • Fix an assert when running validation during training.
  • Release —0.4.1
  • take care of eos during spec decoding
  • Release —0.4.0
  • finally complete speculative decoding with early exit strategy for mo…
  • early exit at layer is only done at inference time, in which hiddens …
  • Release —0.3.14
  • give the early exit path an extra feedforward transformer block, and …
  • decoder is now setup for early exit speculative decoding strategy
  • cite technique to be employed
  • early exit layer should have its own separate layernorm before projec…
  • take first step towards training an early exit layer in the decoder, …