Rare find

Phenaki. Turn text descriptions into videos up to two minutes long.

github.com/lucidrains/phenaki-pytorch
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

July 2024
  • use future annotations
  • Release —0.5.0
  • address https://github.com/lucidrains/phenaki-pytorch/issues/42
December 2023
  • Release —0.4.2
  • update to working lfq
October 2023
  • Release —0.4.1
  • fix lookup of codes when using LFQ
  • Release —0.4.0
  • start adopting finite scalar / lookup free quantization for vae
March 2023
  • Release —0.3.1
  • update ema
February 2023
  • Release —0.3.0
  • bet on new attention stabilization technique
  • Release —0.2.0
  • adopt dual patchnorm design
January 2023
  • Release —0.1.1
  • make cvivit required
  • Release —0.1.0
  • greatly simplify token critic training, as seeing good results elsewh…
  • get rid of one layer of indirection, in preparation of simplifying cr…
  • Release —0.0.72
  • token critic should be able to see the prime as well
  • should be using 1 - probs for score
  • remove wip
  • fix a discriminator gradient issue, thanks to @apoorv2904
  • quick fix
  • fix bug with random video frame selection for discriminator losses in…
  • fix sampling when training only on images
  • each batch can now be trained with many different random timesteps (d…
  • save and load methods for cvivit