Rare find

NÜWA. Turn text descriptions into videos.

github.com/lucidrains/nuwa-pytorch

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

January 2023

Release —0.7.8 Jan 17
fix potential bug with discriminator training in vqgan-vae Jan 17

August 2022

Release —0.7.7a Aug 14
do attention in float32 always Aug 14
Release —0.7.7 Aug 14

April 2022

Release —0.7.6 Apr 28
lock codebook dimensions to 256, unless if overridden for something s… Apr 28
Release —0.7.5 Apr 28
only apply gradient penalty every 4th step, like stylegan Apr 28
Release —0.7.4 Apr 27
fix issue with EMA class Apr 27
Release —0.7.3 Apr 22
remove all biases, given results from PaLM as well as hearing about @… Apr 22
status Apr 21
Release —0.7.2 Apr 7
move all exponential moving average logic to separate class, add an E… Apr 7

March 2022

updates Mar 26
Release —0.7.1 Mar 24
cleanup Mar 24
Release —0.7.0 Mar 24
move to using causal convolutions through asymmetric padding Mar 24
reminder Mar 18
todo Mar 15
give axial relative positional bias to sparse 3d nearby attention for… Mar 15
todo item Mar 15
axial relative positional bias for sparse 2d nearby attention (audio) Mar 15
take care of random splitting of dataset for validation for training … Mar 15
add axial relative positional bias to sparse 3d nearby attention Mar 15
add axial positional embeddings to audio as well Mar 15
only sample one video when training NUWA, periodically Mar 12