Rare find

MagViT2. A tool that turns video into a format AI models can understand and work with.

github.com/lucidrains/magvit2-pytorch

Problem

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Audience

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Market

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Pricing

The full read on this project is a sign-in away — what it solves, who it serves, and where it sits in the market.

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

January 2025

Release —0.5.1 Jan 12
needs to be zero centered GP Jan 12
Release —0.5.0 Jan 11
new paper claims gradient penalty on fake images as well as real stab… Jan 11

October 2024

update Oct 14

July 2024

Release —0.4.9 Jul 23
address https://github.com/lucidrains/magvit2-pytorch/issues/44 Jul 23
Release —0.4.8 Jul 22
0.4.8 Jul 22
address https://github.com/lucidrains/magvit2-pytorch/issues/43 Jul 22

June 2024

Release —0.4.6 Jun 26
Release —0.4.7 Jun 26
add ability to train with bsq Jun 26

May 2024

Release —0.4.5 May 16
make sure schedulers are prepared May 16
Release —0.4.4 May 8
add a soft clamping of value before LFQ step May 8
Release —0.4.3 May 7
address https://github.com/lucidrains/magvit2-pytorch/issues/18 May 7
Release —0.4.2 May 3
bump vq lib May 3
address https://github.com/lucidrains/vector-quantize-pytorch/issues/112 May 1

January 2024

start using a new linear attention from stanford Jan 18
address issue with encoding first frame separately https://github.com… Jan 12
0.3.2 Jan 7
dogfood a utility fn Jan 7
Merge pull request #24 from GMNGeoffrey/patch-1 Jan 7
Patch Jan 7
Merge pull request #27 from matwilso/patch-1 Jan 7
Fix causal info leakage in time downsample Jan 7