TimeSformer. AI model that understands what's happening in videos.

github.com/lucidrains/TimeSformer-pytorch
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

August 2021
  • Release —0.4.1
  • default token shift to false
  • Release —0.4.0
  • add token shifting along time axis, from token shift transformer paper
July 2021
  • Release —0.3.3
  • 0.3.3
  • Merge pull request #16 from aarti9/main
  • Update timesformer_pytorch.py
April 2021
  • Release —0.3.2
  • patch
  • Release —0.3.1
  • cleanup
  • add rotary embeddings
  • Release —0.2.1
  • 0.2.1
  • Merge pull request #14 from quaertym/patch-1
  • Set frame_mask and cls_attn_mask if mask is None
  • add ability to mask out frames, for variable lengthed videos in the s…
March 2021
  • Release —0.1.1
  • back to layer norm
  • Release —0.1.0
  • switch to rmsnorm instead, due to nice results from transformer modif…
  • Release —0.0.5
  • switch to scalenorm
  • readme
February 2021
  • Release —0.0.4
  • use geglu variant of feedforward
  • bug
  • readme
  • fix prenormalization