Rare find

CoCa. AI model that understands images and writes captions about them.

github.com/lucidrains/CoCa-pytorch
by @lucidrains

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

December 2023
  • readme
October 2023
  • Release —0.1.0
  • missing fn https://github.com/lucidrains/CoCa-pytorch/issues/18
September 2023
  • Release —0.0.12
  • slightly more efficient
  • Release —0.0.11
  • Release —0.0.10
  • start handling the distributed case
  • Release —0.0.9
  • 0.0.9
  • Release —0.0.8
  • address https://github.com/lucidrains/CoCa-pytorch/issues/17
December 2022
  • update example with vit with patch dropout
  • Release —0.0.7
  • address https://github.com/lucidrains/CoCa-pytorch/issues/10
November 2022
  • encourage use of simple vit
July 2022
  • update readme example with vit
June 2022
  • Release —v0.0.6
  • vision transformer actually is not frozen, thanks to @Flowerfan for p…
May 2022
  • clarity
  • Release —0.0.5
  • expose latent dim
  • Release —0.0.4
  • 0.0.4
  • move out embed text and image to its own functions, for potential int…
  • comments and some cleanup
  • norm the image tokens in the attention pool, was not clear in the paper
  • cite, remove wip, update readme
  • first pass
  • scaffold