Rare find

Conformer. A Python tool that adds local pattern recognition to transformer AI models.

github.com/lucidrains/conformer

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

May 2023
  • Release —0.3.2
  • make conformer able to do things autoregressively, to save issues wit…
  • Release —0.3.1
  • store the dimension for access
  • complete the conformer, just layers of conformer blocks, to ready for…
  • Release —0.3.0
April 2021
  • Release —0.2.5
  • 0.2.5
  • clip to clamp
  • Release —0.2.4
January 2021
  • incorporate some einops suggestions from @arogozhnikov
  • Release —0.2.3
  • move dropout to be faithful to paper
  • Release —0.2.2
  • 0.2.2
  • add shaws relative positional embedding
  • update readme
  • Release —0.2.1
  • bump
  • Release —0.2.0
  • release 1 conformer block
October 2020
  • Release —0.1.0
  • fix depth-wise conv
  • fix even kernel size bug
July 2020
  • make it clear in the example that residual not included
  • add causal variant
  • Create python-publish.yml
  • fix readme
  • first commit
  • add diagram