CirculantAttention.jl. Deep-learning sliding window attention with circular boundary conditions. No tokenization, no patchify-ing.

github.com/nikopj/CirculantAttention.jl

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.