Rare find

long-context-attention. USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

github.com/feifeibear/long-context-attention

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.