Rare find

the-story-of-heads. This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the ACL 2021 paper "Analyzing Source and Target Contributions to NMT Predictions".

github.com/lena-voita/the-story-of-heads

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.