scaled_dot_product_attention. Implements the scaled dot product attention mechamism from the transformer. Vaswani, A. et al. https://arxiv.org/pdf/1706.03762.pdf

github.com/brandontrabucco/scaled_dot_product_attention

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.