Rare find

Singing-Vocal-Beat-Tracking. This repo contains the source code of the first deep learning-base singing voice beat tracking system. It leverages WavLM and DistilHuBERT pre-trained speech models to create vocal embeddings and trains linear multi-head self-attention layers on top of them to extract vocal beat activations. Then, it uses HMM decoder to infer signing beats and tempo.

github.com/mjhydri/Singing-Vocal-Beat-Tracking

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.