Rare find

SparK. [ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

github.com/keyu-tian/SparK

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.