Rare find

soft-mixture-of-experts. PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)

github.com/fkodom/soft-mixture-of-experts

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.