Simon Schug

hypernetwork-attention. Official code for the paper "Attention as a Hypernetwork"

equilibrium-propagation. Fully documented Pytorch implementation of the Equilibrium Propagation algorithm.

jax-hypernetwork. A simple hypernetwork implementation in jax using haiku.

metax. flexible meta-learning in jax

scale-compositionality. Official code for the paper Scale leads to compositional generalization.

contrastive-meta-learning. Code accompanying the paper "A contrastive rule for meta-learning"

modular-hyperteacher. Code accompanying the paper Discovering modular solutions that generalize compositionally

autofsdp. Fully-sharded data parallelism (FSDP) in jax with minimal code changes.

sparsely-gated-linear. Official code for the paper "Sparsely gated tiny linear experts"

flaxify. Convert haiku modules to flax

shrink-perturb. Optax implementation of shrink and perturb (Ash & Adams, 2020).

git-workshop. Git Workshop at Frankfurt Open Science Initiative

minimal-hypernetwork. Minimal hypernetwork implementation.

presynaptic-stochasticity. Presynaptic Stochasticity Improves Energy Efficiency and Alleviates the Stability-Plasticity Dilemma

llm-humanness. Are they human? Detecting large language models by probing human memory constraints

jax-meta-learning. A collection of meta-learning algorithms in Jax

cryptography-workshop. Cryptography Workshop for hebbian.ch

rotation-trick-jax. JAX implementation of rotation trick