Beijing

Zihan Qiu

Intermediate
@qiuzh20

gated_attention. The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free

973

EMoE. Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]

39

RMoE. Official implementation of RMoE (Layerwise Recurrent Router for Mixture-of-Experts)

33

EEG-Cross-Subject-Emotion-Recognition. Python

10

HMA. HMA: Heterogenous Memory Augmented Neural Networks

5

Tuning-keys-v.s.-values. Official PyTorch Implementation of Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers [Tiny Paper @ ICLR 2024]

4

DL_project. Deep learning class project -- A rational search engine

3

eegnet_pytorch. EEGNet implementation in PyTorch

1

MemLMM. An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

1
9
Apply