This is the official repo for the Supercomputing System and AI Lab (SSAIL) at University of Illinois at Urbana-Champaign
MegaFold. Python
74MiLo. Code repo for efficient quantized MoE inference with mixture of low-rank compensators
39VecFlow. Cuda
37X-MoE. Python
30InstantEdit. Python
20VoltanaLLM. Python
13FlexGaussian. Python
11STEP. Python
11SuperInfer. Python
11MedCite. Python
8MiniKV. Python
5SuperOffload. Shell
4UniversalCheckpointing. Python
4PuzzleMoE. Python
3Megatron-DeepSpeed. Ongoing research training transformer language models at scale, including: BERT & GPT-2
2Supercomputing-System-AI-Lab.github.io. Website URL
2DeepSpeed. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
2