Efficient Training
2022-applied-mathmetics-homework. 计算机应用数学作业
3Monarch-README. Dockerfile
2MatrixSketching. Code for sketching matrices with applications
1Analog-and-Digital-Circuits-Lab. Old files here
1fly. personal research based on fly
1Informer2020. The GitHub repository for the paper "Informer" accepted by AAAI 2021.
1ViTAE-Transformer. fish's fork of the official implementation for "ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias", "ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond".
1Database-Coursework. USTC 2021 Spring Database Labs
1gcn. Graph Convolutional Networks for Text Classification.
1flash-attention. Fast and memory-efficient exact attention
1DALI-L3. A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
1butterfly-r-transformer. R-Transformer with Butterfly Linear and RNN layers
1machinelearning. lianjianping's blogs and code for machine learning. http://cnblogs.com/pinard
1triton. Development repository for the Triton language and compiler
1cramming. Cramming the training of a (BERT-type) language model into limited compute.
1frequent-directions-experiments. Contains matrix sketching algorithms in python
1Browser-Erasure-Codec. HTML
1Power-Iteration-SVD. Backpropagation-Friendly-Eigendecomposition
1leeml-notes. 李宏毅《机器学习》笔记,在线阅读地址:https://datawhalechina.github.io/leeml-notes
1cutlass. CUDA Templates for Linear Algebra Subroutines
1hello-world. It's a hello-world repo built by fabfish.
1logging. MLPerf™ logging library
1butterfly. Butterfly matrix multiplication in PyTorch
1temp. Shell
1R-transformer. Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.
1