Yihe Dong

attention-rank-collapse. [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.

learn-to-hash. Neural LSH [ICLR 2020] - Using supervised learning to produce better space partitions for fast nearest neighbor search.

HNHN. Hypergraph representation learning: Hypergraph Networks with Hyperedge Neurons.

coin-press. [NeurIPS 2020] Simple and practical private mean and covariance estimation.

que-outlier-detection. [NeurIPS 2019 Spotlight] High dimensional mean estimation and outlier detection in nearly-linear time.

copt. [NeurIPS 2020]. COPT - Coordinated Optimal Transport on Graphs

fast_ot. A study of performance of optimal transport.

fsck. Check and fix UNIX xv6 file system damages.

funML. Machine learning algorithms.

crossword. Crossword puzzle generator

learn_to_hash. Python

Algorithms. Collection of fun algorithms and data structures.

SentenceGenerator. Generates sentences based on token dependency probabilities.

knn_vgg. Epic comparison between feature clustering vs additional layers with various numbers of layers peeled off from VGG.

optimal_transport. An ongoing collection of optimal transport codes.

dynamicModel. Modeled a dynamic system of neurons using differential equations.

concurrency. Implemented concurrency architecture on Unix xv6.