Z.X.
ExpertI am an Assistant Professor leading xLeaF Lab@HKUST(GZ) that is generally interested in understanding and solving fundamental issues of modern AI.
adaptive-inertia-adai. [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum".
150stable-weight-decay-regularization. [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.
61artificial-neural-variability-for-deep-learning. [Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neural Computation paper: Artificial Neural Variability for Deep Learning: On overfitting, Noise Memorization, and Catastrophic Forgetting.
33Positive-Negative-Momentum. [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.
28