Nitish Keskar

large-batch-training. Code to reproduce some of the figures in the paper "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima"

minSQN. Optimization using Stochastic quasi-Newton methods

NQN. A Limited-Memory Quasi-Newton Algorithm for Bound-Constrained Nonsmooth Optimization

OBA. A Second-Order Method for Convex L1-Regularized Optimization with Active-Set Prediction

SGDR. Python