ICLR 2015
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba
Follow Adam’s first and second moment estimates, derive zero-initialization bias correction, inspect epsilon placement, and separate useful optimization practice from convergence guarantees.
