My Final Project at AMMI is on Optimization for Machine Learning. I am trying to give some convergence results of some optimization algorithms like Adam. If possible I will try proving the convergence of ADAM/AMSGRAD using a Lyaponuv method.