New convergence issues found in AMSGrad and a new version proposed.
problem AMSGrad convergence proof issues and neglected hyper-parameter treatment.
method Provided counter-example and proposed new convergence proof and version.
result AMSGrad convergence proof issues and new version AMSX.