Potential-Function Proofs for First-Order Methods

12/13/2017

∙

by   Nikhil Bansal, et al.

∙

0

∙

share

This note discusses proofs for convergence of first-order methods based on simple potential-function arguments. We cover methods like gradient descent (for both smooth and non-smooth settings), mirror descent, and some accelerated variants.