DSOS and SDSOS Optimization: More Tractable Alternatives to Sum of Squares and Semidefinite Optimization

06/08/2017
by   Amir Ali Ahmadi, et al.
0

In recent years, optimization theory has been greatly impacted by the advent of sum of squares (SOS) optimization. The reliance of this technique on large-scale semidefinite programs however, has limited the scale of problems to which it can be applied. In this paper, we introduce DSOS and SDSOS optimization as more tractable alternatives to sum of squares optimization that rely instead on linear and second order cone programs respectively. These are optimization problems over certain subsets of sum of squares polynomials (or equivalently subsets of positive semidefinite matrices), which can be of interest in general applications of semidefinite programming where scalability is a limitation. We show that some basic theorems from SOS optimization which rely on results from real algebraic geometry are still valid for DSOS and SDSOS optimization. Furthermore, we show with numerical experiments from diverse application areas---polynomial optimization, statistics and machine learning, derivative pricing, and control theory---that with reasonable tradeoffs in accuracy, we can handle problems at scales that are currently far beyond the reach of sum of squares approaches. Finally, we provide a review of recent techniques that bridge the gap between our DSOS/SDSOS approach and the SOS approach at the expense of additional running time. The appendix of the paper introduces an accompanying MATLAB package for DSOS and SDSOS optimization.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/19/2018

Optimization over Nonnegative and Convex Polynomials With and Without Semidefinite Programming

The problem of optimizing over the cone of nonnegative polynomials is a ...
research
10/09/2017

Response to "Counterexample to global convergence of DSOS and SDSOS hierarchies"

In a recent note [8], the author provides a counterexample to the global...
research
11/22/2016

Geometry of 3D Environments and Sum of Squares Polynomials

Motivated by applications in robotics and computer vision, we study prob...
research
06/28/2023

Theory and applications of the Sum-Of-Squares technique

The Sum-of-Squares (SOS) approximation method is a technique used in opt...
research
08/14/2019

A Survey of Recent Scalability Improvements for Semidefinite Programming with Applications in Machine Learning, Control, and Robotics

Historically, scalability has been a major challenge to the successful a...
research
06/19/2019

Engineering and Business Applications of Sum of Squares Polynomials

Optimizing over the cone of nonnegative polynomials, and its dual counte...
research
03/17/2022

Learning Distributionally Robust Models at Scale via Composite Optimization

To train machine learning models that are robust to distribution shifts ...

Please sign up or login with your details

Forgot password? Click here to reset