Optimization-Informed Neural Networks

10/05/2022
by   Dawen Wu, et al.
0

Solving constrained nonlinear optimization problems (CNLPs) is a longstanding problem that arises in various fields, e.g., economics, computer science, and engineering. We propose optimization-informed neural networks (OINN), a deep learning approach to solve CNLPs. By neurodynamic optimization methods, a CNLP is first reformulated as an initial value problem (IVP) involving an ordinary differential equation (ODE) system. A neural network model is then used as an approximate solution for this IVP, with the endpoint being the prediction to the CNLP. We propose a novel training algorithm that directs the model to hold the best prediction during training. In a nutshell, OINN transforms a CNLP into a neural network training problem. By doing so, we can solve CNLPs based on deep learning infrastructure only, without using standard optimization solvers or numerical integration solvers. The effectiveness of the proposed approach is demonstrated through a collection of classical problems, e.g., variational inequalities, nonlinear complementary problems, and standard CNLPs.

READ FULL TEXT
research
12/31/2022

Physics-informed Neural Networks approach to solve the Blasius function

Deep learning techniques with neural networks have been used effectively...
research
07/09/2020

A blueprint for building efficient Neural Network Differential Equation Solvers

Neural Networks are well known to have universal approximation propertie...
research
01/16/2022

Solving Inventory Management Problems with Inventory-dynamics-informed Neural Networks

A key challenge in inventory management is to identify policies that opt...
research
08/22/2023

Multi-level Neural Networks for Accurate Solutions of Boundary-Value Problems

The solution to partial differential equations using deep learning appro...
research
08/23/2022

Reduced-PINN: An Integration-Based Physics-Informed Neural Networks for Stiff ODEs

Physics-informed neural networks (PINNs) have recently received much att...
research
09/06/2019

Port-Hamiltonian Approach to Neural Network Training

Neural networks are discrete entities: subdivided into discrete layers a...
research
12/14/2020

On the Treatment of Optimization Problems with L1 Penalty Terms via Multiobjective Continuation

We present a novel algorithm that allows us to gain detailed insight int...

Please sign up or login with your details

Forgot password? Click here to reset