DeepAI AI Chat
Log In Sign Up

Optimization-Informed Neural Networks

by   Dawen Wu, et al.

Solving constrained nonlinear optimization problems (CNLPs) is a longstanding problem that arises in various fields, e.g., economics, computer science, and engineering. We propose optimization-informed neural networks (OINN), a deep learning approach to solve CNLPs. By neurodynamic optimization methods, a CNLP is first reformulated as an initial value problem (IVP) involving an ordinary differential equation (ODE) system. A neural network model is then used as an approximate solution for this IVP, with the endpoint being the prediction to the CNLP. We propose a novel training algorithm that directs the model to hold the best prediction during training. In a nutshell, OINN transforms a CNLP into a neural network training problem. By doing so, we can solve CNLPs based on deep learning infrastructure only, without using standard optimization solvers or numerical integration solvers. The effectiveness of the proposed approach is demonstrated through a collection of classical problems, e.g., variational inequalities, nonlinear complementary problems, and standard CNLPs.


Physics-informed Neural Networks approach to solve the Blasius function

Deep learning techniques with neural networks have been used effectively...

A blueprint for building efficient Neural Network Differential Equation Solvers

Neural Networks are well known to have universal approximation propertie...

Solving Inventory Management Problems with Inventory-dynamics-informed Neural Networks

A key challenge in inventory management is to identify policies that opt...

Multi-level Neural Networks for Accurate Solutions of Boundary-Value Problems

The solution to partial differential equations using deep learning appro...

Reduced-PINN: An Integration-Based Physics-Informed Neural Networks for Stiff ODEs

Physics-informed neural networks (PINNs) have recently received much att...

Port-Hamiltonian Approach to Neural Network Training

Neural networks are discrete entities: subdivided into discrete layers a...

On the Treatment of Optimization Problems with L1 Penalty Terms via Multiobjective Continuation

We present a novel algorithm that allows us to gain detailed insight int...