Speeding up Computational Morphogenesis with Online Neural Synthetic Gradients

04/25/2021
by   Yuyu Zhang, et al.
6

A wide range of modern science and engineering applications are formulated as optimization problems with a system of partial differential equations (PDEs) as constraints. These PDE-constrained optimization problems are typically solved in a standard discretize-then-optimize approach. In many industry applications that require high-resolution solutions, the discretized constraints can easily have millions or even billions of variables, making it very slow for the standard iterative optimizer to solve the exact gradients. In this work, we propose a general framework to speed up PDE-constrained optimization using online neural synthetic gradients (ONSG) with a novel two-scale optimization scheme. We successfully apply our ONSG framework to computational morphogenesis, a representative and challenging class of PDE-constrained optimization problems. Extensive experiments have demonstrated that our method can significantly speed up computational morphogenesis (also known as topology optimization), and meanwhile maintain the quality of final solution compared to the standard optimizer. On a large-scale 3D optimal design problem with around 1,400,000 design variables, our method achieves up to 7.5x speedup while producing optimized designs with comparable objectives.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
09/24/2019

D3M: A deep domain decomposition method for partial differential equations

A state-of-the-art deep domain decomposition method (D3M) based on the v...
research
09/25/2019

Accelerating design optimization using reduced order models

Although design optimization has shown its great power of automatizing t...
research
11/11/2020

Optimization under rare chance constraints

Chance constraints provide a principled framework to mitigate the risk o...
research
09/15/2022

Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradients

Deep learning based approaches like Physics-informed neural networks (PI...
research
10/25/2021

Fast PDE-constrained optimization via self-supervised operator learning

Design and optimal control problems are among the fundamental, ubiquitou...
research
07/18/2023

Landscape Surrogate: Learning Decision Losses for Mathematical Optimization Under Partial Information

Recent works in learning-integrated optimization have shown promise in s...
research
01/29/2019

A Parallel Projection Method for Metric Constrained Optimization

Many clustering applications in machine learning and data mining rely on...

Please sign up or login with your details

Forgot password? Click here to reset