Deep Reinforcement Learning for Computational Fluid Dynamics on HPC Systems

05/13/2022
by   Marius Kurz, et al.
0

Reinforcement learning (RL) is highly suitable for devising control strategies in the context of dynamical systems. A prominent instance of such a dynamical system is the system of equations governing fluid dynamics. Recent research results indicate that RL-augmented computational fluid dynamics (CFD) solvers can exceed the current state of the art, for example in the field of turbulence modeling. However, while in supervised learning, the training data can be generated a priori in an offline manner, RL requires constant run-time interaction and data exchange with the CFD solver during training. In order to leverage the potential of RL-enhanced CFD, the interaction between the CFD solver and the RL algorithm thus have to be implemented efficiently on high-performance computing (HPC) hardware. To this end, we present Relexi as a scalable RL framework that bridges the gap between machine learning workflows and modern CFD solvers on HPC systems providing both components with its specialized hardware. Relexi is built with modularity in mind and allows easy integration of various HPC solvers by means of the in-memory data transfer provided by the SmartSim library. Here, we demonstrate that the Relexi framework can scale up to hundreds of parallel environment on thousands of cores. This allows to leverage modern HPC resources to either enable larger problems or faster turnaround times. Finally, we demonstrate the potential of an RL-augmented CFD solver by finding a control strategy for optimal eddy viscosity selection in large eddy simulations.

READ FULL TEXT

page 4

page 10

research
11/04/2021

Control of a fly-mimicking flyer in complex flow using deep reinforcement learning

An integrated framework of computational fluid-structural dynamics (CFD-...
research
06/06/2023

BackpropTools: A Fast, Portable Deep Reinforcement Learning Library for Continuous Control

Deep Reinforcement Learning (RL) has been demonstrated to yield capable ...
research
02/14/2023

Learning a model is paramount for sample efficiency in reinforcement learning control of PDEs

The goal of this paper is to make a strong point for the usage of dynami...
research
07/18/2022

Development of Massively Parallel Near Peak Performance Solvers for Three-Dimensional Geodynamic Modelling

We address in this thesis the current need to design new parallel algori...
research
05/01/2022

Data-driven control of spatiotemporal chaos with reduced-order neural ODE-based models and reinforcement learning

Deep reinforcement learning (RL) is a data-driven method capable of disc...
research
11/13/2021

Deep Reinforcement Learning with Shallow Controllers: An Experimental Application to PID Tuning

Deep reinforcement learning (RL) is an optimization-driven framework for...
research
07/02/2021

Neko: A Modern, Portable, and Scalable Framework for High-Fidelity Computational Fluid Dynamics

Recent trends and advancement in including more diverse and heterogeneou...

Please sign up or login with your details

Forgot password? Click here to reset