A review on deep reinforcement learning for fluid mechanics: an update

J Viquerat (1) , P Meliga (1) , A Larcher (1) , E Hachem (1)

1 CEMEF - Centre de Mise en Forme des Matériaux

In the past couple of years, the interest of the fluid mechanics community for deep reinforcement learning (DRL) techniques has increased at fast pace, leading to a growing bibliography on the topic. Due to its ability to solve complex decision-making problems, DRL has especially emerged as a valuable tool to perform flow control, but recent publications also advertise great potential for other applications, such as shape optimization or micro-fluidics. The present work proposes an exhaustive review of the existing literature, and is a follow-up to our previous review on the topic. The contributions are regrouped by domain of application, and are compared together regarding algorithmic and technical choices, such as state selection, reward design, time granularity, and more. Based on these comparisons, general conclusions are drawn regarding the current state-of-the-art, and perspectives for future improvements are sketched.

Domaines: Modélisation et simulation

J Viquerat, P Meliga, A Larcher, E Hachem. A review on deep reinforcement learning for fluid mechanics: an update. Physics of Fluids, 2022, 34 (11), pp.111301. ⟨10.1063/5.0128446⟩. ⟨hal-03432654v2⟩