Learning to Estimate and Refine Fluid Motion with Physical Dynamics

by   Mingrui Zhang, et al.

Extracting information on fluid motion directly from images is challenging. Fluid flow represents a complex dynamic system governed by the Navier-Stokes equations. General optical flow methods are typically designed for rigid body motion, and thus struggle if applied to fluid motion estimation directly. Further, optical flow methods only focus on two consecutive frames without utilising historical temporal information, while the fluid motion (velocity field) can be considered a continuous trajectory constrained by time-dependent partial differential equations (PDEs). This discrepancy has the potential to induce physically inconsistent estimations. Here we propose an unsupervised learning based prediction-correction scheme for fluid flow estimation. An estimate is first given by a PDE-constrained optical flow predictor, which is then refined by a physical based corrector. The proposed approach outperforms optical flow methods and shows competitive results compared to existing supervised learning based methods on a benchmark dataset. Furthermore, the proposed approach can generalize to complex real-world fluid scenarios where ground truth information is effectively unknowable. Finally, experiments demonstrate that the physical corrector can refine flow estimates by mimicking the operator splitting method commonly utilised in fluid dynamical simulation.


page 5

page 6

page 7

page 8

page 9

page 14

page 15

page 16


Unsupervised Learning of Particle Image Velocimetry

Particle Image Velocimetry (PIV) is a classical flow estimation problem ...

Where computer vision can aid physics: dynamic cloud motion forecasting from satellite images

This paper describes a new algorithm for solar energy forecasting from a...

Controllable Animation of Fluid Elements in Still Images

We propose a method to interactively control the animation of fluid elem...

Nonlinear Evolutionary PDE-Based Refinement of Optical Flow

The goal of this paper is propose a mathematical framework for optical f...

Tracking via Motion Estimation with Physically Motivated Inter-Region Constraints

In this paper, we propose a method for tracking structures (e.g., ventri...

Level set based particle filter driven by optical flow: an application to track the salt boundary from X-ray CT time-series

Image-based computational fluid dynamics have long played an important r...

DDCNet-Multires: Effective Receptive Field Guided Multiresolution CNN for Dense Prediction

Dense optical flow estimation is challenging when there are large displa...

Please sign up or login with your details

Forgot password? Click here to reset