Virtual Elastic Objects

by   Hsiao-yu Chen, et al.

We present Virtual Elastic Objects (VEOs): virtual objects that not only look like their real-world counterparts but also behave like them, even when subject to novel interactions. Achieving this presents multiple challenges: not only do objects have to be captured including the physical forces acting on them, then faithfully reconstructed and rendered, but also plausible material parameters found and simulated. To create VEOs, we built a multi-view capture system that captures objects under the influence of a compressed air stream. Building on recent advances in model-free, dynamic Neural Radiance Fields, we reconstruct the objects and corresponding deformation fields. We propose to use a differentiable, particle-based simulator to use these deformation fields to find representative material parameters, which enable us to run new simulations. To render simulated objects, we devise a method for integrating the simulation results with Neural Radiance Fields. The resulting method is applicable to a wide range of scenarios: it can handle objects composed of inhomogeneous material, with very different shapes, and it can simulate interactions with other virtual objects. We present our results using a newly collected dataset of 12 objects under a variety of force fields, which will be shared with the community.


page 1

page 7

page 8


Estimating Cloth Elasticity Parameters Using Position-Based Simulation of Compliant Constrained Dynamics

Clothing plays a vital role in real life and hence, is also important fo...

Dynamic Network: Graphical Deformation of Penetrated Objects

In a computer-based virtual environment, objects may collide with each o...

Learning Elastic Constitutive Material and Damping Models

The fidelity of a deformation simulation is highly dependent upon the un...

Dynamic Simulation of Soft Heterogeneous Objects

This paper describes a 2D and 3D simulation engine that quantitatively m...

PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification

Existing approaches to system identification (estimating the physical pa...

3D-PhysNet: Learning the Intuitive Physics of Non-Rigid Object Deformations

The ability to interact and understand the environment is a fundamental ...

TPA-Net: Generate A Dataset for Text to Physics-based Animation

Recent breakthroughs in Vision-Language (V L) joint research have achi...

Please sign up or login with your details

Forgot password? Click here to reset