VolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representations
Loading...
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
© 2024 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.
Abstract
The recent increase in popularity of volumetric representations for scene reconstruction and novel view synthesis has put renewed focus on animating volumetric content at high visual quality and in real‐time. While implicit deformation methods based on learned functions can produce impressive results, they are ‘black boxes’ to artists and content creators, they require large amounts of training data to generalize meaningfully, and they do not produce realistic extrapolations outside of this data. In this work, we solve these issues by introducing a volume deformation method which is real‐time even for complex deformations, easy to edit with off‐the‐shelf software and can extrapolate convincingly. To demonstrate the versatility of our method, we apply it in two scenarios: physics‐based object deformation and telepresence where avatars are controlled using blendshapes. We also perform thorough experiments showing that our method compares favourably to both volumetric approaches combined with implicit deformation and methods based on mesh deformation.
Description
@article{10.1111:cgf.15117,
journal = {Computer Graphics Forum},
title = {{VolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representations}},
author = {Garbin, Stephan J. and Kowalski, Marek and Estellers, Virginia and Szymanowicz, Stanislaw and Rezaeifar, Shideh and Shen, Jingjing and Johnson, Matthew A. and Valentin, Julien},
year = {2024},
publisher = {© 2024 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.},
DOI = {10.1111/cgf.15117}
}