VolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representations

dc.contributor.authorGarbin, Stephan J.en_US
dc.contributor.authorKowalski, Mareken_US
dc.contributor.authorEstellers, Virginiaen_US
dc.contributor.authorSzymanowicz, Stanislawen_US
dc.contributor.authorRezaeifar, Shidehen_US
dc.contributor.authorShen, Jingjingen_US
dc.contributor.authorJohnson, Matthew A.en_US
dc.contributor.authorValentin, Julienen_US
dc.contributor.editorAlliez, Pierreen_US
dc.contributor.editorWimmer, Michaelen_US
dc.date.accessioned2024-12-19T11:15:09Z
dc.date.available2024-12-19T11:15:09Z
dc.date.issued2024
dc.description.abstractThe recent increase in popularity of volumetric representations for scene reconstruction and novel view synthesis has put renewed focus on animating volumetric content at high visual quality and in real‐time. While implicit deformation methods based on learned functions can produce impressive results, they are ‘black boxes’ to artists and content creators, they require large amounts of training data to generalize meaningfully, and they do not produce realistic extrapolations outside of this data. In this work, we solve these issues by introducing a volume deformation method which is real‐time even for complex deformations, easy to edit with off‐the‐shelf software and can extrapolate convincingly. To demonstrate the versatility of our method, we apply it in two scenarios: physics‐based object deformation and telepresence where avatars are controlled using blendshapes. We also perform thorough experiments showing that our method compares favourably to both volumetric approaches combined with implicit deformation and methods based on mesh deformation.en_US
dc.description.number6
dc.description.sectionheadersORIGINAL ARTICLES
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume43
dc.identifier.doi10.1111/cgf.15117
dc.identifier.pages21 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.15117
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf15117
dc.publisher© 2024 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.subjectfacial animation
dc.subjectneural rendering
dc.subjecttetrahedral geometry
dc.titleVolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representationsen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
05_cgf15117.pdf
Size:
11.7 MB
Format:
Adobe Portable Document Format
Collections