4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolation

Simple item page
dc.contributor.authorCasas, Danen_US
dc.contributor.authorRichardt, Christianen_US
dc.contributor.authorCollomosse, Johnen_US
dc.contributor.authorTheobalt, Christianen_US
dc.contributor.authorHilton, Adrianen_US
dc.contributor.editorStam, Jos and Mitra, Niloy J. and Xu, Kunen_US
dc.date.accessioned2015-10-07T05:12:19Z
dc.date.available2015-10-07T05:12:19Z
dc.date.issued2015en_US
dc.description.abstractWe introduce the concept of 4D model flow for the precomputed alignment of dynamic surface appearance across 4D video sequences of different motions reconstructed from multi-view video. Precomputed 4D model flow allows the efficient parametrization of surface appearance from the captured videos, which enables efficient real-time rendering of interpolated 4D video sequences whilst accurately reproducing visual dynamics, even when using a coarse underlying geometry. We estimate the 4D model flow using an image-based approach that is guided by available geometry proxies. We propose a novel representation in surface texture space for efficient storage and online parametric interpolation of dynamic appearance. Our 4D model flow overcomes previous requirements for computationally expensive online optical flow computation for data-driven alignment of dynamic surface appearance by precomputing the appearance alignment. This leads to an efficient rendering technique that enables the online interpolation between 4D videos in real time, from arbitrary viewpoints and with visual quality comparable to the state of the art.en_US
dc.description.number7en_US
dc.description.sectionheadersImage and Videoen_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.description.volume34en_US
dc.identifier.doi10.1111/cgf.12756en_US
dc.identifier.pages173-182en_US
dc.identifier.urihttps://doi.org/10.1111/cgf.12756en_US
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.title4D Model Flow: Precomputed Appearance Alignment for Real-time 4D Video Interpolationen_US
Files
Collections
34-Issue 7