State of the Art in Dense Monocular Non-Rigid 3D Reconstruction

Simple item page
dc.contributor.authorTretschk, Edithen_US
dc.contributor.authorKairanda, Navamien_US
dc.contributor.authorB R, Mallikarjunen_US
dc.contributor.authorDabral, Rishabhen_US
dc.contributor.authorKortylewski, Adamen_US
dc.contributor.authorEgger, Bernharden_US
dc.contributor.authorHabermann, Marcen_US
dc.contributor.authorFua, Pascalen_US
dc.contributor.authorTheobalt, Christianen_US
dc.contributor.authorGolyanik, Vladislaven_US
dc.contributor.editorBousseau, Adrienen_US
dc.contributor.editorTheobalt, Christianen_US
dc.date.accessioned2023-05-03T06:13:37Z
dc.date.available2023-05-03T06:13:37Z
dc.date.issued2023
dc.description.abstract3D reconstruction of deformable (or non-rigid) scenes from a set of monocular 2D image observations is a long-standing and actively researched area of computer vision and graphics. It is an ill-posed inverse problem, since-without additional prior assumptions-it permits infinitely many solutions leading to accurate projection to the input 2D images. Non-rigid reconstruction is a foundational building block for downstream applications like robotics, AR/VR, or visual content creation. The key advantage of using monocular cameras is their omnipresence and availability to the end users as well as their ease of use compared to more sophisticated camera set-ups such as stereo or multi-view systems. This survey focuses on state-of-the-art methods for dense non-rigid 3D reconstruction of various deformable objects and composite scenes from monocular videos or sets of monocular views. It reviews the fundamentals of 3D reconstruction and deformation modeling from 2D image observations. We then start from general methods-that handle arbitrary scenes and make only a few prior assumptions-and proceed towards techniques making stronger assumptions about the observed objects and types of deformations (e.g. human faces, bodies, hands, and animals). A significant part of this STAR is also devoted to classification and a high-level comparison of the methods, as well as an overview of the datasets for training and evaluation of the discussed techniques. We conclude by discussing open challenges in the field and the social aspects associated with the usage of the reviewed methods.en_US
dc.description.documenttypestar
dc.description.number2
dc.description.sectionheadersState of the Art Reports
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume42
dc.identifier.doi10.1111/cgf.14774
dc.identifier.issn1467-8659
dc.identifier.pages485-520
dc.identifier.pages36 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14774
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14774
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.titleState of the Art in Dense Monocular Non-Rigid 3D Reconstructionen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
v42i2pp485-520_cgf14774.pdf
Size:
26.68 MB
Format:
Adobe Portable Document Format
Download
Collections
EG 2023 - STARs (CGF 42-2)