Fine Back Surfaces Oriented Human Reconstruction for Single RGB-D Images

Simple item page
dc.contributor.authorFang, Xianyongen_US
dc.contributor.authorQian, Yuen_US
dc.contributor.authorHe, Jinshenen_US
dc.contributor.authorWang, Linboen_US
dc.contributor.authorLiu, Zhengyien_US
dc.contributor.editorChaine, Raphaëlleen_US
dc.contributor.editorDeng, Zhigangen_US
dc.contributor.editorKim, Min H.en_US
dc.date.accessioned2023-10-09T07:36:48Z
dc.date.available2023-10-09T07:36:48Z
dc.date.issued2023
dc.description.abstractCurrent single RGB-D image based human surface reconstruction methods generally take both the RGB images and the captured frontal depth maps together so that the 3D cues from the frontal surfaces can help infer the full surface geometries. However, we observe that the back surfaces can often be quite different from the frontal surfaces and, therefore, current methods can mess the recovery process by adopting such 3D cues, especially for the unseen back surfaces. We need to do the back surface inference without the frontal depth map. Consequently, a novel human reconstruction framework is proposed, so that human models with fine geometric details, especially for the back surfaces, can be obtained. In this approach, a progressive estimation method is introduced to effectively recover the unseen back depth maps. The coarse back depth maps are recovered by the parametric models of the subjects, with the fine ones further obtained by the normal-maps conditioned GAN. This framework also includes a cross-attention based denoising method for the frontal depth maps. This method adopts the cross attention between the features of the last two layers encoded from the frontal depth maps and thus suppresses the noise for fine depth maps by the attentions of features from the low-noise and globally-structured highest layer. Experimental results show the efficacies of the proposed ideas.en_US
dc.description.number7
dc.description.sectionheadersDetails and Styles on 3D Models
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume42
dc.identifier.doi10.1111/cgf.14971
dc.identifier.issn1467-8659
dc.identifier.pages12 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.14971
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14971
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectCCS Concepts: Computing methodologies -> Parametric curve and surface models; Virtual reality; Reconstruction
dc.subjectComputing methodologies
dc.subjectParametric curve and surface models
dc.subjectVirtual reality
dc.subjectReconstruction
dc.titleFine Back Surfaces Oriented Human Reconstruction for Single RGB-D Imagesen_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
v42i7_43_14971.pdf
Size:
20.13 MB
Format:
Adobe Portable Document Format
Download
Collections
42-Issue 7