Merging Live and pre-Captured Data to support Full 3D Head Reconstruction for Telepresence

Fleury, Cedric; Popa, Tiberiu; Cham, Tat Jen; Fuchs, Henry

Merging Live and pre-Captured Data to support Full 3D Head Reconstruction for Telepresence

Files

009-012.pdf (7.51 MB)

short1026_mm_crc.mp4 (39.17 MB)

Date

2014

Authors

Fleury, Cedric
Popa, Tiberiu
Cham, Tat Jen
Fuchs, Henry

Publisher

The Eurographics Association

Abstract

This paper proposes a 3D head reconstruction method for low cost 3D telepresence systems that uses only a single consumer level hybrid sensor (color+depth) located in front of the users. Our method fuses the real-time, noisy and incomplete output of a hybrid sensor with a set of static, high-resolution textured models acquired in a calibration phase. A complete and fully textured 3D model of the users head can thus be reconstructed in real-time, accurately preserving the facial expression of the user. The main features of our method are a mesh interpolation and a fusion of a static and a dynamic textures to combine respectively a better resolution and the dynamic features of the face.

        @inproceedings{:10.2312/egsh.20141002
,
booktitle = {Eurographics 2014 - Short Papers
},
editor = {Eric Galin and Michael Wand
},
title = {{Merging Live and pre-Captured Data to support Full 3D Head Reconstruction for Telepresence
}},
author = {Fleury, Cedric and 
Popa, Tiberiu and 
Cham, Tat Jen and 
Fuchs, Henry
},
year = {2014
},
publisher = {The Eurographics Association
},
ISSN = {1017-4656
},
ISBN = {},
DOI = {/10.2312/egsh.20141002
}
}