Real-time Facial Animation from Live Video Tracking

Simple item page
dc.contributor.authorRhee, Taehyunen_US
dc.contributor.authorHwang, Youngkyooen_US
dc.contributor.authorKim, James Dokyoonen_US
dc.contributor.authorKim, Changyeongen_US
dc.contributor.editorA. Bargteil and M. van de Panneen_US
dc.date.accessioned2013-10-31T10:29:03Z
dc.date.available2013-10-31T10:29:03Z
dc.date.issued2011en_US
dc.description.abstractThis paper describes a complete pipe-line of a practical system for producing real-time facial expressions of a 3D virtual avatar controlled by an actor's live performances. The system handles practical challenges arising from markerless expression captures from a single conventional video camera. For robust tracking, a localized algorithm constrained by belief propagation is applied to the upper face, and an appearance matching techniqueusing a parameterized generic face model is exploited for lower face and head pose tracking. The captured expression features then transferred to high dimensional 3D animation controls using our facial expression space which is a structure-preserving map between two algebraic structures. The transferred animation controls drive facial animation of a 3D avatar while optimizing the smoothness of the face mesh. An example-based face deformation technique produces non-linear local detail deformations on the avatar that are not captured in the movement of the animation controls.en_US
dc.description.seriesinformationEurographics/ ACM SIGGRAPH Symposium on Computer Animationen_US
dc.identifier.isbn978-1-4503-0923-3en_US
dc.identifier.issn1727-5288en_US
dc.identifier.urihttps://doi.org/10.2312/SCA/SCA11/215-224en_US
dc.publisherThe Eurographics Associationen_US
dc.subjectCategories and Subject Descriptors (according to ACM CCS): I.3.7 [Computer Graphics]: Three-DimensionalGraphics and Realism-Animation; I.4.8 [Image Processing and Computer Vision]: Scene Analysis-Motion;en_US
dc.titleReal-time Facial Animation from Live Video Trackingen_US
Files
Collections
SCA 11: Eurographics/SIGGRAPH Symposium on Computer Animation