Animatable Facial Reflectance Fields
Loading...
Date
2004
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We present a technique for creating an animatable image-based appearance model of a human face, able to capture appearance variation over changing facial expression, head pose, view direction, and lighting condition. Our capture process makes use of a specialized lighting apparatus designed to rapidly illuminate the subject sequentially from many different directions in just a few seconds. For each pose, the subject remains still while six video cameras capture their appearance under each of the directions of lighting. We repeat this process for approximately 60 different poses, capturing different expressions, visemes, head poses, and eye positions. The images for each of the poses and camera views are registered to each other semi-automatically with the help of fiducial markers. The result is a model which can be rendered realistically under any linear blend of the captured poses and under any desired lighting condition by warping, scaling, and blending data from the original images. Finally, we show how to drive the model with performance capture data, where the pose is not necessarily a linear combination of the original captured poses.
Description
@inproceedings{:10.2312/EGWR/EGSR04/309-319,
booktitle = {Eurographics Workshop on Rendering},
editor = {Alexander Keller and Henrik Wann Jensen},
title = {{Animatable Facial Reflectance Fields}},
author = {Hawkins, Tim and Wenger, Andreas and Tchou, Chris and Gardner, Andrew and Göransson, Fredrik and Debevec, Paul},
year = {2004},
publisher = {The Eurographics Association},
ISSN = {1727-3463},
ISBN = {3-905673-12-6},
DOI = {/10.2312/EGWR/EGSR04/309-319}
}