Reconstructing 3D Face of Infants in Social Interactions Using Morphable Models of Non-Infants
Loading...
Date
2022
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
3D morphable models (3DMMs) simultaneously reconstruct facial morphology, expression and pose from 2D images, and thus could be an invaluable tool for capturing and characterizing the face and facial behavior in early childhood. However, 3DMM fitting on infants is a largely unexplored problem. All publicly available 3DMMs are developed for adults, and it is unclear if and to what extent they can be used on videos of infants. In this paper, we compare five state-of-the-art 3DMM fitting methods on data from naturalistic infant-caregiver interactions. Results suggest that it is possible to produce consistent and subject-specific reconstructions of 3D shape identity from multiple frames, but not from a single frame. Qualitative evaluation highlights that facial regions with high texture variation, such as eyes, brows and mouth, are captured with higher accuracy compared to the rest of the face. Thus, even though a 3DMM developed for adults has significant limitations when reconstructing the morphology of the entire facial region of infants, applications that involve analysis of facial behavior can be feasible. Our encouraging results, combined with the unique ability of 3DMMs to disentangle two major sources of noise for expression analysis (i.e., identity bias and pose variations), motivate future research on using 3DMMs to measure the facial behavior of infants.
Description
CCS Concepts: Human-centered computing → Empirical studies in HCI; Computing methodologies → Shape representations
@inproceedings{10.2312:3dor.20221178,
booktitle = {Eurographics Workshop on 3D Object Retrieval},
editor = {Berretti, Stefano and Thehoaris, Theoharis and Daoudi, Mohamed and Ferrari, Claudio and Veltkamp, Remco C.},
title = {{Reconstructing 3D Face of Infants in Social Interactions Using Morphable Models of Non-Infants}},
author = {Sariyanidi, Evangelos and Zampella, Casey J. and Drye, Madison N. and Fecher, Madison L. and Magginson, Grace and Cubit, Laura Soskey and Schultz, Robert T. and Guthrie, Whitney and Tunc, Birkan},
year = {2022},
publisher = {The Eurographics Association},
ISSN = {1997-0471},
ISBN = {978-3-03868-174-8},
DOI = {10.2312/3dor.20221178}
}