UV Completion with Self-referenced Discrimination
Loading...
Date
2020
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
A facial UV map is used in many applications such as facial reconstruction, synthesis, recognition, and editing. However, it is difficult to collect a number of the UVs needed for accuracy using 3D scan device, or a multi-view capturing system should be required to construct the UV. An occluded facial UV with holes could be obtained by sampling an image after fitting a 3D facial model by recent alignment methods. In this paper, we introduce a facial UV completion framework to train the deep neural network with a set of incomplete UV textures. By using the fact that the facial texture distributions of the left and right half-sides are almost equal, we devise an adversarial network to model the complete UV distribution of the facial texture. Also, we propose the self-referenced discrimination scheme that uses the facial UV completed from the generator for training real distribution. It is demonstrated that the network can be trained to complete the facial texture with incomplete UVs comparably to when utilizing the ground-truth UVs.
Description
@inproceedings{10.2312:egs.20201018,
booktitle = {Eurographics 2020 - Short Papers},
editor = {Wilkie, Alexander and Banterle, Francesco},
title = {{UV Completion with Self-referenced Discrimination}},
author = {Kang, Jiwoo and Lee, Seongmin and Lee, Sanghoon},
year = {2020},
publisher = {The Eurographics Association},
ISSN = {1017-4656},
ISBN = {978-3-03868-101-4},
DOI = {10.2312/egs.20201018}
}