DFGA: Digital Human Faces Generation and Animation from the RGB Video using Modern Deep Learning Technology

Simple item page
dc.contributor.authorJiang, Diqiongen_US
dc.contributor.authorYou, Lihuaen_US
dc.contributor.authorChang, Jianen_US
dc.contributor.authorTong, Ruofengen_US
dc.contributor.editorYang, Yinen_US
dc.contributor.editorParakkat, Amal D.en_US
dc.contributor.editorDeng, Bailinen_US
dc.contributor.editorNoh, Seung-Taken_US
dc.date.accessioned2022-10-04T06:38:05Z
dc.date.available2022-10-04T06:38:05Z
dc.date.issued2022
dc.description.abstractHigh-quality and personalized digital human faces have been widely used in media and entertainment, from film and game production to virtual reality. However, the existing technology of generating digital faces requires extremely intensive labor, which prevents the large-scale popularization of digital face technology. In order to tackle this problem, the proposed research will investigate deep learning-based facial modeling and animation technologies to 1) create personalized face geometry from a single image, including the recognizable neutral face shape and believable personalized blendshapes; (2) generate personalized production-level facial skin textures from a video or image sequence; (3) automatically drive and animate a 3D target avatar by an actor's 2D facial video or audio. Our innovation is to achieve these tasks both efficiently and precisely by using the end-to-end framework with modern deep learning technology (StyleGAN, Transformer, NeRF).en_US
dc.description.sectionheadersDigital Human
dc.description.seriesinformationPacific Graphics Short Papers, Posters, and Work-in-Progress Papers
dc.identifier.doi10.2312/pg.20221249
dc.identifier.isbn978-3-03868-190-8
dc.identifier.pages63-64
dc.identifier.pages2 pages
dc.identifier.urihttps://doi.org/10.2312/pg.20221249
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/pg20221249
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleDFGA: Digital Human Faces Generation and Animation from the RGB Video using Modern Deep Learning Technologyen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
063-064.pdf
Size:
1.61 MB
Format:
Adobe Portable Document Format
Download
Collections
PG2022 Short Papers, Posters, and Work-in-Progress Papers