From Faces to Outdoor Light Probes

Simple item page
dc.contributor.authorCalian, Dan A.en_US
dc.contributor.authorLalonde, Jean-Françoisen_US
dc.contributor.authorGotardo, Pauloen_US
dc.contributor.authorSimon, Tomasen_US
dc.contributor.authorMatthews, Iainen_US
dc.contributor.authorMitchell, Kennyen_US
dc.contributor.editorGutierrez, Diego and Sheffer, Allaen_US
dc.date.accessioned2018-04-14T18:23:01Z
dc.date.available2018-04-14T18:23:01Z
dc.date.issued2018
dc.description.abstractImage-based lighting has allowed the creation of photo-realistic computer-generated content. However, it requires the accurate capture of the illumination conditions, a task neither easy nor intuitive, especially to the average digital photography enthusiast. This paper presents an approach to directly estimate an HDR light probe from a single LDR photograph, shot outdoors with a consumer camera, without specialized calibration targets or equipment. Our insight is to use a person's face as an outdoor light probe. To estimate HDR light probes from LDR faces we use an inverse rendering approach which employs data-driven priors to guide the estimation of realistic, HDR lighting. We build compact, realistic representations of outdoor lighting both parametrically and in a data-driven way, by training a deep convolutional autoencoder on a large dataset of HDR sky environment maps. Our approach can recover high-frequency, extremely high dynamic range lighting environments. For quantitative evaluation of lighting estimation accuracy and relighting accuracy, we also contribute a new database of face photographs with corresponding HDR light probes. We show that relighting objects with HDR light probes estimated by our method yields realistic results in a wide variety of settings.en_US
dc.description.number2
dc.description.sectionheadersIt's all About Light
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume37
dc.identifier.doi10.1111/cgf.13341
dc.identifier.issn1467-8659
dc.identifier.pages51-61
dc.identifier.urihttps://doi.org/10.1111/cgf.13341
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf13341
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectI.3.7 [Computer Graphics]
dc.subjectThree Dimensional Graphics and Realism
dc.subjectColor
dc.subjectshading
dc.subjectshadowing
dc.subjectand texture
dc.subjectI.4.8 [Image Processing and Computer Vision]
dc.subjectScene Analysis
dc.subjectShading
dc.titleFrom Faces to Outdoor Light Probesen_US
Files
Collections
37-Issue 2