Deep Neural Models for Illumination Estimation and Relighting: A Survey

dc.contributor.authorEinabadi, Farshaden_US
dc.contributor.authorGuillemaut, Jean‐Yvesen_US
dc.contributor.authorHilton, Adrianen_US
dc.contributor.editorBenes, Bedrich and Hauser, Helwigen_US
dc.date.accessioned2021-10-08T07:38:14Z
dc.date.available2021-10-08T07:38:14Z
dc.date.issued2021
dc.description.abstractScene relighting and estimating illumination of a real scene for insertion of virtual objects in a mixed‐reality scenario are well‐studied challenges in the computer vision and graphics fields. Classical inverse rendering approaches aim to decompose a scene into its orthogonal constituting elements, namely scene geometry, illumination and surface materials, which can later be used for augmented reality or to render new images under novel lighting or viewpoints. Recently, the application of deep neural computing to illumination estimation, relighting and inverse rendering has shown promising results. This contribution aims to bring together in a coherent manner current advances in this conjunction. We examine in detail the attributes of the proposed approaches, presented in three categories: scene illumination estimation, relighting with reflectance‐aware scene‐specific representations and finally relighting as image‐to‐image transformations. Each category is concluded with a discussion on the main characteristics of the current methods and possible future trends. We also provide an overview of current publicly available datasets for neural lighting applications.en_US
dc.description.documenttypestar
dc.description.number6
dc.description.sectionheadersArticles
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume40
dc.identifier.doi10.1111/cgf.14283
dc.identifier.issn1467-8659
dc.identifier.pages315-331
dc.identifier.urihttps://doi.org/10.1111/cgf.14283
dc.identifier.urihttps://diglib.eg.org:443/handle/10.1111/cgf14283
dc.publisher© 2021 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltden_US
dc.subjectneural relighting
dc.subjectneural illumination estimation
dc.titleDeep Neural Models for Illumination Estimation and Relighting: A Surveyen_US
Files
Collections