TraM‐NeRF: Tracing Mirror and Near‐Perfect Specular Reflections Through Neural Radiance Fields

Simple item page
dc.contributor.authorHolland, Leif Vanen_US
dc.contributor.authorBliersbach, Rubenen_US
dc.contributor.authorMüller, Jan U.en_US
dc.contributor.authorStotko, Patricken_US
dc.contributor.authorKlein, Reinharden_US
dc.contributor.editorAlliez, Pierreen_US
dc.contributor.editorWimmer, Michaelen_US
dc.date.accessioned2024-12-19T11:15:46Z
dc.date.available2024-12-19T11:15:46Z
dc.date.issued2024
dc.description.abstractImplicit representations like neural radiance fields (NeRF) showed impressive results for photorealistic rendering of complex scenes with fine details. However, ideal or near‐perfectly specular reflecting objects such as mirrors, which are often encountered in various indoor scenes, impose ambiguities and inconsistencies in the representation of the re‐constructed scene leading to severe artifacts in the synthesized renderings. In this paper, we present a novel reflection tracing method tailored for the involved volume rendering within NeRF that takes these mirror‐like objects into account while avoiding the cost of straightforward but expensive extensions through standard path tracing. By explicitly modelling the reflection behaviour using physically plausible materials and estimating the reflected radiance with Monte‐Carlo methods within the volume rendering formulation, we derive efficient strategies for importance sampling and the transmittance computation along rays from only few samples. We show that our novel method enables the training of consistent representations of such challenging scenes and achieves superior results in comparison to previous state‐of‐the‐art approaches.en_US
dc.description.number6
dc.description.sectionheadersMajor Revision from Eurographics Conference
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume43
dc.identifier.doi10.1111/cgf.15163
dc.identifier.pages14 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.15163
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf15163
dc.publisher© 2024 Eurographics ‐ The European Association for Computer Graphics and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectrendering
dc.subjectimage‐based rendering
dc.subjectray tracing
dc.subjectreflectance and shading models
dc.titleTraM‐NeRF: Tracing Mirror and Near‐Perfect Specular Reflections Through Neural Radiance Fieldsen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
18_cgf15163.pdf
Size:
7.33 MB
Format:
Adobe Portable Document Format
Download
Collections
43-Issue 6