Filtering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality

dc.contributor.authorMehta, Soham Udayen_US
dc.contributor.authorKim, Kihwanen_US
dc.contributor.authorPajak, Dawiden_US
dc.contributor.authorPulli, Karien_US
dc.contributor.authorKautz, Janen_US
dc.contributor.authorRamamoorthi, Ravien_US
dc.contributor.editorJaakko Lehtinen and Derek Nowrouzezahraien_US
dc.date.accessioned2015-06-23T05:04:39Z
dc.date.available2015-06-23T05:04:39Z
dc.date.issued2015en_US
dc.description.abstractPhysically correct rendering of environment illumination has been a long-standing challenge in interactive graphics, since Monte-Carlo ray-tracing requires thousands of rays per pixel. We propose accurate filtering of a noisy Monte-Carlo image using Fourier analysis. Our novel analysis extends previous works by showing that the shape of illumination spectra is not always a line or wedge, as in previous approximations, but rather an ellipsoid. Our primary contribution is an axis-aligned filtering scheme that preserves the frequency content of the illumination. We also propose a novel application of our technique to mixed reality scenes, in which virtual objects are inserted into a real video stream so as to become indistinguishable from the real objects. The virtual objects must be shaded with the real lighting conditions, and the mutual illumination between real and virtual objects must also be determined. For this, we demonstrate a novel two-mode path tracing approach that allows ray-tracing a scene with image-based real geometry and mesh-based virtual geometry. Finally, we are able to de-noise a sparsely sampled image and render physically correct mixed reality scenes at over 5 fps on the GPU.en_US
dc.description.sectionheadersReal-time Rendering and Filteringen_US
dc.description.seriesinformationEurographics Symposium on Rendering - Experimental Ideas & Implementationsen_US
dc.identifier.doi10.2312/sre.20151172en_US
dc.identifier.pages107-118en_US
dc.identifier.urihttps://doi.org/10.2312/sre.20151172en_US
dc.publisherThe Eurographics Associationen_US
dc.subjectI.3.7 [Computer Graphics]en_US
dc.subjectRayen_US
dc.subjecttracingen_US
dc.subjectVirtual Realityen_US
dc.titleFiltering Environment Illumination for Interactive Physically-Based Rendering in Mixed Realityen_US
Files
Original bundle
Now showing 1 - 3 of 3
Loading...
Thumbnail Image
Name:
107-118.pdf
Size:
12.83 MB
Format:
Adobe Portable Document Format
No Thumbnail Available
Name:
egsr-paper-1010.mp4
Size:
72.1 MB
Format:
Unknown data format
No Thumbnail Available
Name:
readme.txt
Size:
53 B
Format:
Plain Text