Filtering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality
Loading...
Date
2015
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Physically correct rendering of environment illumination has been a long-standing challenge in interactive graphics, since Monte-Carlo ray-tracing requires thousands of rays per pixel. We propose accurate filtering of a noisy Monte-Carlo image using Fourier analysis. Our novel analysis extends previous works by showing that the shape of illumination spectra is not always a line or wedge, as in previous approximations, but rather an ellipsoid. Our primary contribution is an axis-aligned filtering scheme that preserves the frequency content of the illumination. We also propose a novel application of our technique to mixed reality scenes, in which virtual objects are inserted into a real video stream so as to become indistinguishable from the real objects. The virtual objects must be shaded with the real lighting conditions, and the mutual illumination between real and virtual objects must also be determined. For this, we demonstrate a novel two-mode path tracing approach that allows ray-tracing a scene with image-based real geometry and mesh-based virtual geometry. Finally, we are able to de-noise a sparsely sampled image and render physically correct mixed reality scenes at over 5 fps on the GPU.
Description
@inproceedings{10.2312:sre.20151172,
booktitle = {Eurographics Symposium on Rendering - Experimental Ideas & Implementations},
editor = {Jaakko Lehtinen and Derek Nowrouzezahrai},
title = {{Filtering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality}},
author = {Mehta, Soham Uday and Kim, Kihwan and Pajak, Dawid and Pulli, Kari and Kautz, Jan and Ramamoorthi, Ravi},
year = {2015},
publisher = {The Eurographics Association},
ISBN = {},
DOI = {10.2312/sre.20151172}
}