Reflection Separation in Light Fields based on Sparse Coding and Specular Flow

Sulc, Antonin; Alperovich, Anna; Marniok, Nico; Goldluecke, Bastian

Reflection Separation in Light Fields based on Sparse Coding and Specular Flow

Files

137-144.pdf (13.63 MB)

Date

2016

Authors

Sulc, Antonin
Alperovich, Anna
Marniok, Nico
Goldluecke, Bastian

Publisher

The Eurographics Association

Abstract

We present a method to separate a dichromatic reflection component from diffuse object colors for the set of rays in a 4D light field such that the separation is consistent across all subaperture views. The separation model is based on explaining the observed light field as a sparse linear combination of a constant-color specular term and a small finite set of albedos. Consistency across the light field is achieved by embedding the ray-wise separation into a global optimization framework. On each individual epipolar plane image (EPI), the diffuse coefficients need to be constant along lines which are the projections of the same scene point, while the specular coefficient needs to be constant along the direction of the specular flow within the epipolar volume. We handle both constraints with depth-dependent anisotropic regularizers, and demonstrate promising performance on a number of real-world light fields captured with a Lytro Illum plenoptic camera.

        @inproceedings{10.2312:vmv.20161352
,
booktitle = {Vision, Modeling & Visualization
},
editor = {Matthias Hullin and Marc Stamminger and Tino Weinkauf
},
title = {{Reflection Separation in Light Fields based on Sparse Coding and Specular Flow
}},
author = {Sulc, Antonin and 
Alperovich, Anna and 
Marniok, Nico and 
Goldluecke, Bastian
},
year = {2016
},
publisher = {The Eurographics Association
},
ISSN = {-
},
ISBN = {978-3-03868-025-3
},
DOI = {10.2312/vmv.20161352
}
}