Image Based Proximate Shadow Retargeting

Abstract
We introduce Shadow Retargeting which maps real shadow appearance to virtual shadows given a corresponding deformation of scene geometry, such that appearance is seamlessly maintained. By performing virtual shadow reconstruction from un-occluded real shadow samples observed in the camera frame, we recover the deformed shadow appearance efficiently. Our method uses geometry priors for the shadow casting object and a planar receiver surface. Inspired by image retargeting approaches [VTP10] we describe a novel local search strategy, steered by importance based deformed shadow estimation. Results are presented on a range of objects, deformations and illumination conditions in real-time Augmented Reality (AR) on a mobile device. We demonstrate the practical application of the method in generating otherwise laborious in-betweening frames for 3D printed stop motion animation.
Description

        
@inproceedings{
10.2312:cgvc.20181206
, booktitle = {
Computer Graphics and Visual Computing (CGVC)
}, editor = {
{Tam, Gary K. L. and Vidal, Franck
}, title = {{
Image Based Proximate Shadow Retargeting
}}, author = {
Casas, Llogari
and
Fauconneau, Matthias
and
Kosek, Maggie
and
Mclister, Kieran
and
Mitchell, Kenny
}, year = {
2018
}, publisher = {
The Eurographics Association
}, ISBN = {
978-3-03868-071-0
}, DOI = {
10.2312/cgvc.20181206
} }
Citation