Spatio-Temporal View Interpolation

Vedula, Sundar; Baker, Simon; Kanade, Takeo

Spatio-Temporal View Interpolation

Files

065-076.pdf (4.22 MB)

Date

2002

Authors

Vedula, Sundar
Baker, Simon
Kanade, Takeo

Publisher

The Eurographics Association

Abstract

We propose a fully automatic algorithm for view interpolation of a completely non-rigid dynamic event across both space and time. The algorithm operates by combining images captured across space to compute voxel models of the scene shape at each time instant, and images captured across time to compute the "scene flow" between the voxel models. The scene-flow is the non-rigid 3D motion of every point in the scene. To interpolate in time, the voxel models are "flowed" using an appropriate multiple of the scene flow and a smooth surface fit to the result. The novel image is then computed by ray-casting to the surface at the intermediate time instant, following the scene flow to the neighboring time instants, projecting into the input images at those times, and finally blending the results. We use our algorithm to create re-timed slow-motion fly-by movies of dynamic real-world events.

        @inproceedings{:10.2312/EGWR/EGWR02/065-076
,
booktitle = {Eurographics Workshop on Rendering
},
editor = {P. Debevec and S. Gibson
},
title = {{Spatio-Temporal View Interpolation
}},
author = {Vedula, Sundar and 
Baker, Simon and 
Kanade, Takeo
},
year = {2002
},
publisher = {The Eurographics Association
},
ISSN = {1727-3463
},
ISBN = {1-58113-534-3
},
DOI = {/10.2312/EGWR/EGWR02/065-076
}
}