Dynamic Environment Mapping for Augmented Reality Applications on Mobile Devices
Loading...
Date
2018
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Augmented Reality is a topic of foremost interest nowadays. Its main goal is to seamlessly blend virtual content in real-world scenes. Due to the lack of computational power in mobile devices, rendering a virtual object with high-quality, coherent appearance and in real-time, remains an area of active research. In this work, we present a novel pipeline that allows for coupled environment acquisition and virtual object rendering on a mobile device equipped with a depth sensor. While keeping human interaction to a minimum, our system can scan a real scene and project it onto a two-dimensional environment map containing RGB+Depth data. Furthermore, we define a set of criteria that allows for an adaptive update of the environment map to account for dynamic changes in the scene. Then, under the assumption of diffuse surfaces and distant illumination, our method exploits an analytic expression for the irradiance in terms of spherical harmonic coefficients, which leads to a very efficient rendering algorithm. We show that all the processes in our pipeline can be executed while maintaining an average frame rate of 31Hz on a mobile device.
Description
@inproceedings{10.2312:vmv.20181249,
booktitle = {Vision, Modeling and Visualization},
editor = {Beck, Fabian and Dachsbacher, Carsten and Sadlo, Filip},
title = {{Dynamic Environment Mapping for Augmented Reality Applications on Mobile Devices}},
author = {Monroy, Rafael and Hudon, Matis and Smolic, Aljosa},
year = {2018},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-072-7},
DOI = {10.2312/vmv.20181249}
}