Evaluating the Effects of Hand-gesture-based Interaction with Virtual Content in a 360° Movie

Loading...
Thumbnail Image
Date
2017
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Head-mounted displays are becoming increasingly popular as home entertainment devices for viewing 360° movies. This paper explores the effects of adding gesture interaction with virtual content and two different hand-visualisation modes for 360° movie watching experience. The system in the study comprises of a Leap Motion sensor to track the user's hand and finger motions, in combination with a SoftKinetic RGB-D camera to capture the texture of the hands and arms. A 360° panoramic movie with embedded virtual objects was used as content. Four conditions, displaying either a point-cloud of the real hand or a rigged computer-generated hand, with and without interaction, were evaluated. Presence, agency, embodiment, and ownership, as well as the overall participant preference were measured. Results showed that participants had a strong preference for the conditions with interactive virtual content, and they felt stronger embodiment and ownership. The comparison of the two hand visualisations showed that the display of the real hand elicited stronger ownership. There was no overall difference for presence between the four conditions. These findings suggest that adding interaction with virtual content could be beneficial to the overall user experience, and that interaction should be performed using the real hand visualisation instead of the virtual hand if higher ownership is desired.
Description

        
@inproceedings{
10.2312:egve.20171340
, booktitle = {
ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
}, editor = {
Robert W. Lindeman and Gerd Bruder and Daisuke Iwai
}, title = {{
Evaluating the Effects of Hand-gesture-based Interaction with Virtual Content in a 360° Movie
}}, author = {
Khan, Humayun
and
Lee, Gun A.
and
Hoermann, Simon
and
Clifford, Rory M. S.
and
Billinghurst, Mark
and
Lindeman, Robert W.
}, year = {
2017
}, publisher = {
The Eurographics Association
}, ISSN = {
1727-530X
}, ISBN = {
978-3-03868-038-3
}, DOI = {
10.2312/egve.20171340
} }
Citation
Collections