XR remote dialogue system presenting speaker's expression using a real-space avatar robot

Loading...
Thumbnail Image
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
This paper proposes a remote dialogue system that utilizes XR technology with an avatar robot. The proposed system is designed to facilitate on-site interaction between a worker wearing mixed reality glasses (HoloLens 2) and a remote interlocutor wearing a head-mounted display, including spatial objects. The remote interlocutor's facial expressions, head movements, mouth movements, and gaze direction were reproduced on a 3D avatar. The effectiveness of the proposed system was evaluated qualitatively. In addition, the effect of the facial expression generation of the real avatar was assessed.
Description

CCS Concepts: Computing methodologies → Mixed / augmented reality

        
@inproceedings{
10.2312:egve.20241362
, booktitle = {
ICAT-EGVE 2024 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
}, editor = {
Hasegawa, Shoichi
and
Sakata, Nobuchika
and
Sundstedt, Veronica
}, title = {{
XR remote dialogue system presenting speaker's expression using a real-space avatar robot
}}, author = {
Yoneda, Yuto
and
Ojima, Yukiya
and
Fukuchi, Yosuke
and
Yem, Vibol
and
Ikei, Yasushi
and
Nishiuchi, Nobuyuki
}, year = {
2024
}, publisher = {
The Eurographics Association
}, ISSN = {
1727-530X
}, ISBN = {
978-3-03868-245-5
}, DOI = {
10.2312/egve.20241362
} }
Citation
Collections