Exploring Language Pedagogy with Virtual Reality and Artificial Intelligence
No Thumbnail Available
Date
2023
Authors
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Virtual Reality (VR) is a highly immersive and interactive experience that renders users to be engrossed in a 3D virtual environment. The recent technological advancements with high-resolution headset display, and accurate tracking of six degrees of freedom paired with controllers allow life-like renditions of real-world scenarios as well as fictional scenarios without potential environmental risks. This paper explores the usage of Virtual Reality in education by incorporating current pedagogical approaches into an interactive 3D virtual environment. The focus of this study revolves around language pedagogy, in specific, the tool developed allows teach users fundamental Mandarin Chinese. This educational VR application enables users to practice their reading and writing skills through a calligraphy lesson and engages users in a listening and speaking lesson through natural conversation. To achieve an organic dialogue, phrases spoken by the user in a lesson are validated immediately through an intuitive phrase recognition system developed using machine learning. The developed prototype has undergone testing to ensure its efficacy. An initial investigation into this prototype found that the majority of participants were supportive of this concept and believe that it would improve the engagement of digital education.
Description
CCS Concepts: Computing methodologies -> Virtual reality; Neural networks
@inproceedings{10.2312:cgvc.20231201,
booktitle = {Computer Graphics and Visual Computing (CGVC)},
editor = {Vangorp, Peter and Hunter, David},
title = {{Exploring Language Pedagogy with Virtual Reality and Artificial Intelligence}},
author = {Michael, Brandon and Aburumman, Nadine},
year = {2023},
publisher = {The Eurographics Association},
ISBN = {978-3-03868-231-8},
DOI = {10.2312/cgvc.20231201}
}