Audio-aided Character Control for Inertial Measurement Tracking

Loading...
Thumbnail Image
Date
2025
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
Physics-based character control generates realistic motion dynamics by leveraging kinematic priors from large-scale data within a simulation engine. The simulated motion respects physical plausibility, while dynamic cues like contacts and forces guide compelling human-scene interaction. However, leveraging audio cues, which can capture physical contacts in a costeffective way, has been less explored in animating human motions. In this work, we demonstrate that audio inputs can enhance accuracy in predicting footsteps and capturing human locomotion dynamics. Experiments validate that audio-aided control from sparse observations (e.g., an IMU sensor on a VR headset) enhances the prediction accuracy of contact dynamics and motion tracking, offering a practical auxiliary signal for robotics, gaming, and virtual environments.
Description

CCS Concepts: Computing methodologies → Simulation by animation; Physical simulation; Motion processing

        
@inproceedings{
10.2312:egs.20251045
, booktitle = {
Eurographics 2025 - Short Papers
}, editor = {
Ceylan, Duygu
and
Li, Tzu-Mao
}, title = {{
Audio-aided Character Control for Inertial Measurement Tracking
}}, author = {
Jang, Hojun
and
Bae, Jinseok
and
Kim, Young Min
}, year = {
2025
}, publisher = {
The Eurographics Association
}, ISSN = {
1017-4656
}, ISBN = {
978-3-03868-268-4
}, DOI = {
10.2312/egs.20251045
} }
Citation