Open Your Ears and Take a Look: A State-of-the-Art Report on the Integration of Sonification and Visualization

Simple item page
dc.contributor.authorEnge, Kajetanen_US
dc.contributor.authorElmquist, Eliasen_US
dc.contributor.authorCaiola, Valentinaen_US
dc.contributor.authorRönnberg, Niklasen_US
dc.contributor.authorRind, Alexanderen_US
dc.contributor.authorIber, Michaelen_US
dc.contributor.authorLenzi, Saraen_US
dc.contributor.authorLan, Fangfeien_US
dc.contributor.authorHöldrich, Roberten_US
dc.contributor.authorAigner, Wolfgangen_US
dc.contributor.editorGarth, Christophen_US
dc.contributor.editorKerren, Andreasen_US
dc.contributor.editorRaidou, Renataen_US
dc.date.accessioned2024-05-21T08:48:49Z
dc.date.available2024-05-21T08:48:49Z
dc.date.issued2024
dc.description.abstractThe research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, and the other community employs auditory (non-speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques into one form of audiovisual display, which we argue to be ''more than the sum of the two.'' We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta-analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, showing an overall diverse field with different designs. An analysis of a co-author network of the field shows individual teams without many interconnections. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs while hopefully inspiring them to collaborate with experts from the respective other field.en_US
dc.description.number3
dc.description.sectionheadersEngage all Your Senses
dc.description.seriesinformationComputer Graphics Forum
dc.description.volume43
dc.identifier.doi10.1111/cgf.15114
dc.identifier.issn1467-8659
dc.identifier.pages30 pages
dc.identifier.urihttps://doi.org/10.1111/cgf.15114
dc.identifier.urihttps://diglib.eg.org/handle/10.1111/cgf15114
dc.publisherThe Eurographics Association and John Wiley & Sons Ltd.en_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.titleOpen Your Ears and Take a Look: A State-of-the-Art Report on the Integration of Sonification and Visualizationen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
v43i3_02_cgf15114.pdf
Size:
4.1 MB
Format:
Adobe Portable Document Format
Download
Collections
EuroVisSTAR2024
STAR collection (since 2024)