Browsing by Author "Enge, Kajetan"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    Integrating Sonification and Visualization - But Why?
    (The Eurographics Association, 2024) Rind, Alexander; Enge, Kajetan; Iber, Michael; Rönnberg, Niklas; Lenzi, Sara; Elmquist, Elias; Caiola, Valentina; Lan, Fangfei; Höldrich, Robert; Aigner, Wolfgang; Schulz, Hans-Jörg; Isenberg, Tobias
    The research communities studying visualization and sonification share exceptionally similar goals, essentially aiming to make data interpretable to humans. One community uses visual representations, while the other employs auditory (nonspeech) representations of data. Although the two communities have much in common, they developed mostly in parallel, with only comparatively few examples of integrated audiovisual data analysis idioms presented so far. This panel brings together researchers from both the fields of visualization and sonification to collectively discuss the question: 'Integrating Sonification and Visualization - but why?' In the panel discussion, we will tackle this question along two main hypotheses: Combining the modalities to (1) increase the ''bandwidth from data to brain,'' or (2) to increase a user's personal engagement during the data analysis process. On the one hand, designers might aim to communicate more data in less time or gain more and more complex insights from the data by using a multi-modal display. This argument follows an understanding that two senses should be capable of processing more information than ''just'' one. On the other hand, sometimes, a more engaged analysis of the represented data is desirable. Engagement with data visualization stands as a crucial topic in numerous contexts within our field, encouraging ''deeper'' thinking by expert analysts, readers of data journalism articles, and students in educational settings. We hypothesize that integrating visualization with sonification holds the potential to enhance user engagement during analysis. Through the panel discussion, we want to delve into the spectrum between aiming for bandwidth and engagement, seeking to understand the opportunities and challenges of integrating sonification and visualization.
  • Thumbnail Image
    Item
    Open Your Ears and Take a Look: A State-of-the-Art Report on the Integration of Sonification and Visualization
    (The Eurographics Association and John Wiley & Sons Ltd., 2024) Enge, Kajetan; Elmquist, Elias; Caiola, Valentina; Rönnberg, Niklas; Rind, Alexander; Iber, Michael; Lenzi, Sara; Lan, Fangfei; Höldrich, Robert; Aigner, Wolfgang; Garth, Christoph; Kerren, Andreas; Raidou, Renata
    The research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, and the other community employs auditory (non-speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques into one form of audiovisual display, which we argue to be ''more than the sum of the two.'' We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta-analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, showing an overall diverse field with different designs. An analysis of a co-author network of the field shows individual teams without many interconnections. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs while hopefully inspiring them to collaborate with experts from the respective other field.