Towards a Software Framework for Evaluating the Visualization Literacy of Large Language Models

Simple item page
dc.contributor.authorJobst, Adrianen_US
dc.contributor.authorAtzberger, Danielen_US
dc.contributor.authorScheibel, Willyen_US
dc.contributor.authorDöllner, Jürgenen_US
dc.contributor.editorDiehl, Alexandraen_US
dc.contributor.editorKucher, Kostiantynen_US
dc.contributor.editorMédoc, Nicolasen_US
dc.date.accessioned2025-05-26T06:55:11Z
dc.date.available2025-05-26T06:55:11Z
dc.date.issued2025
dc.description.abstractLarge Language Models (LLMs) are increasingly integrated into Natural Language Interfaces (NLIs) for visualizations, enabling users to inquire about visualizations through natural language. This work introduces a software framework for evaluating LLMs' visualization literacy, i.e., their ability to interpret and answer questions about visualizations. Our framework generates a set of data points across different LLMs, prompts, and question types, allowing for in-depth analysis. We demonstrate its utility by two experiments, examining the impact of the temperature parameter and predefined answer choices.en_US
dc.description.sectionheadersPosters
dc.description.seriesinformationEuroVis 2025 - Posters
dc.identifier.doi10.2312/evp.20251134
dc.identifier.isbn978-3-03868-286-8
dc.identifier.pages3 pages
dc.identifier.urihttps://doi.org/10.2312/evp.20251134
dc.identifier.urihttps://diglib.eg.org/handle/10.2312/evp20251134
dc.publisherThe Eurographics Associationen_US
dc.rightsAttribution 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjectCCS Concepts: Human-centered computing → Visualization systems and tools; Information visualization; Natural language interfaces; Accessibility technologies; Visualization theory, concepts and paradigms; User centered design
dc.subjectHuman centered computing → Visualization systems and tools
dc.subjectInformation visualization
dc.subjectNatural language interfaces
dc.subjectAccessibility technologies
dc.subjectVisualization theory
dc.subjectconcepts and paradigms
dc.subjectUser centered design
dc.titleTowards a Software Framework for Evaluating the Visualization Literacy of Large Language Modelsen_US
Files
Original bundle
Now showing 1 - 2 of 2
Thumbnail Image
Name:
evp20251134.pdf
Size:
447.85 KB
Format:
Adobe Portable Document Format
Download
Thumbnail Image
Name:
1015-file-i7.pdf
Size:
399.98 KB
Format:
Adobe Portable Document Format
Download
Collections
EuroVisPosters2025