Vis Repligogy: Towards a Culture of Facilitating Replication Studies in Visualization Pedagogy and Research

Abstract
In this paper, we present the Vis Repligogy framework that enables conducting replication studies in the class. Replication studies are crucial to strengthening the data visualization field and ensuring its foundations are solid and methods accurate. Although visualization researchers acknowledge the epistemological significance of replications and their necessity to establish trust and reliability, the field has made little progress to support the publication of such studies and, importantly, provide methods to the community to encourage replications. Therefore, we contribute Vis Repligogy, a novel framework to systematically incorporate replications within visualization course curricula that not only teaches students replication and evaluation methodologies but also results in executed replication studies to validate prior work. To validate the feasibility of the framework, we present case studies of two graduate data visualization courses that implemented it. These courses resulted in a total of five replication studies. Finally, we reflect on our experience implementing the Vis Repligogy framework to provide useful recommendations for future use. We envision this framework will encourage instructors to conduct replications in their courses, help facilitate more replications in visualization pedagogy and in research, and support a culture shift towards reproducible research. Supplemental materials of this paper are available at https://osf.io/ncb6d/.
Description

CCS Concepts: Human-centered computing→Visualization theory and methods; Visualization pedagogy

        
@inproceedings{
10.2312:eved.20241054
, booktitle = {
EuroVis 2024 - Education Papers
}, editor = {
Firat, Elif E.
and
Laramee, Robert S.
and
Andersen, Nicklas Sindelv
}, title = {{
Vis Repligogy: Towards a Culture of Facilitating Replication Studies in Visualization Pedagogy and Research
}}, author = {
Syeda, Uzma Haque
and
South, Laura
and
Raynor, Justin
and
Panavas, Liudas
and
Saffo, David
and
Morriss, Tommy
and
Dunne, Cody
and
Borkin, Michelle A.
}, year = {
2024
}, publisher = {
The Eurographics Association
}, ISBN = {
978-3-03868-257-8
}, DOI = {
10.2312/eved.20241054
} }
Citation