Running Online User Studies with the reVISit Framework

Abstract
There currently are two main approaches for running online user studies: experimenters can use commercial survey tools, which are easy to use but can be costly, hamper reproducibility, and have limitations for complex stimuli; or they can build custom software to run and instrument a study, which is a laborious and complex task. In this tutorial, we introduce participants to a new, open-source alternative: the reVISit study platform. Many studies quickly reach a level of complexity such that designers have not only to consider their stimuli and experimental tasks, but also the study UI, data hosting, participant recruiting, randomization, etc. ReVISit ameliorates these problems and allows study designers to focus more on the research questions and stimulus design. ReVISit removes the tedium of study design by providing built-in components that most studies will need. ReVISit uses a domain specific language to allow study designers to quickly create studies, and to deploy them as static websites that are publicly accessible. This tutorial will introduce reVISit to the visualization community and allow community members to get hands on experience with it through a series of practical examples. Throughout the tutorial, participants will improve on a study until they have developed and deployed a study of an interactive, fully instrumented data visualization.
Description

CCS Concepts: Human-centered computing → User studies

        
@inproceedings{
10.2312:evt.20251117
, booktitle = {
EuroVis 2025 - Panels and Tutorials
}, editor = {
Isenberg, Tobias
and
Sedlmair, Michael
and
Tierny, Julien
}, title = {{
Running Online User Studies with the reVISit Framework
}}, author = {
Wilburn, Jack
and
Shrestha, Hilson
and
Cutler, Zach
and
Ding, Yiren
and
He, Tingying
and
McNutt, Andrew M.
and
Harrison, Lane
and
Lex, Alexander
}, year = {
2025
}, publisher = {
The Eurographics Association
}, ISBN = {
978-3-03868-285-1
}, DOI = {
10.2312/evt.20251117
} }
Citation
Collections