EuroRVVV: EuroVis Workshop on Reproducibility, Verification, and Validation in Visualization

Permanent URI for this community

https://diglib.eg.org/handle/10.2312/980

Browse

Browsing EuroRVVV: EuroVis Workshop on Reproducibility, Verification, and Validation in Visualization by Subject "Evaluation/methodology"

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    Guidelines and Recommendations for the Evaluation of New Visualization Techniques by Means of Experimental Studies
    (The Eurographics Association, 2017) Luz, Maria; Lawonn, Kai; Hansen, Christian; Kai Lawonn and Noeska Smit and Douglas Cunningham
    This paper addresses important issues in the evaluation of new visualization techniques. It describes the principle of quantitative research in general and presents the idea of experimental studies. The goal of experimental studies is to provide the base for guidelines, which allow testing of hypotheses that newly-developed visualization solutions are better than older ones. Moreover, the paper provides guidelines for successful planning of experimental studies in terms of independent and dependent variables, participants, tasks, data collection and statistical evaluation of collected data. It describes how the results should be interpreted and reported in publications. Finally, the paper points out useful literature and thus contributes to a better understanding of how to evaluate new visualization techniques.
  • Thumbnail Image
    Item
    Where'd it go? How Geographic and Force-directed Layouts Affect Network Task Performance
    (The Eurographics Association, 2017) Hale, Scott A.; McNeill, Graham; Bright, Jonathan; Kai Lawonn and Noeska Smit and Douglas Cunningham
    When visualizing geospatial network data, it is possible to position nodes according to their geographic locations or to position nodes using standard network layout algorithms that ignore geographic location. Such data is increasingly common in interactive displays of Internet-connected sensor data, but network layouts that ignore geographic location data are rarely employed. We conduct a user experiment to compare the effects of geographic and force-directed network layouts on three common network tasks: locating a node, determining the path length between two nodes, and comparing the degree of two nodes. We found a geographic layout was superior for locating a node but inferior for determining the path length between two nodes. The two layouts performed similarly when participants compared the degree of two nodes. We also tested a relaxed- or pseudogeographic layout created with multidimensional scaling and found it performed as well or better than the pure geographic layout on all tasks but remained inferior to the force-directed layout for the path-length task. We suggest interactive displays of geospatial network data allow viewers to switch between geographic and force-directed layouts, although further research is needed to understand the extent to which viewers are able to choose the most appropriate layout for a given task.