Automatic Evaluation of Sketch Recognizers

Schmieder, Paul; Plimmer, Beryl; Blagojevic, Rachel

Automatic Evaluation of Sketch Recognizers

Files

085-092.pdf (286.35 KB)

Date

2009

Authors

Schmieder, Paul
Plimmer, Beryl
Blagojevic, Rachel

Publisher

The Eurographics Association

Abstract

We present our toolkit to automatically evaluate recognition algorithms. There are few published comparative evaluations of sketch recognition algorithms and those that exist do not provide benchmarking or direct comparisons because standardised data and an evaluation platform is not available. By unifying data collection, labelling and evaluation in one tool, fair, flexible and comprehensive evaluations are possible. Currently we have 6 existing recognizers integrated into this tool. With our initial evaluations of these recognizers we have observed that the context from which training data is taken has an effect on recognition success rates. These results suggest that an evaluation platform such as this is a powerful adjunct for sketch recognition research.

        @inproceedings{:10.2312/SBM/SBM09/085-092
,
booktitle = {EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling
},
editor = {Cindy Grimm and Joseph J. LaViola, Jr.
},
title = {{Automatic Evaluation of Sketch Recognizers
}},
author = {Schmieder, Paul and 
Plimmer, Beryl and 
Blagojevic, Rachel
},
year = {2009
},
publisher = {The Eurographics Association
},
ISSN = {1812-3503
},
ISBN = {978-3-905674-19-4
},
DOI = {/10.2312/SBM/SBM09/085-092
}
}