Mobile Vision-Based Sketch Recognition with SPARK

Simple item page
dc.contributor.authorBrowne, Jeffreyen_US
dc.contributor.authorSherwood, Timothyen_US
dc.contributor.editorKaran Singh and Levent Burak Karaen_US
dc.date.accessioned2014-01-28T18:19:35Z
dc.date.available2014-01-28T18:19:35Z
dc.date.issued2012en_US
dc.description.abstractThe sketch community has, over the past years, developed a powerful arsenal of recognition capabilities and interaction methods. Unfortunately, many people who could benefit from these systems lack pen capture hardware and are stuck drawing diagrams on traditional surfaces like paper or whiteboards. In this paper we explore bringing the benefits of sketch capture and recognition to traditional surfaces through a common smart-phone with the Sketch Practically Anywhere Recognition Kit (SPARK), a framework for building mobile, image-based sketch recognition applications. Naturally, there are several challenges that come with recognizing hand-drawn diagrams from a single image. Image processing techniques are needed to isolate marks from the background surface due to variations in lighting and surface wear. Further, since static images contain no notion of how the original diagram was drawn, we employ bitmap thinning and stroke tracing to transform the ink into the abstraction of strokes commonly used by modern sketch recognition algorithms. Since the timing data between points in each stroke are not present, recognition must remain robust to variability in both perceived drawing speed and even coarse ordering between points. We have evaluated Rubine's recognizer in an effort to quantify the impact of timing information on recognition, and our results show that accuracy can remain consistent in spite of artificially traced stroke data. As evidence of our techniques, we have implemented a mobile app in SPARK that captures images of Turing machine diagrams drawn on paper, a whiteboard, or even a chalkboard, and through sketch recognition techniques, allows users to simulate the recognized Turing machine on their phones.en_US
dc.description.seriesinformationEurographics Workshop on Sketch-Based Interfaces and Modelingen_US
dc.identifier.isbn978-3-905674-42-2en_US
dc.identifier.issn1812-3503en_US
dc.identifier.urihttps://doi.org/10.2312/SBM/SBM12/087-096en_US
dc.publisherThe Eurographics Associationen_US
dc.subjectCategories and Subject Descriptors (according to ACM CCS): I.7.5 [Document and Text Processing]: Document Capture-Graphics Recognition and Interpretation I.3.3 [Computer Graphics]: Picture/Image Generation- Digitizing and Scanningen_US
dc.titleMobile Vision-Based Sketch Recognition with SPARKen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
087-096.pdf
Size:
486.16 KB
Format:
Adobe Portable Document Format
Download
Collections
SBM12: Sketch Based Interfaces and Modeling 2012