Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces

dc.contributor.authorAltıok, Ozan Canen_US
dc.contributor.authorSezgin, Tev k Metinen_US
dc.contributor.editorHolger Winnemoeller and Lyn Bartramen_US
dc.date.accessioned2017-10-18T08:37:28Z
dc.date.available2017-10-18T08:37:28Z
dc.date.issued2017
dc.description.abstractFrom a user interaction perspective, speech and sketching make a good couple for describing motion. Speech allows easy speci cation of content, events and relationships, while sketching brings in spatial expressiveness. Yet, we have insu cient knowledge of how sketching and speech can be used for motion-based video retrieval, because there are no existing retrieval systems that support such interaction. In this paper, we describe a Wizard-of-Oz protocol and a set of tools that we have developed to engage users in a sketchand speech-based video retrieval task. We report how the tools and the protocol t together using ''retrieval of soccer videos'' as a use case scenario. Our so ware is highly customizable, and our protocol is easy to follow. We believe that together they will serve as a convenient and powerful duo for studying a wide range of multi-modal use cases.en_US
dc.description.sectionheadersGeneral Submissions (Abstracts)
dc.description.seriesinformationSketch-Based Interfaces and Modeling
dc.identifier.doi10.1145/3122791.3122801
dc.identifier.isbn978-1-4503-5080-8
dc.identifier.issn1812-3503
dc.identifier.urihttps://doi.org/10.1145/3122791.3122801
dc.identifier.urihttps://diglib.eg.org:443/handle/10.2312/sbim2017a08
dc.publisherAssociation for Computing Machinery, Inc (ACM)en_US
dc.subjectHuman
dc.subjectcentered computing
dc.subjectSystems and tools for interaction design
dc.subjectEmpirical studies in HCI
dc.subjectsketch
dc.subjectbased interfaces
dc.subjecthuman
dc.subjectcentered design
dc.subjectmotion
dc.subjectmultimedia retrieval
dc.titleCharacterizing User Behavior for Speech and Sketch-based Video Retrieval Interfacesen_US
Files