Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces

Thumbnail Image
Date
2017
Authors
Altıok, Ozan Can
Sezgin, Tev k Metin
Journal Title
Journal ISSN
Volume Title
Publisher
Association for Computing Machinery, Inc (ACM)
Abstract
From a user interaction perspective, speech and sketching make a good couple for describing motion. Speech allows easy speci cation of content, events and relationships, while sketching brings in spatial expressiveness. Yet, we have insu cient knowledge of how sketching and speech can be used for motion-based video retrieval, because there are no existing retrieval systems that support such interaction. In this paper, we describe a Wizard-of-Oz protocol and a set of tools that we have developed to engage users in a sketchand speech-based video retrieval task. We report how the tools and the protocol t together using ''retrieval of soccer videos'' as a use case scenario. Our so ware is highly customizable, and our protocol is easy to follow. We believe that together they will serve as a convenient and powerful duo for studying a wide range of multi-modal use cases.
Description

        
@inproceedings{
10.1145:3122791.3122801
,
booktitle = {
Sketch-Based Interfaces and Modeling
},
editor = {
Holger Winnemoeller and Lyn Bartram
},
title = {{
Characterizing User Behavior for Speech and Sketch-based Video Retrieval Interfaces
}},
author = {
Altıok, Ozan Can
 and 
Sezgin, Tev k Metin
},
year = {
2017
},
publisher = {
Association for Computing Machinery, Inc (ACM)
},
ISSN = {
1812-3503
},
ISBN = {
978-1-4503-5080-8
},
DOI = {
10.1145/3122791.3122801
}
}
Citation
URI
https://doi.org/10.1145/3122791.3122801
 https://diglib.eg.org:443/handle/10.2312/sbim2017a08
Collections
SBM17: Sketch Based Interfaces and Modeling 2017