A Deep Learned Method for Video Indexing and Retrieval

Men, Xin; Zhou, Feng; Li, Xiaoyong

A Deep Learned Method for Video Indexing and Retrieval

Files

085-088.pdf (1.93 MB)

Date

2018

Authors

Men, Xin
Zhou, Feng
Li, Xiaoyong

Publisher

The Eurographics Association

Abstract

In this paper, we proposed a deep neural network based method for content based video retrieval. Our approach leveraged the deep neural network to generate the semantic information and introduced the graph-based storage structure to establish the video indices. We devised the Inception-Single Shot Multibox Detector (ISSD) and RI3D model to extract spatial semantic information (objects) and extract temporal semantic information (actions). Our ISSD model achieved a mAP of 26.7% on MS COCO dataset, increasing 3.2% over the original SSD model, while the RI3D model achieved a top-1 accuracy of 97.7% on dataset UCF-101. And we also introduced the graph structure to build the video index with the temporal and spatial semantic information. Our experiment results showed that the deep learned semantic information is highly effective for video indexing and retrieval.

        @inproceedings{10.2312:pg.20181287
,
booktitle = {Pacific Graphics Short Papers
},
editor = {Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes
},
title = {{A Deep Learned Method for Video Indexing and Retrieval
}},
author = {Men, Xin and 
Zhou, Feng and 
Li, Xiaoyong
},
year = {2018
},
publisher = {The Eurographics Association
},
ISBN = {978-3-03868-073-4
},
DOI = {10.2312/pg.20181287
}
}