Inferring the Structure of Action Movies
Loading...
Date
2017
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
While important advances were recently made towards temporally localizing and recognizing specific human actions or activities in videos, efficient detection and classification of long video chunks belonging to semantically-defined categories remains challenging. Examples of such categories can be found in action movies, whose storylines often follow a standardized structure corresponding to a sequence of typical segments such as ''pursuit'', ''romance'', etc. We introduce a new dataset, Action Movie Franchises, consisting of a collection of Hollywood action movie franchises. We define 11 non-exclusive semantic categories that are broad enough to cover most of the movie footage. The corresponding events are annotated as groups of video shots, possibly overlapping. We propose an approach for localizing events based on classifying shots into categories and learning the temporal constraints between shots. We show that temporal constraints significantly improve the classification performance. We set up an evaluation protocol for event localization as well as for shot classification, depending on whether movies from the same franchise are present or not in the training data.
Description
@inproceedings{10.2312:wiced.20171067,
booktitle = {Eurographics Workshop on Intelligent Cinematography and Editing},
editor = {William Bares and Vineet Gandhi and Quentin Galvane and Remi Ronfard},
title = {{Inferring the Structure of Action Movies}},
author = {Potapov, Danila and Douze, Matthijs and Revaud, Jérôme and Harchaoui, Zaid and Schmid, Cordelia},
year = {2017},
publisher = {The Eurographics Association},
ISSN = {2411-9733},
ISBN = {978-3-03868-031-4},
DOI = {10.2312/wiced.20171067}
}