TAVE: Template-based Augmentation of Visual Effects to Human Actions in Videos

Liu, Jingyuan; Zhou, Xuren; Fu, Hongbo; Tai, Chiew-Lan

TAVE: Template-based Augmentation of Visual Effects to Human Actions in Videos

Files

003-004.pdf (11.26 MB)

demo.mp4 (232.81 MB)

Date

2018

Authors

Liu, Jingyuan
Zhou, Xuren
Fu, Hongbo
Tai, Chiew-Lan

Publisher

The Eurographics Association

Abstract

We present TAVE, a framework that allows novice users to add interesting visual effects by mimicking human actions in a given template video, in which pre-defined visual effects have already been associated with specific human actions. Our framework is mainly based on high-level features of human pose extracted from video frames, and uses low-level image features as the auxiliary information. We encode an action into a set of code sequences representing joint motion directions and use a finite state machine to recognize the action state of interest. The visual effects, possibly with occlusion masks, can be automatically transferred from the template video to a target video containing similar human actions.

        @inproceedings{10.2312:pg.20181289
,
booktitle = {Pacific Graphics Posters
},
editor = {Fu, Hongbo and Ghosh, Abhijeet and Kopf, Johannes
},
title = {{TAVE: Template-based Augmentation of Visual Effects to Human Actions in Videos
}},
author = {Liu, Jingyuan and 
Zhou, Xuren and 
Fu, Hongbo and 
Tai, Chiew-Lan
},
year = {2018
},
publisher = {The Eurographics Association
},
ISBN = {978-3-03868-074-1
},
DOI = {10.2312/pg.20181289
}
}