VMV15

Permanent URI for this collection

https://diglib.eg.org/handle/10.2312/13268

Browse

Browsing VMV15 by Subject "Animation"

Now showing 1 - 3 of 3
  • Thumbnail Image
    Item
    Data Driven 3D Face Tracking Based on a Facial Deformation Model
    (The Eurographics Association, 2015) Sibbing, Dominik; Kobbelt, Leif; David Bommes and Tobias Ritschel and Thomas Schultz
    We introduce a new markerless 3D face tracking approach for 2D video streams captured by a single consumer grade camera. Our approach is based on tracking 2D features in the video and matching them with the projection of the corresponding feature points of a deformable 3D model. By this we estimate the initial shape and pose of the face. To make the tracking and reconstruction more robust we add a smoothness prior for pose changes as well as for deformations of the faces. Our major contribution lies in the formulation of the smooth deformation prior which we derive from a large database of previously captured facial animations showing different (dynamic) facial expressions of a fairly large number of subjects. We split these animation sequences into snippets of fixed length which we use to predict the facial motion based on previous frames. In order to keep the deformation model compact and independent from the individual physiognomy, we represent it by deformation gradients (instead of vertex positions) and apply a principal component analysis in deformation gradient space to extract the major modes of facial deformation. Since the facial deformation is optimized during tracking, it is particularly easy to apply them to other physiognomies and thereby re-target the facial expressions. We demonstrate the effectiveness of our technique on a number of examples.
  • Thumbnail Image
    Item
    Rotoscoping on Stereoscopic Images and Videos
    (The Eurographics Association, 2015) Bukenberger, Dennis R.; Schwarz, Katharina; Groh, Fabian; Lensch, Hendrik P. A.; David Bommes and Tobias Ritschel and Thomas Schultz
    Creating an animation based on video footage (rotoscoping) often requires significant manual work. For monoscopic videos diverse publications already feature (semi-)automatic techniques to apply non-photorealistic image abstraction (NPR) to videos. This paper addresses abstraction of 3D stereo content minimizing stereoscopic discomfort in images and videos. We introduce a completely autonomous framework that enhances stereo and temporal consistency. Stereoscopic coherence with consistent textures for both eyes is produced by warping the left and right images into a central disparity domain followed by mapping them back to the left and right view. Smooth movements with reduced flickering are achieved by considering optical flow in the propagation of abstract features between frames. The results show significant improvements of stereo consistency without discomforting artifacts in the depth perception. We extend existing stroke based rendering (SBR) for higher accuracy at strong image gradients. Furthermore, we demonstrate that our stereo framework is easily applicable to other point-based abstraction styles. Finally, we evaluate the stereo consistency of our results in a small user study and show that the comfort of the visual appearance is maintained.
  • Thumbnail Image
    Item
    Tongue S(t)imulator - A Comprehensive Parametrized Pose Model for Speech Therapy
    (The Eurographics Association, 2015) Haraké, Laura; Bełtkiewicz, Dorota; Lochmann, Gerrit; David Bommes and Tobias Ritschel and Thomas Schultz
    Recent digital applications in speech therapy address patients to train auditive speech comprehension, reading or semantics, in a playful way. Virtual tutors consist of three-dimensional head models for assisting the patient with conversational exercises. However, speech therapists also have to give pronunciation instructions and motility training of the tongue very often, but only have two-dimensional drawings or their own mouths for demonstration. In this paper we propose a comprehensive application for speech therapy as a therapeutical tool, simulating the articulation of German phones including color-coded expiration flows and the deglutition process (swallowing). A three-dimensional visualization of anatomical models of pharyngo-laryngeal area can be used in an interactive way. For examining the benefits of our tool over common conventional therapy media, our approach considers iteratively the demands of speech therapists. A final expert interview was conducted to assess how the application could be involved in treatment and the application’'s limits.