Outdoor Human Motion Capture by Simultaneous Optimization of Pose and Camera Parameters

dc.contributor.authorElhayek, A.en_US
dc.contributor.authorStoll, C.en_US
dc.contributor.authorKim, K. I.en_US
dc.contributor.authorTheobalt, C.en_US
dc.contributor.editorDeussen, Oliver and Zhang, Hao (Richard)en_US
dc.date.accessioned2015-10-12T13:32:45Z
dc.date.available2015-10-12T13:32:45Z
dc.date.issued2015en_US
dc.description.abstractWe present a method for capturing the skeletal motions of humans using a sparse set of potentially moving cameras in an uncontrolled environment. Our approach is able to track multiple people even in front of cluttered and non‐static backgrounds, and unsynchronized cameras with varying image quality and frame rate. We completely rely on optical information and do not make use of additional sensor information (e.g. depth images or inertial sensors). Our algorithm simultaneously reconstructs the skeletal pose parameters of multiple performers and the motion of each camera. This is facilitated by a new energy functional that captures the alignment of the model and the camera positions with the input videos in an analytic way. The approach can be adopted in many practical applications to replace the complex and expensive motion capture studios with few consumer‐grade cameras even in uncontrolled outdoor scenes. We demonstrate this based on challenging multi‐view video sequences that are captured with unsynchronized and moving (e.g. mobile‐phone or ) cameras.We present a method for capturing the skeletal motions of humans using a sparse set of potentially moving cameras in an uncontrolled environment. Our approach is able to track multiple people even in front of cluttered and non‐static backgrounds, and unsynchronized cameras with varying image quality and frame rate. We completely rely on optical information and do not make use of additional sensor information (e.g. depth images or inertial sensors). Our algorithm simultaneously reconstructs the skeletal pose parameters of multiple performers and the motion of each camera. This is facilitated by a new energy functional that captures the alignment of the model and the camera positions with the input videos in an analytic way. The approach can be adopted in many practical applications to replace the complex and expensive motion capture studios with few consumer‐grade cameras even in uncontrolled outdoor scenes. We demonstrate this based on challenging multi‐view video sequences that are captured with unsynchronized and moving (e.g. mobile‐phone or ) cameras.en_US
dc.description.number6en_US
dc.description.sectionheadersArticlesen_US
dc.description.seriesinformationComputer Graphics Forumen_US
dc.description.volume34en_US
dc.identifier.doi10.1111/cgf.12519en_US
dc.identifier.urihttps://doi.org/10.1111/cgf.12519en_US
dc.publisherCopyright © 2015 The Eurographics Association and John Wiley & Sons Ltd.en_US
dc.subjectmarkerless human motion captureen_US
dc.subjectoutdoor captureen_US
dc.subjectmoving camerasen_US
dc.subjectI.3.7 [Computer Graphics]: Three‐Dimensional Graphics and Realism—Animationen_US
dc.titleOutdoor Human Motion Capture by Simultaneous Optimization of Pose and Camera Parametersen_US
Files
Collections