Andriluka, Mykhaylo (2011)
Detection, Tracking and Pose Estimation of People in Challenging Real-World Scenes.
Technische Universität Darmstadt
Ph.D. Thesis, Primary publication
|
PDF
dis_andriluka_tuprints_v1.pdf Copyright Information: CC BY-NC-ND 2.5 Generic - Creative Commons, Attribution, NonCommercial, NoDerivs . Download (11MB) | Preview |
Item Type: | Ph.D. Thesis | ||||
---|---|---|---|---|---|
Type of entry: | Primary publication | ||||
Title: | Detection, Tracking and Pose Estimation of People in Challenging Real-World Scenes | ||||
Language: | English | ||||
Referees: | Roth, Prof. Stefan ; Huttenlocher, Prof. Daniel ; Schiele, Prof. Bernt | ||||
Date: | 19 October 2011 | ||||
Place of Publication: | Darmstadt | ||||
Date of oral examination: | 22 October 2010 | ||||
Abstract: | In this thesis, we consider three challenging and longstanding problems in computer vision: people detection, people tracking and articulated pose estimation. Generic solutions to these problems are essential building blocks for understanding images containing people, an exciting and challenging task with numerous applications in automotive safety, robotic navigation, human-computer interaction, and automatic image indexing and retrieval. Indeed, human actions, intentions and emotions can often be inferred from accurate estimates of human body poses and their movement over time. However, untill recently, accurate estimation of body poses has been possible only in controlled laboratory conditions, typically requiring multiple cameras and specialized motion capture equipment. In order to address this shortcoming, we propose algorithms capable of automatically finding people in uncontrolled outdoor environments, tracking them over time and estimating their body configurations. In the process, we also tackle several important technical challenges, including the large appearance variability of humans, the full and partial occlusions that frequently occur in typical street scenes, and ambiguities in 2D to 3D lifting and data association. Humans appear in images wearing a large variety of clothing, in a large number of possible body poses and visible from various viewpoints. Jointly, these factors create very complex appearance patterns that are hard to model and detect well. In order to deal with the large appearance variability, we propose an approach based on the pictorial structures paradigm in which we represent the human body as a flexible configuration of rigid body parts and model the appearance of each body part using local image descriptors and discriminative classifiers. We demonstrate the generality of our approach by successfully applying it to various human detection and pose estimation problems. One of the goals of this work is to demonstrate the advantages of a tight coupling of people detection, pose estimation and tracking. Tracking of people in uncontrolled conditions is difficult not only due to appearance variability, but also to frequent full and partial occlusions, which often happen when multiple people are present in the scene. Presence of multiple people also severely complicates data association between frames of the sequence. In order to address this challenge, we propose a tracking-by-detection framework that combines evidence from single-frame detections over several subsequent frames using a dynamical model of body articulations. We demonstrate the effectiveness of our tracking-by-detection approach by applying it to the problem of monocular 3D pose estimation of people in uncontrolled street environments. |
||||
Alternative Abstract: |
|
||||
Uncontrolled Keywords: | Bildverarbeitung, Menschenerkennung, Haltungsschätzung | ||||
Alternative keywords: |
|
||||
URN: | urn:nbn:de:tuda-tuprints-27636 | ||||
Classification DDC: | 000 Generalities, computers, information > 004 Computer science | ||||
Divisions: | 20 Department of Computer Science | ||||
Date Deposited: | 19 Oct 2011 14:58 | ||||
Last Modified: | 25 Jan 2024 12:44 | ||||
URI: | https://tuprints.ulb.tu-darmstadt.de/id/eprint/2763 | ||||
PPN: | 386245363 | ||||
Export: |
View Item |