TU Darmstadt / ULB / TUprints

Perceiving and Predicting Semantic Keypoints

Zauss, Duncan (2021):
Perceiving and Predicting Semantic Keypoints. (Publisher's Version)
Darmstadt, École polytechnique fédérale de Lausanne and Technische Universität Darmstadt, DOI: 10.26083/tuprints-00019453,
[Master Thesis]

Copyright Information: CC BY 4.0 International - Creative Commons, Attribution.

Download (43MB) | Preview
Item Type: Master Thesis
Status: Publisher's Version
Title: Perceiving and Predicting Semantic Keypoints
Language: English

In this work the inherently ambiguous task of predicting 3D human poses from monocular RGB images is tackled. Two different approaches to achieve this goal are presented. Firstly, it is proposed to train a fully connected neural network to lift the 2D joint positions, that can be obtained with any off-the-shelf 2D human pose estimation algorithm, to 3D poses. Since 3D human pose datasets are limited and the joint locations of datasets for 2D human pose estimation and 3D human pose estimation often do not match, we create a synthetic ground truth. Through this mean, our model can learn to lift arbitrary sets of keypoints to 3D. Our experiments show that we achieve competitive results on the Human3.6M without using any of the Human3.6M training data. Secondly, we propose a new fully convolutional architecture that encodes 3D poses with composite fields. Our method learns 3D vectors that point from a central position of the human body to all of the humans joints in the 3D space. Our model achieves competitive results on the challenging 3D poses in the wild dataset. Furthermore, our model runs at 21 FPS which makes it real-time capable.

Place of Publication: Darmstadt
Collation: xi, 50, xxviii Seiten
Classification DDC: 000 Allgemeines, Informatik, Informationswissenschaft > 004 Informatik
Divisions: Study Areas > Study area Computational Engineering
Date Deposited: 10 Sep 2021 12:13
Last Modified: 09 Sep 2022 09:24
DOI: 10.26083/tuprints-00019453
URN: urn:nbn:de:tuda-tuprints-194534
Referees: Schäfer, Prof. Dr. Michael ; Alahi, Prof. Dr. Alexandre
URI: https://tuprints.ulb.tu-darmstadt.de/id/eprint/19453
PPN: 485777207
Actions (login required)
View Item View Item