Zauss, Duncan (2021)
Perceiving and Predicting Semantic Keypoints.
École polytechnique fédérale de Lausanne and Technische Universität Darmstadt
doi: 10.26083/tuprints-00019453
Master Thesis, Primary publication, Publisher's Version
|
Text
Master_thesis_Duncan_Zauss.pdf Copyright Information: CC BY 4.0 International - Creative Commons, Attribution. Download (43MB) | Preview |
Item Type: | Master Thesis |
---|---|
Type of entry: | Primary publication |
Title: | Perceiving and Predicting Semantic Keypoints |
Language: | English |
Referees: | Schäfer, Prof. Dr. Michael ; Alahi, Prof. Dr. Alexandre |
Date: | 2021 |
Place of Publication: | Darmstadt |
Collation: | xi, 50, xxviii Seiten |
DOI: | 10.26083/tuprints-00019453 |
Abstract: | In this work the inherently ambiguous task of predicting 3D human poses from monocular RGB images is tackled. Two different approaches to achieve this goal are presented. Firstly, it is proposed to train a fully connected neural network to lift the 2D joint positions, that can be obtained with any off-the-shelf 2D human pose estimation algorithm, to 3D poses. Since 3D human pose datasets are limited and the joint locations of datasets for 2D human pose estimation and 3D human pose estimation often do not match, we create a synthetic ground truth. Through this mean, our model can learn to lift arbitrary sets of keypoints to 3D. Our experiments show that we achieve competitive results on the Human3.6M without using any of the Human3.6M training data. Secondly, we propose a new fully convolutional architecture that encodes 3D poses with composite fields. Our method learns 3D vectors that point from a central position of the human body to all of the humans joints in the 3D space. Our model achieves competitive results on the challenging 3D poses in the wild dataset. Furthermore, our model runs at 21 FPS which makes it real-time capable. |
Status: | Publisher's Version |
URN: | urn:nbn:de:tuda-tuprints-194534 |
Classification DDC: | 000 Generalities, computers, information > 004 Computer science |
Divisions: | Study Areas > Study area Computational Engineering |
Date Deposited: | 10 Sep 2021 12:13 |
Last Modified: | 09 Sep 2022 09:24 |
URI: | https://tuprints.ulb.tu-darmstadt.de/id/eprint/19453 |
PPN: | 485777207 |
Export: |
View Item |