TU Darmstadt / ULB / TUprints

Towards a Generally Accepted Validation Methodology for Sensor Models - Challenges, Metrics, and First Results

Rosenberger, Philipp ; Wendler, Jan Timo ; Holder, Martin Friedrich ; Linnhoff, Clemens ; Berghöfer, Moritz ; Winner, Hermann ; Maurer, Markus (2019)
Towards a Generally Accepted Validation Methodology for Sensor Models - Challenges, Metrics, and First Results.
Grazer Symposium Virtuelles Fahrzeug. Graz, Austria (07.-08.05.2019)
Conference or Workshop Item, Primary publication

[img]
Preview
Publication to the Presentation at the Graz Symposium Virtual Vehicle (GSVF) 2019 - Text
Towards a Generally Accepted Validation Methodology for Sensor Models.pdf - Published Version
Copyright Information: CC BY-NC-ND 4.0 International - Creative Commons, Attribution NonCommercial, NoDerivs.

Download (5MB) | Preview
Item Type: Conference or Workshop Item
Type of entry: Primary publication
Title: Towards a Generally Accepted Validation Methodology for Sensor Models - Challenges, Metrics, and First Results
Language: German
Date: 7 May 2019
Place of Publication: Darmstadt
Event Title: Grazer Symposium Virtuelles Fahrzeug
Event Location: Graz, Austria
Event Dates: 07.-08.05.2019
Abstract:

In order to significantly reduce the testing effort of autonomous vehicles, simulation-based testing in combination with a scenario-based approach is a major part of the overall test concept. But, for sophisticated simulations, all applied models have to be validated beforehand, which is the focus of this paper. The presented validation methodology for sensor system simulation is based on a state-of-the-art analysis and the derived necessary improvements. The lack of experience in formulating requirements and providing adequate metrics for their usage in sensor model validation, in contrast to e.g. vehicle dynamics simulation, is addressed. Additionally, the importance of valid measurement and reference data is pointed out and especially the challenges of repeatability and reproducibility of trajectories and measurements of perception sensors in dynamic multi-object scenarios are shown. The process to find relevant scenarios and the resulting parameter space to be examined is described. At the example of lidar point clouds, the derivation of metrics with respect to the requirements is explained and exemplary evaluation results are summarized. Based on this, extensions to the state-of-the-art model validation method are provided.

URN: urn:nbn:de:tuda-tuprints-86536
Classification DDC: 600 Technology, medicine, applied sciences > 620 Engineering and machine engineering
Divisions: 16 Department of Mechanical Engineering
16 Department of Mechanical Engineering > Institute of Automotive Engineering (FZD)
16 Department of Mechanical Engineering > Institute of Automotive Engineering (FZD) > Driver Assistance
16 Department of Mechanical Engineering > Institute of Automotive Engineering (FZD) > Safety
16 Department of Mechanical Engineering > Institute of Automotive Engineering (FZD) > Test Methods
Date Deposited: 06 Jun 2019 09:32
Last Modified: 24 Nov 2022 11:56
URI: https://tuprints.ulb.tu-darmstadt.de/id/eprint/8653
PPN: 450439984
Export:
Actions (login required)
View Item View Item