Empirical uncertainty evaluation for the pose of a kinematic LiDAR-based multi-sensor system

Research output: Contribution to journalArticleResearchpeer review

View graph of relations

Details

Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalJournal of Applied Geodesy
Early online date22 May 2024
Publication statusE-pub ahead of print - 22 May 2024

Abstract

Kinematic multi-sensor systems (MSS) describe their movements through six-degree-of-freedom trajectories, which are often evaluated primarily for accuracy. However, understanding their self-reported uncertainty is crucial, especially when operating in diverse environments like urban, industrial, or natural settings. This is important, so the following algorithms can provide correct and safe decisions, i.e. for autonomous driving. In the context of localization, light detection and ranging sensors (LiDARs) are widely applied for tasks such as generating, updating, and integrating information from maps supporting other sensors to estimate trajectories. However, popular low-cost LiDARs deviate from other geodetic sensors in their uncertainty modeling. This paper therefore demonstrates the uncertainty evaluation of a LiDAR-based MSS localizing itself using an inertial measurement unit (IMU) and matching LiDAR observations to a known map. The necessary steps for accomplishing the sensor data fusion in a novel Error State Kalman filter (ESKF) will be presented considering the influences of the sensor uncertainties and their combination. The results provide new insights into the impact of random and systematic deviations resulting from parameters and their uncertainties established in prior calibrations. The evaluation is done using the Mahalanobis distance to consider the deviations of the trajectory from the ground truth weighted by the self-reported uncertainty, and to evaluate the consistency in hypothesis testing. The evaluation is performed using a real data set obtained from an MSS consisting of a tactical grade IMU and a Velodyne Puck in combination with reference data by a Laser Tracker in a laboratory environment. The data set consists of measurements for calibrations and multiple kinematic experiments. In the first step, the data set is simulated based on the Laser Tracker measurements to provide a baseline for the results under assumed perfect corrections. In comparison, the results using a more realistic simulated data set and the real IMU and LiDAR measurements provide deviations about a factor of five higher leading to an inconsistent estimation. The results offer insights into the open challenges related to the assumptions for integrating low-cost LiDARs in MSSs.

Keywords

    uncertainty evaluation, uncertainty modeling, multi-sensor system, LiDAR, IMU

ASJC Scopus subject areas

Cite this

Empirical uncertainty evaluation for the pose of a kinematic LiDAR-based multi-sensor system. / Ernst, Dominik; Vogel, Sören; Neumann, Ingo et al.
In: Journal of Applied Geodesy, 22.05.2024, p. 1-14.

Research output: Contribution to journalArticleResearchpeer review

Ernst D, Vogel S, Neumann I, Alkhatib H. Empirical uncertainty evaluation for the pose of a kinematic LiDAR-based multi-sensor system. Journal of Applied Geodesy. 2024 May 22;1-14. Epub 2024 May 22. doi: 10.1515/jag-2023-0098
Download
@article{77d461a9725544268f32a6620d403756,
title = "Empirical uncertainty evaluation for the pose of a kinematic LiDAR-based multi-sensor system",
abstract = "Kinematic multi-sensor systems (MSS) describe their movements through six-degree-of-freedom trajectories, which are often evaluated primarily for accuracy. However, understanding their self-reported uncertainty is crucial, especially when operating in diverse environments like urban, industrial, or natural settings. This is important, so the following algorithms can provide correct and safe decisions, i.e. for autonomous driving. In the context of localization, light detection and ranging sensors (LiDARs) are widely applied for tasks such as generating, updating, and integrating information from maps supporting other sensors to estimate trajectories. However, popular low-cost LiDARs deviate from other geodetic sensors in their uncertainty modeling. This paper therefore demonstrates the uncertainty evaluation of a LiDAR-based MSS localizing itself using an inertial measurement unit (IMU) and matching LiDAR observations to a known map. The necessary steps for accomplishing the sensor data fusion in a novel Error State Kalman filter (ESKF) will be presented considering the influences of the sensor uncertainties and their combination. The results provide new insights into the impact of random and systematic deviations resulting from parameters and their uncertainties established in prior calibrations. The evaluation is done using the Mahalanobis distance to consider the deviations of the trajectory from the ground truth weighted by the self-reported uncertainty, and to evaluate the consistency in hypothesis testing. The evaluation is performed using a real data set obtained from an MSS consisting of a tactical grade IMU and a Velodyne Puck in combination with reference data by a Laser Tracker in a laboratory environment. The data set consists of measurements for calibrations and multiple kinematic experiments. In the first step, the data set is simulated based on the Laser Tracker measurements to provide a baseline for the results under assumed perfect corrections. In comparison, the results using a more realistic simulated data set and the real IMU and LiDAR measurements provide deviations about a factor of five higher leading to an inconsistent estimation. The results offer insights into the open challenges related to the assumptions for integrating low-cost LiDARs in MSSs.",
keywords = "uncertainty evaluation, uncertainty modeling, multi-sensor system, LiDAR, IMU",
author = "Dominik Ernst and S{\"o}ren Vogel and Ingo Neumann and Hamza Alkhatib",
note = "Publisher Copyright: {\textcopyright} 2024 Walter de Gruyter GmbH, Berlin/Boston 2024.",
year = "2024",
month = may,
day = "22",
doi = "10.1515/jag-2023-0098",
language = "English",
pages = "1--14",

}

Download

TY - JOUR

T1 - Empirical uncertainty evaluation for the pose of a kinematic LiDAR-based multi-sensor system

AU - Ernst, Dominik

AU - Vogel, Sören

AU - Neumann, Ingo

AU - Alkhatib, Hamza

N1 - Publisher Copyright: © 2024 Walter de Gruyter GmbH, Berlin/Boston 2024.

PY - 2024/5/22

Y1 - 2024/5/22

N2 - Kinematic multi-sensor systems (MSS) describe their movements through six-degree-of-freedom trajectories, which are often evaluated primarily for accuracy. However, understanding their self-reported uncertainty is crucial, especially when operating in diverse environments like urban, industrial, or natural settings. This is important, so the following algorithms can provide correct and safe decisions, i.e. for autonomous driving. In the context of localization, light detection and ranging sensors (LiDARs) are widely applied for tasks such as generating, updating, and integrating information from maps supporting other sensors to estimate trajectories. However, popular low-cost LiDARs deviate from other geodetic sensors in their uncertainty modeling. This paper therefore demonstrates the uncertainty evaluation of a LiDAR-based MSS localizing itself using an inertial measurement unit (IMU) and matching LiDAR observations to a known map. The necessary steps for accomplishing the sensor data fusion in a novel Error State Kalman filter (ESKF) will be presented considering the influences of the sensor uncertainties and their combination. The results provide new insights into the impact of random and systematic deviations resulting from parameters and their uncertainties established in prior calibrations. The evaluation is done using the Mahalanobis distance to consider the deviations of the trajectory from the ground truth weighted by the self-reported uncertainty, and to evaluate the consistency in hypothesis testing. The evaluation is performed using a real data set obtained from an MSS consisting of a tactical grade IMU and a Velodyne Puck in combination with reference data by a Laser Tracker in a laboratory environment. The data set consists of measurements for calibrations and multiple kinematic experiments. In the first step, the data set is simulated based on the Laser Tracker measurements to provide a baseline for the results under assumed perfect corrections. In comparison, the results using a more realistic simulated data set and the real IMU and LiDAR measurements provide deviations about a factor of five higher leading to an inconsistent estimation. The results offer insights into the open challenges related to the assumptions for integrating low-cost LiDARs in MSSs.

AB - Kinematic multi-sensor systems (MSS) describe their movements through six-degree-of-freedom trajectories, which are often evaluated primarily for accuracy. However, understanding their self-reported uncertainty is crucial, especially when operating in diverse environments like urban, industrial, or natural settings. This is important, so the following algorithms can provide correct and safe decisions, i.e. for autonomous driving. In the context of localization, light detection and ranging sensors (LiDARs) are widely applied for tasks such as generating, updating, and integrating information from maps supporting other sensors to estimate trajectories. However, popular low-cost LiDARs deviate from other geodetic sensors in their uncertainty modeling. This paper therefore demonstrates the uncertainty evaluation of a LiDAR-based MSS localizing itself using an inertial measurement unit (IMU) and matching LiDAR observations to a known map. The necessary steps for accomplishing the sensor data fusion in a novel Error State Kalman filter (ESKF) will be presented considering the influences of the sensor uncertainties and their combination. The results provide new insights into the impact of random and systematic deviations resulting from parameters and their uncertainties established in prior calibrations. The evaluation is done using the Mahalanobis distance to consider the deviations of the trajectory from the ground truth weighted by the self-reported uncertainty, and to evaluate the consistency in hypothesis testing. The evaluation is performed using a real data set obtained from an MSS consisting of a tactical grade IMU and a Velodyne Puck in combination with reference data by a Laser Tracker in a laboratory environment. The data set consists of measurements for calibrations and multiple kinematic experiments. In the first step, the data set is simulated based on the Laser Tracker measurements to provide a baseline for the results under assumed perfect corrections. In comparison, the results using a more realistic simulated data set and the real IMU and LiDAR measurements provide deviations about a factor of five higher leading to an inconsistent estimation. The results offer insights into the open challenges related to the assumptions for integrating low-cost LiDARs in MSSs.

KW - uncertainty evaluation

KW - uncertainty modeling

KW - multi-sensor system

KW - LiDAR

KW - IMU

UR - http://www.scopus.com/inward/record.url?scp=85194177980&partnerID=8YFLogxK

U2 - 10.1515/jag-2023-0098

DO - 10.1515/jag-2023-0098

M3 - Article

SP - 1

EP - 14

JO - Journal of Applied Geodesy

JF - Journal of Applied Geodesy

SN - 1862-9016

ER -

By the same author(s)