Loading [MathJax]/extensions/tex2jax.js

Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Details

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2024 Workshops, Proceedings
EditorsAlessio Del Bue, Cristian Canton, Jordi Pont-Tuset, Tatiana Tommasi
PublisherSpringer Science and Business Media Deutschland GmbH
Pages116-131
Number of pages16
ISBN (electronic)978-3-031-91767-7
ISBN (print)9783031917660
Publication statusPublished - 12 May 2025
Event18th European Conference on Computer Vision, ECCV 2024 - Milan, Italy
Duration: 29 Sept 20244 Oct 2024

Publication series

NameLecture Notes in Computer Science
Volume15629 LNCS
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

Safe navigation in new environments requires autonomous vehicles and robots to accurately interpret their surroundings, relying on LiDAR scene segmentation, out-of-distribution (OOD) obstacle detection, and uncertainty computation. We propose a method to distinguish in-distribution (ID) from OOD samples and quantify both epistemic and aleatoric uncertainties using the feature space of a single deterministic model. After training a semantic segmentation network, a Gaussian Mixture Model (GMM) is fitted to its feature space. OOD samples are detected by checking if their squared Mahalanobis distances to each Gaussian component conform to a chi-squared distribution, eliminating the need for an additional OOD training set. Given that the estimated mean and covariance matrix of a multivariate Gaussian distribution follow Gaussian and Inverse-Wishart distributions, multiple GMMs are generated by sampling from these distributions to assess epistemic uncertainty through classification variability. Aleatoric uncertainty is derived from the entropy of responsibility values within Gaussian components. Comparing our method with deep ensembles and logit-sampling for uncertainty computation demonstrates its superior performance in real-world applications for quantifying epistemic and aleatoric uncertainty, as well as detecting OOD samples. While deep ensembles miss some highly uncertain samples, our method successfully detects them and assigns high epistemic uncertainty.

Keywords

    Epistemic and aleatoric uncertainty quantification, LiDAR scene semantic segmentation, Out-of-distribution detection

ASJC Scopus subject areas

Cite this

Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation. / Shojaei Miandashti, Hanieh; Zou, Qianqian; Mehltretter, Max.
Computer Vision – ECCV 2024 Workshops, Proceedings. ed. / Alessio Del Bue; Cristian Canton; Jordi Pont-Tuset; Tatiana Tommasi. Springer Science and Business Media Deutschland GmbH, 2025. p. 116-131 (Lecture Notes in Computer Science; Vol. 15629 LNCS).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Shojaei Miandashti, H, Zou, Q & Mehltretter, M 2025, Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation. in A Del Bue, C Canton, J Pont-Tuset & T Tommasi (eds), Computer Vision – ECCV 2024 Workshops, Proceedings. Lecture Notes in Computer Science, vol. 15629 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 116-131, 18th European Conference on Computer Vision, ECCV 2024, Milan, Italy, 29 Sept 2024. https://doi.org/10.1007/978-3-031-91767-7_8, https://doi.org/10.48550/arXiv.2410.08687
Shojaei Miandashti, H., Zou, Q., & Mehltretter, M. (2025). Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation. In A. Del Bue, C. Canton, J. Pont-Tuset, & T. Tommasi (Eds.), Computer Vision – ECCV 2024 Workshops, Proceedings (pp. 116-131). (Lecture Notes in Computer Science; Vol. 15629 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-91767-7_8, https://doi.org/10.48550/arXiv.2410.08687
Shojaei Miandashti H, Zou Q, Mehltretter M. Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation. In Del Bue A, Canton C, Pont-Tuset J, Tommasi T, editors, Computer Vision – ECCV 2024 Workshops, Proceedings. Springer Science and Business Media Deutschland GmbH. 2025. p. 116-131. (Lecture Notes in Computer Science). doi: 10.1007/978-3-031-91767-7_8, 10.48550/arXiv.2410.08687
Shojaei Miandashti, Hanieh ; Zou, Qianqian ; Mehltretter, Max. / Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation. Computer Vision – ECCV 2024 Workshops, Proceedings. editor / Alessio Del Bue ; Cristian Canton ; Jordi Pont-Tuset ; Tatiana Tommasi. Springer Science and Business Media Deutschland GmbH, 2025. pp. 116-131 (Lecture Notes in Computer Science).
Download
@inproceedings{8804114bd8474d50ac4bcb364d5c47ad,
title = "Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation",
abstract = "Safe navigation in new environments requires autonomous vehicles and robots to accurately interpret their surroundings, relying on LiDAR scene segmentation, out-of-distribution (OOD) obstacle detection, and uncertainty computation. We propose a method to distinguish in-distribution (ID) from OOD samples and quantify both epistemic and aleatoric uncertainties using the feature space of a single deterministic model. After training a semantic segmentation network, a Gaussian Mixture Model (GMM) is fitted to its feature space. OOD samples are detected by checking if their squared Mahalanobis distances to each Gaussian component conform to a chi-squared distribution, eliminating the need for an additional OOD training set. Given that the estimated mean and covariance matrix of a multivariate Gaussian distribution follow Gaussian and Inverse-Wishart distributions, multiple GMMs are generated by sampling from these distributions to assess epistemic uncertainty through classification variability. Aleatoric uncertainty is derived from the entropy of responsibility values within Gaussian components. Comparing our method with deep ensembles and logit-sampling for uncertainty computation demonstrates its superior performance in real-world applications for quantifying epistemic and aleatoric uncertainty, as well as detecting OOD samples. While deep ensembles miss some highly uncertain samples, our method successfully detects them and assigns high epistemic uncertainty.",
keywords = "Epistemic and aleatoric uncertainty quantification, LiDAR scene semantic segmentation, Out-of-distribution detection",
author = "{Shojaei Miandashti}, Hanieh and Qianqian Zou and Max Mehltretter",
note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.; 18th European Conference on Computer Vision, ECCV 2024, ECCV 2024 ; Conference date: 29-09-2024 Through 04-10-2024",
year = "2025",
month = may,
day = "12",
doi = "10.1007/978-3-031-91767-7_8",
language = "English",
isbn = "9783031917660",
series = "Lecture Notes in Computer Science",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "116--131",
editor = "{Del Bue}, Alessio and Cristian Canton and Jordi Pont-Tuset and Tatiana Tommasi",
booktitle = "Computer Vision – ECCV 2024 Workshops, Proceedings",
address = "Germany",

}

Download

TY - GEN

T1 - Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation

AU - Shojaei Miandashti, Hanieh

AU - Zou, Qianqian

AU - Mehltretter, Max

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

PY - 2025/5/12

Y1 - 2025/5/12

N2 - Safe navigation in new environments requires autonomous vehicles and robots to accurately interpret their surroundings, relying on LiDAR scene segmentation, out-of-distribution (OOD) obstacle detection, and uncertainty computation. We propose a method to distinguish in-distribution (ID) from OOD samples and quantify both epistemic and aleatoric uncertainties using the feature space of a single deterministic model. After training a semantic segmentation network, a Gaussian Mixture Model (GMM) is fitted to its feature space. OOD samples are detected by checking if their squared Mahalanobis distances to each Gaussian component conform to a chi-squared distribution, eliminating the need for an additional OOD training set. Given that the estimated mean and covariance matrix of a multivariate Gaussian distribution follow Gaussian and Inverse-Wishart distributions, multiple GMMs are generated by sampling from these distributions to assess epistemic uncertainty through classification variability. Aleatoric uncertainty is derived from the entropy of responsibility values within Gaussian components. Comparing our method with deep ensembles and logit-sampling for uncertainty computation demonstrates its superior performance in real-world applications for quantifying epistemic and aleatoric uncertainty, as well as detecting OOD samples. While deep ensembles miss some highly uncertain samples, our method successfully detects them and assigns high epistemic uncertainty.

AB - Safe navigation in new environments requires autonomous vehicles and robots to accurately interpret their surroundings, relying on LiDAR scene segmentation, out-of-distribution (OOD) obstacle detection, and uncertainty computation. We propose a method to distinguish in-distribution (ID) from OOD samples and quantify both epistemic and aleatoric uncertainties using the feature space of a single deterministic model. After training a semantic segmentation network, a Gaussian Mixture Model (GMM) is fitted to its feature space. OOD samples are detected by checking if their squared Mahalanobis distances to each Gaussian component conform to a chi-squared distribution, eliminating the need for an additional OOD training set. Given that the estimated mean and covariance matrix of a multivariate Gaussian distribution follow Gaussian and Inverse-Wishart distributions, multiple GMMs are generated by sampling from these distributions to assess epistemic uncertainty through classification variability. Aleatoric uncertainty is derived from the entropy of responsibility values within Gaussian components. Comparing our method with deep ensembles and logit-sampling for uncertainty computation demonstrates its superior performance in real-world applications for quantifying epistemic and aleatoric uncertainty, as well as detecting OOD samples. While deep ensembles miss some highly uncertain samples, our method successfully detects them and assigns high epistemic uncertainty.

KW - Epistemic and aleatoric uncertainty quantification

KW - LiDAR scene semantic segmentation

KW - Out-of-distribution detection

UR - http://www.scopus.com/inward/record.url?scp=105007223597&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-91767-7_8

DO - 10.1007/978-3-031-91767-7_8

M3 - Conference contribution

AN - SCOPUS:105007223597

SN - 9783031917660

T3 - Lecture Notes in Computer Science

SP - 116

EP - 131

BT - Computer Vision – ECCV 2024 Workshops, Proceedings

A2 - Del Bue, Alessio

A2 - Canton, Cristian

A2 - Pont-Tuset, Jordi

A2 - Tommasi, Tatiana

PB - Springer Science and Business Media Deutschland GmbH

T2 - 18th European Conference on Computer Vision, ECCV 2024

Y2 - 29 September 2024 through 4 October 2024

ER -

By the same author(s)