Data-driven and active learning of variance-based sensitivity indices with Bayesian probabilistic integration

Research output: Contribution to journalArticleResearchpeer review

Authors

  • Jingwen Song
  • Pengfei Wei
  • Marcos A. Valdebenito
  • Matthias Faes
  • Michael Beer

Research Organisations

External Research Organisations

  • Northwestern Polytechnical University
  • Tokyo City University
  • Universidad Adolfo Ibanez
  • KU Leuven
  • University of Liverpool
  • International Joint Research Center for Engineering Reliability and Stochastic Mechanics
  • Tongji University
View graph of relations

Details

Original languageEnglish
Article number108106
JournalMechanical Systems and Signal Processing
Volume163
Early online date17 Jun 2021
Publication statusPublished - 15 Jan 2022

Abstract

Variance-based sensitivity indices play an important role in scientific computation and data mining, thus the significance of developing numerical methods for efficient and reliable estimation of these sensitivity indices based on (expensive) computer simulators and/or data cannot be emphasized too much. In this article, the estimation of these sensitivity indices is treated as a statistical inference problem. Two principle lemmas are first proposed as rules of thumb for making the inference. After that, the posterior features for all the (partial) variance terms involved in the main and total effect indices are analytically derived (not in closed form) based on Bayesian Probabilistic Integration (BPI). This forms a data-driven method for estimating the sensitivity indices as well as the involved discretization errors. Further, to improve the efficiency of the developed method for expensive simulators, an acquisition function, named Posterior Variance Contribution (PVC), is utilized for realizing optimal designs of experiments, based on which an adaptive BPI method is established. The application of this framework is illustrated for the calculation of the main and total effect indices, but the proposed two principle lemmas also apply to the calculation of interaction effect indices. The performance of the development is demonstrated by an illustrative numerical example and three engineering benchmarks with finite element models.

Keywords

    Adaptive experiment design, Bayesian probabilistic integration, Data-driven, Gaussian process regression, Posterior variance contribution, Variance-based sensitivity

ASJC Scopus subject areas

Cite this

Data-driven and active learning of variance-based sensitivity indices with Bayesian probabilistic integration. / Song, Jingwen; Wei, Pengfei; Valdebenito, Marcos A. et al.
In: Mechanical Systems and Signal Processing, Vol. 163, 108106, 15.01.2022.

Research output: Contribution to journalArticleResearchpeer review

Song J, Wei P, Valdebenito MA, Faes M, Beer M. Data-driven and active learning of variance-based sensitivity indices with Bayesian probabilistic integration. Mechanical Systems and Signal Processing. 2022 Jan 15;163:108106. Epub 2021 Jun 17. doi: 10.1016/j.ymssp.2021.108106
Download
@article{6e5b922c9caa46ce8e6089bd025eff9c,
title = "Data-driven and active learning of variance-based sensitivity indices with Bayesian probabilistic integration",
abstract = "Variance-based sensitivity indices play an important role in scientific computation and data mining, thus the significance of developing numerical methods for efficient and reliable estimation of these sensitivity indices based on (expensive) computer simulators and/or data cannot be emphasized too much. In this article, the estimation of these sensitivity indices is treated as a statistical inference problem. Two principle lemmas are first proposed as rules of thumb for making the inference. After that, the posterior features for all the (partial) variance terms involved in the main and total effect indices are analytically derived (not in closed form) based on Bayesian Probabilistic Integration (BPI). This forms a data-driven method for estimating the sensitivity indices as well as the involved discretization errors. Further, to improve the efficiency of the developed method for expensive simulators, an acquisition function, named Posterior Variance Contribution (PVC), is utilized for realizing optimal designs of experiments, based on which an adaptive BPI method is established. The application of this framework is illustrated for the calculation of the main and total effect indices, but the proposed two principle lemmas also apply to the calculation of interaction effect indices. The performance of the development is demonstrated by an illustrative numerical example and three engineering benchmarks with finite element models.",
keywords = "Adaptive experiment design, Bayesian probabilistic integration, Data-driven, Gaussian process regression, Posterior variance contribution, Variance-based sensitivity",
author = "Jingwen Song and Pengfei Wei and Valdebenito, {Marcos A.} and Matthias Faes and Michael Beer",
note = "Funding Information: This work is supported by the National Natural Science Foundation of China under Grant No. 51905430, the Sino-German Mobility Program under Grant No. M-0175, the ANID (Agency for Research and Development, Chile) under its program FONDECYT, Grant No. 1180271, and the Research Foundation Flanders (FWO) under Grant No. 12P3519N. The first author is supported by the program of China Scholarships Council (CSC). The second to forth authors are all supported by the Alexander von Humboldt Foundation of Germany. ",
year = "2022",
month = jan,
day = "15",
doi = "10.1016/j.ymssp.2021.108106",
language = "English",
volume = "163",
journal = "Mechanical Systems and Signal Processing",
issn = "0888-3270",
publisher = "Academic Press Inc.",

}

Download

TY - JOUR

T1 - Data-driven and active learning of variance-based sensitivity indices with Bayesian probabilistic integration

AU - Song, Jingwen

AU - Wei, Pengfei

AU - Valdebenito, Marcos A.

AU - Faes, Matthias

AU - Beer, Michael

N1 - Funding Information: This work is supported by the National Natural Science Foundation of China under Grant No. 51905430, the Sino-German Mobility Program under Grant No. M-0175, the ANID (Agency for Research and Development, Chile) under its program FONDECYT, Grant No. 1180271, and the Research Foundation Flanders (FWO) under Grant No. 12P3519N. The first author is supported by the program of China Scholarships Council (CSC). The second to forth authors are all supported by the Alexander von Humboldt Foundation of Germany.

PY - 2022/1/15

Y1 - 2022/1/15

N2 - Variance-based sensitivity indices play an important role in scientific computation and data mining, thus the significance of developing numerical methods for efficient and reliable estimation of these sensitivity indices based on (expensive) computer simulators and/or data cannot be emphasized too much. In this article, the estimation of these sensitivity indices is treated as a statistical inference problem. Two principle lemmas are first proposed as rules of thumb for making the inference. After that, the posterior features for all the (partial) variance terms involved in the main and total effect indices are analytically derived (not in closed form) based on Bayesian Probabilistic Integration (BPI). This forms a data-driven method for estimating the sensitivity indices as well as the involved discretization errors. Further, to improve the efficiency of the developed method for expensive simulators, an acquisition function, named Posterior Variance Contribution (PVC), is utilized for realizing optimal designs of experiments, based on which an adaptive BPI method is established. The application of this framework is illustrated for the calculation of the main and total effect indices, but the proposed two principle lemmas also apply to the calculation of interaction effect indices. The performance of the development is demonstrated by an illustrative numerical example and three engineering benchmarks with finite element models.

AB - Variance-based sensitivity indices play an important role in scientific computation and data mining, thus the significance of developing numerical methods for efficient and reliable estimation of these sensitivity indices based on (expensive) computer simulators and/or data cannot be emphasized too much. In this article, the estimation of these sensitivity indices is treated as a statistical inference problem. Two principle lemmas are first proposed as rules of thumb for making the inference. After that, the posterior features for all the (partial) variance terms involved in the main and total effect indices are analytically derived (not in closed form) based on Bayesian Probabilistic Integration (BPI). This forms a data-driven method for estimating the sensitivity indices as well as the involved discretization errors. Further, to improve the efficiency of the developed method for expensive simulators, an acquisition function, named Posterior Variance Contribution (PVC), is utilized for realizing optimal designs of experiments, based on which an adaptive BPI method is established. The application of this framework is illustrated for the calculation of the main and total effect indices, but the proposed two principle lemmas also apply to the calculation of interaction effect indices. The performance of the development is demonstrated by an illustrative numerical example and three engineering benchmarks with finite element models.

KW - Adaptive experiment design

KW - Bayesian probabilistic integration

KW - Data-driven

KW - Gaussian process regression

KW - Posterior variance contribution

KW - Variance-based sensitivity

UR - http://www.scopus.com/inward/record.url?scp=85108119561&partnerID=8YFLogxK

U2 - 10.1016/j.ymssp.2021.108106

DO - 10.1016/j.ymssp.2021.108106

M3 - Article

AN - SCOPUS:85108119561

VL - 163

JO - Mechanical Systems and Signal Processing

JF - Mechanical Systems and Signal Processing

SN - 0888-3270

M1 - 108106

ER -

By the same author(s)