Novel gradient-enhanced Bayesian neural networks for uncertainty propagation

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Autoren

Externe Organisationen

  • Xi'an Aircraft Industrial Corporation
  • The University of Liverpool
  • Tongji University
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Aufsatznummer117188
Seitenumfang26
FachzeitschriftComputer Methods in Applied Mechanics and Engineering
Jahrgang429
Frühes Online-Datum1 Juli 2024
PublikationsstatusVeröffentlicht - 1 Sept. 2024

Abstract

Uncertainty propagation (UP) is crucial for assessing the impact of input uncertainty on structural responses, holding significant importance in engineering applications. However, achieving accurate and efficient UP remains challenging, especially for highly nonlinear structures. Bayesian neural networks (BNN) have gained attention for addressing UP issues, yet current BNN models only utilize input samples and corresponding structural responses for training. However, incorporating gradients of structural responses with respect to input samples provides valuable information. This study proposes a novel approach called gradient-enhanced Bayesian neural networks (GEBNN) to tackle UP tasks. In the GEBNN, a modified evidence lower bound (MELBO) loss is developed to consider both structural responses and gradient information simultaneously. This includes disparities between actual and predicted responses, as well as disparities between actual and predicted derivatives. Additionally, a gradient screening strategy based on the marginal probability density functions (PDFs) of input samples is established to identify significant derivative data for GEBNN training. Once the GEBNN is configured, it is utilized to replace the computationally intensive finite element model to efficiently provide UP results. Various applications, including nonlinear numerical examples, and mechanical, civil, and aeronautical structures, are presented to demonstrate the effectiveness of the GEBNN. The results show that the GEBNN significantly enhances the computational accuracy of the BNN in solving UP tasks.

ASJC Scopus Sachgebiete

Zitieren

Novel gradient-enhanced Bayesian neural networks for uncertainty propagation. / Shi, Yan; Chai, Rui; Beer, Michael.
in: Computer Methods in Applied Mechanics and Engineering, Jahrgang 429, 117188, 01.09.2024.

Publikation: Beitrag in FachzeitschriftArtikelForschungPeer-Review

Download
@article{d10d22dbcb0246b49982989f2ba4a0c3,
title = "Novel gradient-enhanced Bayesian neural networks for uncertainty propagation",
abstract = "Uncertainty propagation (UP) is crucial for assessing the impact of input uncertainty on structural responses, holding significant importance in engineering applications. However, achieving accurate and efficient UP remains challenging, especially for highly nonlinear structures. Bayesian neural networks (BNN) have gained attention for addressing UP issues, yet current BNN models only utilize input samples and corresponding structural responses for training. However, incorporating gradients of structural responses with respect to input samples provides valuable information. This study proposes a novel approach called gradient-enhanced Bayesian neural networks (GEBNN) to tackle UP tasks. In the GEBNN, a modified evidence lower bound (MELBO) loss is developed to consider both structural responses and gradient information simultaneously. This includes disparities between actual and predicted responses, as well as disparities between actual and predicted derivatives. Additionally, a gradient screening strategy based on the marginal probability density functions (PDFs) of input samples is established to identify significant derivative data for GEBNN training. Once the GEBNN is configured, it is utilized to replace the computationally intensive finite element model to efficiently provide UP results. Various applications, including nonlinear numerical examples, and mechanical, civil, and aeronautical structures, are presented to demonstrate the effectiveness of the GEBNN. The results show that the GEBNN significantly enhances the computational accuracy of the BNN in solving UP tasks.",
keywords = "Bayesian neural networks, Evidence lower bound loss, Gradient information, Gradient screening strategy, Uncertainty propagation",
author = "Yan Shi and Rui Chai and Michael Beer",
note = "Publisher Copyright: {\textcopyright} 2024 The Author(s)",
year = "2024",
month = sep,
day = "1",
doi = "10.1016/j.cma.2024.117188",
language = "English",
volume = "429",
journal = "Computer Methods in Applied Mechanics and Engineering",
issn = "0045-7825",
publisher = "Elsevier",

}

Download

TY - JOUR

T1 - Novel gradient-enhanced Bayesian neural networks for uncertainty propagation

AU - Shi, Yan

AU - Chai, Rui

AU - Beer, Michael

N1 - Publisher Copyright: © 2024 The Author(s)

PY - 2024/9/1

Y1 - 2024/9/1

N2 - Uncertainty propagation (UP) is crucial for assessing the impact of input uncertainty on structural responses, holding significant importance in engineering applications. However, achieving accurate and efficient UP remains challenging, especially for highly nonlinear structures. Bayesian neural networks (BNN) have gained attention for addressing UP issues, yet current BNN models only utilize input samples and corresponding structural responses for training. However, incorporating gradients of structural responses with respect to input samples provides valuable information. This study proposes a novel approach called gradient-enhanced Bayesian neural networks (GEBNN) to tackle UP tasks. In the GEBNN, a modified evidence lower bound (MELBO) loss is developed to consider both structural responses and gradient information simultaneously. This includes disparities between actual and predicted responses, as well as disparities between actual and predicted derivatives. Additionally, a gradient screening strategy based on the marginal probability density functions (PDFs) of input samples is established to identify significant derivative data for GEBNN training. Once the GEBNN is configured, it is utilized to replace the computationally intensive finite element model to efficiently provide UP results. Various applications, including nonlinear numerical examples, and mechanical, civil, and aeronautical structures, are presented to demonstrate the effectiveness of the GEBNN. The results show that the GEBNN significantly enhances the computational accuracy of the BNN in solving UP tasks.

AB - Uncertainty propagation (UP) is crucial for assessing the impact of input uncertainty on structural responses, holding significant importance in engineering applications. However, achieving accurate and efficient UP remains challenging, especially for highly nonlinear structures. Bayesian neural networks (BNN) have gained attention for addressing UP issues, yet current BNN models only utilize input samples and corresponding structural responses for training. However, incorporating gradients of structural responses with respect to input samples provides valuable information. This study proposes a novel approach called gradient-enhanced Bayesian neural networks (GEBNN) to tackle UP tasks. In the GEBNN, a modified evidence lower bound (MELBO) loss is developed to consider both structural responses and gradient information simultaneously. This includes disparities between actual and predicted responses, as well as disparities between actual and predicted derivatives. Additionally, a gradient screening strategy based on the marginal probability density functions (PDFs) of input samples is established to identify significant derivative data for GEBNN training. Once the GEBNN is configured, it is utilized to replace the computationally intensive finite element model to efficiently provide UP results. Various applications, including nonlinear numerical examples, and mechanical, civil, and aeronautical structures, are presented to demonstrate the effectiveness of the GEBNN. The results show that the GEBNN significantly enhances the computational accuracy of the BNN in solving UP tasks.

KW - Bayesian neural networks

KW - Evidence lower bound loss

KW - Gradient information

KW - Gradient screening strategy

KW - Uncertainty propagation

UR - http://www.scopus.com/inward/record.url?scp=85197352472&partnerID=8YFLogxK

U2 - 10.1016/j.cma.2024.117188

DO - 10.1016/j.cma.2024.117188

M3 - Article

AN - SCOPUS:85197352472

VL - 429

JO - Computer Methods in Applied Mechanics and Engineering

JF - Computer Methods in Applied Mechanics and Engineering

SN - 0045-7825

M1 - 117188

ER -

Von denselben Autoren