Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

View graph of relations

Details

Original languageEnglish
Title of host publicationProceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages483-491
Number of pages9
ISBN (electronic)9781665477734
ISBN (print)978-1-6654-7774-1
Publication statusPublished - 16 Jul 2025
Event25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025 - Hangzhou, China
Duration: 16 Jul 202520 Jul 2025

Publication series

NameProceedings - International Conference on Software Quality, Reliability and Security Companion
ISSN (Print)2693-938X
ISSN (electronic)2693-9371

Abstract

Fault prognostics is one of the key enablers for the realisation of predictive maintenance. In today's era of digital transformation, deep learning (DL) has proven to be a promising data-driven solution for the task of fault prognostics with the ability to accurately predict the remaining useful life of industrial assets based on their historical condition-monitoring data. However, the deployment of DL-based fault prognostics models in practice still faces a number of critical challenges, especially in application scenarios with dynamic or evolving contexts suffering from data distribution shifts. Jointly training DL models using data from all contexts at once is typically impossible due to practical requirements regarding privacy constraints and resource limitations. Moreover, fine-tuning or training DL models in a classical sequential manner has been observed to typically suffer from catastrophic forgetting where adapting to a new context leads to drastically forgetting what has been learned previously. To address this problem, we proposed a novel lifelong learning framework with Bayesian neural networks for fault prognostics. Our proposed Bayesian lifelong learning method focuses not only on preserving the old knowledge learned so far but also allows to reserve the model flexibility for learning new knowledge from upcoming contexts. Experimental results on the benchmark C-MAPSS dataset of turbofan engine degradation data show the superiority of our proposed framework over other relevant lifelong learning methods. On average, we achieve a performance improvement of 10.2% and 75.3% in terms of final prediction accuracy and forgetting measure, respectively.

Keywords

    Bayesian neural networks, deep learning, lifelong learning, Predictive maintenance, prognostics and health management, RUL prediction

ASJC Scopus subject areas

Cite this

Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks. / Xuan, Quy Le; Munderloh, Marco; Ostermann, Jörn.
Proceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025. Institute of Electrical and Electronics Engineers Inc., 2025. p. 483-491 (Proceedings - International Conference on Software Quality, Reliability and Security Companion).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Xuan, QL, Munderloh, M & Ostermann, J 2025, Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks. in Proceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025. Proceedings - International Conference on Software Quality, Reliability and Security Companion, Institute of Electrical and Electronics Engineers Inc., pp. 483-491, 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025, Hangzhou, China, 16 Jul 2025. https://doi.org/10.1109/QRS-C65679.2025.00066
Xuan, Q. L., Munderloh, M., & Ostermann, J. (2025). Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks. In Proceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025 (pp. 483-491). (Proceedings - International Conference on Software Quality, Reliability and Security Companion). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/QRS-C65679.2025.00066
Xuan QL, Munderloh M, Ostermann J. Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks. In Proceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025. Institute of Electrical and Electronics Engineers Inc. 2025. p. 483-491. (Proceedings - International Conference on Software Quality, Reliability and Security Companion). doi: 10.1109/QRS-C65679.2025.00066
Xuan, Quy Le ; Munderloh, Marco ; Ostermann, Jörn. / Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks. Proceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025. Institute of Electrical and Electronics Engineers Inc., 2025. pp. 483-491 (Proceedings - International Conference on Software Quality, Reliability and Security Companion).
Download
@inproceedings{e39169ac5b354ae2b9a8754435b19942,
title = "Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks",
abstract = "Fault prognostics is one of the key enablers for the realisation of predictive maintenance. In today's era of digital transformation, deep learning (DL) has proven to be a promising data-driven solution for the task of fault prognostics with the ability to accurately predict the remaining useful life of industrial assets based on their historical condition-monitoring data. However, the deployment of DL-based fault prognostics models in practice still faces a number of critical challenges, especially in application scenarios with dynamic or evolving contexts suffering from data distribution shifts. Jointly training DL models using data from all contexts at once is typically impossible due to practical requirements regarding privacy constraints and resource limitations. Moreover, fine-tuning or training DL models in a classical sequential manner has been observed to typically suffer from catastrophic forgetting where adapting to a new context leads to drastically forgetting what has been learned previously. To address this problem, we proposed a novel lifelong learning framework with Bayesian neural networks for fault prognostics. Our proposed Bayesian lifelong learning method focuses not only on preserving the old knowledge learned so far but also allows to reserve the model flexibility for learning new knowledge from upcoming contexts. Experimental results on the benchmark C-MAPSS dataset of turbofan engine degradation data show the superiority of our proposed framework over other relevant lifelong learning methods. On average, we achieve a performance improvement of 10.2% and 75.3% in terms of final prediction accuracy and forgetting measure, respectively.",
keywords = "Bayesian neural networks, deep learning, lifelong learning, Predictive maintenance, prognostics and health management, RUL prediction",
author = "Xuan, {Quy Le} and Marco Munderloh and J{\"o}rn Ostermann",
note = "Publisher Copyright: {\textcopyright} 2025 IEEE.; 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025, QRS-C 2025 ; Conference date: 16-07-2025 Through 20-07-2025",
year = "2025",
month = jul,
day = "16",
doi = "10.1109/QRS-C65679.2025.00066",
language = "English",
isbn = "978-1-6654-7774-1",
series = "Proceedings - International Conference on Software Quality, Reliability and Security Companion",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "483--491",
booktitle = "Proceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025",
address = "United States",

}

Download

TY - GEN

T1 - Lifelong Learning for Fault Prognostics in Predictive Maintenance with Bayesian Neural Networks

AU - Xuan, Quy Le

AU - Munderloh, Marco

AU - Ostermann, Jörn

N1 - Publisher Copyright: © 2025 IEEE.

PY - 2025/7/16

Y1 - 2025/7/16

N2 - Fault prognostics is one of the key enablers for the realisation of predictive maintenance. In today's era of digital transformation, deep learning (DL) has proven to be a promising data-driven solution for the task of fault prognostics with the ability to accurately predict the remaining useful life of industrial assets based on their historical condition-monitoring data. However, the deployment of DL-based fault prognostics models in practice still faces a number of critical challenges, especially in application scenarios with dynamic or evolving contexts suffering from data distribution shifts. Jointly training DL models using data from all contexts at once is typically impossible due to practical requirements regarding privacy constraints and resource limitations. Moreover, fine-tuning or training DL models in a classical sequential manner has been observed to typically suffer from catastrophic forgetting where adapting to a new context leads to drastically forgetting what has been learned previously. To address this problem, we proposed a novel lifelong learning framework with Bayesian neural networks for fault prognostics. Our proposed Bayesian lifelong learning method focuses not only on preserving the old knowledge learned so far but also allows to reserve the model flexibility for learning new knowledge from upcoming contexts. Experimental results on the benchmark C-MAPSS dataset of turbofan engine degradation data show the superiority of our proposed framework over other relevant lifelong learning methods. On average, we achieve a performance improvement of 10.2% and 75.3% in terms of final prediction accuracy and forgetting measure, respectively.

AB - Fault prognostics is one of the key enablers for the realisation of predictive maintenance. In today's era of digital transformation, deep learning (DL) has proven to be a promising data-driven solution for the task of fault prognostics with the ability to accurately predict the remaining useful life of industrial assets based on their historical condition-monitoring data. However, the deployment of DL-based fault prognostics models in practice still faces a number of critical challenges, especially in application scenarios with dynamic or evolving contexts suffering from data distribution shifts. Jointly training DL models using data from all contexts at once is typically impossible due to practical requirements regarding privacy constraints and resource limitations. Moreover, fine-tuning or training DL models in a classical sequential manner has been observed to typically suffer from catastrophic forgetting where adapting to a new context leads to drastically forgetting what has been learned previously. To address this problem, we proposed a novel lifelong learning framework with Bayesian neural networks for fault prognostics. Our proposed Bayesian lifelong learning method focuses not only on preserving the old knowledge learned so far but also allows to reserve the model flexibility for learning new knowledge from upcoming contexts. Experimental results on the benchmark C-MAPSS dataset of turbofan engine degradation data show the superiority of our proposed framework over other relevant lifelong learning methods. On average, we achieve a performance improvement of 10.2% and 75.3% in terms of final prediction accuracy and forgetting measure, respectively.

KW - Bayesian neural networks

KW - deep learning

KW - lifelong learning

KW - Predictive maintenance

KW - prognostics and health management

KW - RUL prediction

UR - http://www.scopus.com/inward/record.url?scp=105023657829&partnerID=8YFLogxK

U2 - 10.1109/QRS-C65679.2025.00066

DO - 10.1109/QRS-C65679.2025.00066

M3 - Conference contribution

AN - SCOPUS:105023657829

SN - 978-1-6654-7774-1

T3 - Proceedings - International Conference on Software Quality, Reliability and Security Companion

SP - 483

EP - 491

BT - Proceedings - 2025 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 25th International Conference on Software Quality, Reliability and Security Companion, QRS-C 2025

Y2 - 16 July 2025 through 20 July 2025

ER -

By the same author(s)