Maintaining and Monitoring AIOps Models Against Concept Drift

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • Delft University of Technology
View graph of relations

Details

Original languageEnglish
Title of host publication2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN)
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages98-99
Number of pages2
ISBN (electronic)9798350301137
ISBN (print)979-8-3503-0114-4
Publication statusPublished - 2023
Event2nd IEEE/ACM International Conference on AI Engineering - Software Engineering for AI, CAIN 2023 - Melbourne, Australia
Duration: 15 May 202316 May 2023

Abstract

AIOps solutions enable faster discovery of failures in operational large-scale systems through machine learning models trained on operation data. These models become outdated during the occurrence of concept drift, a term used to describe shifts in data distributions. In operation data concept drift is inevitable and it impacts the performance of AIOps solutions over time. Therefore, concept drift should be closely monitored and immediate maintenance to prevent erroneous predictions is required. In this work, we propose an automated maintenance pipeline for AIOps models that monitors the occurrence of concept drift and chooses the most appropriate model retraining technique according to the drift type.

Keywords

    AIOps, concept drift adaptation, concept drift detection, machine learning model lifecycle

ASJC Scopus subject areas

Cite this

Maintaining and Monitoring AIOps Models Against Concept Drift. / Poenaru-Olaru, Lorena; Miranda da Cruz, Luis; Rellermeyer, Jan S. et al.
2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN). Institute of Electrical and Electronics Engineers Inc., 2023. p. 98-99.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Poenaru-Olaru, L, Miranda da Cruz, L, Rellermeyer, JS & Van Deursen, A 2023, Maintaining and Monitoring AIOps Models Against Concept Drift. in 2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN). Institute of Electrical and Electronics Engineers Inc., pp. 98-99, 2nd IEEE/ACM International Conference on AI Engineering - Software Engineering for AI, CAIN 2023, Melbourne, Australia, 15 May 2023. https://doi.org/10.1109/CAIN58948.2023.00024
Poenaru-Olaru, L., Miranda da Cruz, L., Rellermeyer, J. S., & Van Deursen, A. (2023). Maintaining and Monitoring AIOps Models Against Concept Drift. In 2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN) (pp. 98-99). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CAIN58948.2023.00024
Poenaru-Olaru L, Miranda da Cruz L, Rellermeyer JS, Van Deursen A. Maintaining and Monitoring AIOps Models Against Concept Drift. In 2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN). Institute of Electrical and Electronics Engineers Inc. 2023. p. 98-99 doi: 10.1109/CAIN58948.2023.00024
Poenaru-Olaru, Lorena ; Miranda da Cruz, Luis ; Rellermeyer, Jan S. et al. / Maintaining and Monitoring AIOps Models Against Concept Drift. 2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN). Institute of Electrical and Electronics Engineers Inc., 2023. pp. 98-99
Download
@inproceedings{9ced2d7e7948466eb316b4667e2e1ce0,
title = "Maintaining and Monitoring AIOps Models Against Concept Drift",
abstract = "AIOps solutions enable faster discovery of failures in operational large-scale systems through machine learning models trained on operation data. These models become outdated during the occurrence of concept drift, a term used to describe shifts in data distributions. In operation data concept drift is inevitable and it impacts the performance of AIOps solutions over time. Therefore, concept drift should be closely monitored and immediate maintenance to prevent erroneous predictions is required. In this work, we propose an automated maintenance pipeline for AIOps models that monitors the occurrence of concept drift and chooses the most appropriate model retraining technique according to the drift type.",
keywords = "AIOps, concept drift adaptation, concept drift detection, machine learning model lifecycle",
author = "Lorena Poenaru-Olaru and {Miranda da Cruz}, Luis and Rellermeyer, {Jan S.} and {Van Deursen}, Arie",
year = "2023",
doi = "10.1109/CAIN58948.2023.00024",
language = "English",
isbn = "979-8-3503-0114-4",
pages = "98--99",
booktitle = "2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN)",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",
note = "2nd IEEE/ACM International Conference on AI Engineering - Software Engineering for AI, CAIN 2023 ; Conference date: 15-05-2023 Through 16-05-2023",

}

Download

TY - GEN

T1 - Maintaining and Monitoring AIOps Models Against Concept Drift

AU - Poenaru-Olaru, Lorena

AU - Miranda da Cruz, Luis

AU - Rellermeyer, Jan S.

AU - Van Deursen, Arie

PY - 2023

Y1 - 2023

N2 - AIOps solutions enable faster discovery of failures in operational large-scale systems through machine learning models trained on operation data. These models become outdated during the occurrence of concept drift, a term used to describe shifts in data distributions. In operation data concept drift is inevitable and it impacts the performance of AIOps solutions over time. Therefore, concept drift should be closely monitored and immediate maintenance to prevent erroneous predictions is required. In this work, we propose an automated maintenance pipeline for AIOps models that monitors the occurrence of concept drift and chooses the most appropriate model retraining technique according to the drift type.

AB - AIOps solutions enable faster discovery of failures in operational large-scale systems through machine learning models trained on operation data. These models become outdated during the occurrence of concept drift, a term used to describe shifts in data distributions. In operation data concept drift is inevitable and it impacts the performance of AIOps solutions over time. Therefore, concept drift should be closely monitored and immediate maintenance to prevent erroneous predictions is required. In this work, we propose an automated maintenance pipeline for AIOps models that monitors the occurrence of concept drift and chooses the most appropriate model retraining technique according to the drift type.

KW - AIOps

KW - concept drift adaptation

KW - concept drift detection

KW - machine learning model lifecycle

UR - http://www.scopus.com/inward/record.url?scp=85165126759&partnerID=8YFLogxK

U2 - 10.1109/CAIN58948.2023.00024

DO - 10.1109/CAIN58948.2023.00024

M3 - Conference contribution

AN - SCOPUS:85165126759

SN - 979-8-3503-0114-4

SP - 98

EP - 99

BT - 2023 IEEE/ACM 2nd International Conference on AI Engineering – Software Engineering for AI (CAIN)

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2nd IEEE/ACM International Conference on AI Engineering - Software Engineering for AI, CAIN 2023

Y2 - 15 May 2023 through 16 May 2023

ER -

By the same author(s)