On the relation between dynamic regret and closed-loop stability

Research output: Contribution to journalArticleResearchpeer review

View graph of relations

Details

Original languageEnglish
Article number105532
JournalSystems and Control Letters
Volume177
Early online date7 May 2023
Publication statusPublished - Jul 2023

Abstract

In this work, we study the relations between bounded dynamic regret and the classical notion of asymptotic stability for the case of a priori unknown and time-varying cost functions. In particular, we show that bounded dynamic regret implies asymptotic stability of the optimal steady state for a constant cost function. For the case of an asymptotically stable closed loop, we first derive a necessary condition for achieving bounded dynamic regret. Then, given some additional assumptions on the system and the cost functions, we also provide a sufficient condition ensuring bounded dynamic regret. Our results are illustrated by examples.

Keywords

    Asymptotic stability, Dynamic regret, Online convex optimization, Time-varying optimal control

ASJC Scopus subject areas

Cite this

On the relation between dynamic regret and closed-loop stability. / Nonhoff, Marko; Müller, Matthias A.
In: Systems and Control Letters, Vol. 177, 105532, 07.2023.

Research output: Contribution to journalArticleResearchpeer review

Nonhoff M, Müller MA. On the relation between dynamic regret and closed-loop stability. Systems and Control Letters. 2023 Jul;177:105532. Epub 2023 May 7. doi: 10.48550/arXiv.2209.05964, 10.1016/j.sysconle.2023.105532
Download
@article{420c26f2ef6b43e9acfb68fa1f9df293,
title = "On the relation between dynamic regret and closed-loop stability",
abstract = "In this work, we study the relations between bounded dynamic regret and the classical notion of asymptotic stability for the case of a priori unknown and time-varying cost functions. In particular, we show that bounded dynamic regret implies asymptotic stability of the optimal steady state for a constant cost function. For the case of an asymptotically stable closed loop, we first derive a necessary condition for achieving bounded dynamic regret. Then, given some additional assumptions on the system and the cost functions, we also provide a sufficient condition ensuring bounded dynamic regret. Our results are illustrated by examples.",
keywords = "Asymptotic stability, Dynamic regret, Online convex optimization, Time-varying optimal control",
author = "Marko Nonhoff and M{\"u}ller, {Matthias A.}",
note = "Funding Information: This work was supported by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) - 505182457 .",
year = "2023",
month = jul,
doi = "10.48550/arXiv.2209.05964",
language = "English",
volume = "177",
journal = "Systems and Control Letters",
issn = "0167-6911",
publisher = "Elsevier",

}

Download

TY - JOUR

T1 - On the relation between dynamic regret and closed-loop stability

AU - Nonhoff, Marko

AU - Müller, Matthias A.

N1 - Funding Information: This work was supported by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) - 505182457 .

PY - 2023/7

Y1 - 2023/7

N2 - In this work, we study the relations between bounded dynamic regret and the classical notion of asymptotic stability for the case of a priori unknown and time-varying cost functions. In particular, we show that bounded dynamic regret implies asymptotic stability of the optimal steady state for a constant cost function. For the case of an asymptotically stable closed loop, we first derive a necessary condition for achieving bounded dynamic regret. Then, given some additional assumptions on the system and the cost functions, we also provide a sufficient condition ensuring bounded dynamic regret. Our results are illustrated by examples.

AB - In this work, we study the relations between bounded dynamic regret and the classical notion of asymptotic stability for the case of a priori unknown and time-varying cost functions. In particular, we show that bounded dynamic regret implies asymptotic stability of the optimal steady state for a constant cost function. For the case of an asymptotically stable closed loop, we first derive a necessary condition for achieving bounded dynamic regret. Then, given some additional assumptions on the system and the cost functions, we also provide a sufficient condition ensuring bounded dynamic regret. Our results are illustrated by examples.

KW - Asymptotic stability

KW - Dynamic regret

KW - Online convex optimization

KW - Time-varying optimal control

UR - http://www.scopus.com/inward/record.url?scp=85158027121&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2209.05964

DO - 10.48550/arXiv.2209.05964

M3 - Article

AN - SCOPUS:85158027121

VL - 177

JO - Systems and Control Letters

JF - Systems and Control Letters

SN - 0167-6911

M1 - 105532

ER -

By the same author(s)