Details
| Originalsprache | Englisch |
|---|---|
| Titel des Sammelwerks | GECCO '23: Proceedings of the Genetic and Evolutionary Computation Conference Companion |
| Seiten | 483 - 486 |
| Seitenumfang | 4 |
| ISBN (elektronisch) | 9798400701207 |
| Publikationsstatus | Veröffentlicht - 24 Juli 2023 |
Abstract
with unknown problem structures. Bayesian Optimization (BO) is
a popular, surrogate-assisted and thus sample-efficient approach
for this setting. The BO pipeline itself is highly configurable with
many different design choices regarding the initial design, surrogate
model and acquisition function (AF). Unfortunately, our understand-
ing of how to select suitable components for a problem at hand is
very limited. In this work, we focus on the choice of the AF, whose
main purpose it is to balance the trade-off between exploring re-
gions with high uncertainty and those with high promise for good
solutions. We propose Self-Adjusting Weighted Expected Improve-
ment (SAWEI), where we let the exploration-exploitation trade-off
self-adjust in a data-driven manner based on a convergence crite-
rion for BO. On the BBOB functions of the COCO benchmark, our
method performs favorably compared to handcrafted baselines and
serves as a robust default choice for any problem structure. With
SAWEI, we are a step closer to on-the-fly, data-driven and robust
BO designs that automatically adjust their sampling behavior to
the problem at hand.
ASJC Scopus Sachgebiete
- Informatik (insg.)
- Software
- Informatik (insg.)
- Theoretische Informatik und Mathematik
- Informatik (insg.)
- Angewandte Informatik
Zitieren
- Standard
- Harvard
- Apa
- Vancouver
- BibTex
- RIS
GECCO '23: Proceedings of the Genetic and Evolutionary Computation Conference Companion. 2023. S. 483 - 486.
Publikation: Beitrag in Buch/Bericht/Sammelwerk/Konferenzband › Aufsatz in Konferenzband › Forschung › Peer-Review
}
TY - GEN
T1 - Towards Self-Adjusting Weighted Expected Improvement for Bayesian Optimization
AU - Benjamins, Carolin
AU - Raponi, Elena
AU - Jankovic, Anja
AU - Doerr, Carola
AU - Lindauer, Marius
N1 - Publisher Copyright: © 2023 Copyright held by the owner/author(s).
PY - 2023/7/24
Y1 - 2023/7/24
N2 - In optimization, we often encounter expensive black-box problemswith unknown problem structures. Bayesian Optimization (BO) isa popular, surrogate-assisted and thus sample-efficient approachfor this setting. The BO pipeline itself is highly configurable withmany different design choices regarding the initial design, surrogatemodel and acquisition function (AF). Unfortunately, our understand-ing of how to select suitable components for a problem at hand isvery limited. In this work, we focus on the choice of the AF, whosemain purpose it is to balance the trade-off between exploring re-gions with high uncertainty and those with high promise for goodsolutions. We propose Self-Adjusting Weighted Expected Improve-ment (SAWEI), where we let the exploration-exploitation trade-offself-adjust in a data-driven manner based on a convergence crite-rion for BO. On the BBOB functions of the COCO benchmark, ourmethod performs favorably compared to handcrafted baselines andserves as a robust default choice for any problem structure. WithSAWEI, we are a step closer to on-the-fly, data-driven and robustBO designs that automatically adjust their sampling behavior tothe problem at hand.
AB - In optimization, we often encounter expensive black-box problemswith unknown problem structures. Bayesian Optimization (BO) isa popular, surrogate-assisted and thus sample-efficient approachfor this setting. The BO pipeline itself is highly configurable withmany different design choices regarding the initial design, surrogatemodel and acquisition function (AF). Unfortunately, our understand-ing of how to select suitable components for a problem at hand isvery limited. In this work, we focus on the choice of the AF, whosemain purpose it is to balance the trade-off between exploring re-gions with high uncertainty and those with high promise for goodsolutions. We propose Self-Adjusting Weighted Expected Improve-ment (SAWEI), where we let the exploration-exploitation trade-offself-adjust in a data-driven manner based on a convergence crite-rion for BO. On the BBOB functions of the COCO benchmark, ourmethod performs favorably compared to handcrafted baselines andserves as a robust default choice for any problem structure. WithSAWEI, we are a step closer to on-the-fly, data-driven and robustBO designs that automatically adjust their sampling behavior tothe problem at hand.
KW - Bayesian optimization
KW - Weighted Expected Improvement
KW - Self-adjusting
KW - Acquisition function schedules
KW - Upper bound regret
KW - Bayesian Optimization
KW - Acquisition Function Schedules
KW - Self-Adjusting Weighted Expected Improvement
KW - Upper Bound Regret
UR - http://www.scopus.com/inward/record.url?scp=85169024905&partnerID=8YFLogxK
U2 - 10.1145/3583133
DO - 10.1145/3583133
M3 - Conference contribution
SP - 483
EP - 486
BT - GECCO '23: Proceedings of the Genetic and Evolutionary Computation Conference Companion
ER -