An RL-Based Model for Optimized Kubernetes Scheduling

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • John Rothman
  • Javad Chamanara

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publication2023 IEEE 31st International Conference on Network Protocols
Subtitle of host publicationICNP
PublisherIEEE Computer Society
Number of pages6
ISBN (electronic)9798350303223
ISBN (print)979-8-3503-0323-0
Publication statusPublished - 2023
Event31st IEEE International Conference on Network Protocols, ICNP 2023 - Reykjavik, Iceland
Duration: 10 Oct 202313 Oct 2023

Publication series

NameProceedings - International Conference on Network Protocols, ICNP
ISSN (Print)1092-1648

Abstract

In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.

Keywords

    Energy Consumption, Kubernetes, Optimization, Scheduling

ASJC Scopus subject areas

Sustainable Development Goals

Cite this

An RL-Based Model for Optimized Kubernetes Scheduling. / Rothman, John; Chamanara, Javad.
2023 IEEE 31st International Conference on Network Protocols: ICNP. IEEE Computer Society, 2023. (Proceedings - International Conference on Network Protocols, ICNP).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Rothman, J & Chamanara, J 2023, An RL-Based Model for Optimized Kubernetes Scheduling. in 2023 IEEE 31st International Conference on Network Protocols: ICNP. Proceedings - International Conference on Network Protocols, ICNP, IEEE Computer Society, 31st IEEE International Conference on Network Protocols, ICNP 2023, Reykjavik, Iceland, 10 Oct 2023. https://doi.org/10.1109/ICNP59255.2023.10355623
Rothman, J., & Chamanara, J. (2023). An RL-Based Model for Optimized Kubernetes Scheduling. In 2023 IEEE 31st International Conference on Network Protocols: ICNP (Proceedings - International Conference on Network Protocols, ICNP). IEEE Computer Society. https://doi.org/10.1109/ICNP59255.2023.10355623
Rothman J, Chamanara J. An RL-Based Model for Optimized Kubernetes Scheduling. In 2023 IEEE 31st International Conference on Network Protocols: ICNP. IEEE Computer Society. 2023. (Proceedings - International Conference on Network Protocols, ICNP). doi: 10.1109/ICNP59255.2023.10355623
Rothman, John ; Chamanara, Javad. / An RL-Based Model for Optimized Kubernetes Scheduling. 2023 IEEE 31st International Conference on Network Protocols: ICNP. IEEE Computer Society, 2023. (Proceedings - International Conference on Network Protocols, ICNP).
Download
@inproceedings{7ca48a820db54966bfc280440c704ea3,
title = "An RL-Based Model for Optimized Kubernetes Scheduling",
abstract = "In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.",
keywords = "Energy Consumption, Kubernetes, Optimization, Scheduling",
author = "John Rothman and Javad Chamanara",
year = "2023",
doi = "10.1109/ICNP59255.2023.10355623",
language = "English",
isbn = "979-8-3503-0323-0",
series = "Proceedings - International Conference on Network Protocols, ICNP",
publisher = "IEEE Computer Society",
booktitle = "2023 IEEE 31st International Conference on Network Protocols",
address = "United States",
note = "31st IEEE International Conference on Network Protocols, ICNP 2023 ; Conference date: 10-10-2023 Through 13-10-2023",

}

Download

TY - GEN

T1 - An RL-Based Model for Optimized Kubernetes Scheduling

AU - Rothman, John

AU - Chamanara, Javad

PY - 2023

Y1 - 2023

N2 - In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.

AB - In this paper, we present RLKube, a Reinforcement Learning (RL)-based custom Kubernetes (K8s) scheduler plugin for optimized task scheduling. RLKube objectives are maximizing resource utilization and Pod throughput as well as improving energy efficiency in a K8s cluster. We used Double Deep Q-Network (DDQN) with Prioritized Experience Replay (PER) and utilized different reward functions to train the RL agent. Also, we have developed corresponding policies for each objective. We have evaluated the effectiveness of RLKube using various datasets simulating a diverse set of realistic load patterns. The results show that RLKube outperforms the default K8s scheduling policies in terms of throughput and energy usage, highlighting its potential for Improving task scheduling in K8s clusters.

KW - Energy Consumption

KW - Kubernetes

KW - Optimization

KW - Scheduling

UR - http://www.scopus.com/inward/record.url?scp=85182517484&partnerID=8YFLogxK

U2 - 10.1109/ICNP59255.2023.10355623

DO - 10.1109/ICNP59255.2023.10355623

M3 - Conference contribution

AN - SCOPUS:85182517484

SN - 979-8-3503-0323-0

T3 - Proceedings - International Conference on Network Protocols, ICNP

BT - 2023 IEEE 31st International Conference on Network Protocols

PB - IEEE Computer Society

T2 - 31st IEEE International Conference on Network Protocols, ICNP 2023

Y2 - 10 October 2023 through 13 October 2023

ER -