Loading [MathJax]/extensions/tex2jax.js

HyperAlloc: Efficient VM Memory De/Inflation via Hypervisor-Shared Page-Frame Allocators

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Lars Wrenger
  • Kenny Albes
  • Marco Wurps
  • Christian Dietrich
  • Daniel Lohmann

External Research Organisations

  • Technische Universität Braunschweig

Details

Original languageEnglish
Title of host publicationEuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems
Pages702-719
Number of pages18
ISBN (electronic)9798400711961
Publication statusPublished - 30 Mar 2025
Event20th European Conference on Computer Systems (EuroSys 2025) co-located with 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2025) - Rotterdam, Netherlands
Duration: 30 Mar 20253 Apr 2025

Abstract

The provisioning of the right amount of DRAM to virtual machines (VMs) is still a major challenge and cost driver in virtualization settings. Many VMs run applications with highly volatile memory demands, which either leads to massive overprovisioning in low-demand phases or poor QoS in high-demand phases. Memory hotplugging and ballooning have become established techniques (in Linux/KVM available via virtio-mem and virtio-balloon) to dynamically de/inflate the physical memory of a VM cooperatively, by having the guests give back unused memory to the hypervisor. However, current VM deflation techniques are either not DMA-safe, preventing the passthrough of important devices like GPUs or NICs, or are not flexible or fast enough to cope with the frequently changing demands of the guest. We present HyperAlloc, a DMA-safe and extremely efficient mechanism for virtual machine de/inflation. The core idea is to provide the hypervisor direct access to the guest’s page-frame allocator, greatly reducing the communication overhead. HyperAlloc can shrink virtual machines 362 times faster than virtio-balloon and 10 times faster than virtio-mem while having no measurable impact on the guest’s performance. HyperAlloc’s automatic reclamation provides for better memory elasticity by reducing the average memory footprint of a clang compilation by 17 percent compared to virtio-balloon’s free-page reporting while, again, having no measurable impact on the guest’s performance.

Keywords

    Allocators, Ballooning, Overcommitment, Virtual Machines

ASJC Scopus subject areas

Cite this

HyperAlloc: Efficient VM Memory De/Inflation via Hypervisor-Shared Page-Frame Allocators. / Wrenger, Lars; Albes, Kenny; Wurps, Marco et al.
EuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems. 2025. p. 702-719.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Wrenger, L, Albes, K, Wurps, M, Dietrich, C & Lohmann, D 2025, HyperAlloc: Efficient VM Memory De/Inflation via Hypervisor-Shared Page-Frame Allocators. in EuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems. pp. 702-719, 20th European Conference on Computer Systems (EuroSys 2025) co-located with 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2025), Rotterdam, Netherlands, 30 Mar 2025. https://doi.org/10.1145/3689031.3717484
Wrenger, L., Albes, K., Wurps, M., Dietrich, C., & Lohmann, D. (2025). HyperAlloc: Efficient VM Memory De/Inflation via Hypervisor-Shared Page-Frame Allocators. In EuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems (pp. 702-719) https://doi.org/10.1145/3689031.3717484
Wrenger L, Albes K, Wurps M, Dietrich C, Lohmann D. HyperAlloc: Efficient VM Memory De/Inflation via Hypervisor-Shared Page-Frame Allocators. In EuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems. 2025. p. 702-719 doi: 10.1145/3689031.3717484
Wrenger, Lars ; Albes, Kenny ; Wurps, Marco et al. / HyperAlloc : Efficient VM Memory De/Inflation via Hypervisor-Shared Page-Frame Allocators. EuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems. 2025. pp. 702-719
Download
@inproceedings{13922bf348af4069abae8f8398c0ee9b,
title = "HyperAlloc: Efficient VM Memory De/Inflation via Hypervisor-Shared Page-Frame Allocators",
abstract = "The provisioning of the right amount of DRAM to virtual machines (VMs) is still a major challenge and cost driver in virtualization settings. Many VMs run applications with highly volatile memory demands, which either leads to massive overprovisioning in low-demand phases or poor QoS in high-demand phases. Memory hotplugging and ballooning have become established techniques (in Linux/KVM available via virtio-mem and virtio-balloon) to dynamically de/inflate the physical memory of a VM cooperatively, by having the guests give back unused memory to the hypervisor. However, current VM deflation techniques are either not DMA-safe, preventing the passthrough of important devices like GPUs or NICs, or are not flexible or fast enough to cope with the frequently changing demands of the guest. We present HyperAlloc, a DMA-safe and extremely efficient mechanism for virtual machine de/inflation. The core idea is to provide the hypervisor direct access to the guest{\textquoteright}s page-frame allocator, greatly reducing the communication overhead. HyperAlloc can shrink virtual machines 362 times faster than virtio-balloon and 10 times faster than virtio-mem while having no measurable impact on the guest{\textquoteright}s performance. HyperAlloc{\textquoteright}s automatic reclamation provides for better memory elasticity by reducing the average memory footprint of a clang compilation by 17 percent compared to virtio-balloon{\textquoteright}s free-page reporting while, again, having no measurable impact on the guest{\textquoteright}s performance.",
keywords = "Allocators, Ballooning, Overcommitment, Virtual Machines",
author = "Lars Wrenger and Kenny Albes and Marco Wurps and Christian Dietrich and Daniel Lohmann",
note = "Publisher Copyright: {\textcopyright} 2025 Copyright held by the owner/author(s).; 20th European Conference on Computer Systems (EuroSys 2025) co-located with 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2025) ; Conference date: 30-03-2025 Through 03-04-2025",
year = "2025",
month = mar,
day = "30",
doi = "10.1145/3689031.3717484",
language = "English",
pages = "702--719",
booktitle = "EuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems",

}

Download

TY - GEN

T1 - HyperAlloc

T2 - 20th European Conference on Computer Systems (EuroSys 2025) co-located with 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2025)

AU - Wrenger, Lars

AU - Albes, Kenny

AU - Wurps, Marco

AU - Dietrich, Christian

AU - Lohmann, Daniel

N1 - Publisher Copyright: © 2025 Copyright held by the owner/author(s).

PY - 2025/3/30

Y1 - 2025/3/30

N2 - The provisioning of the right amount of DRAM to virtual machines (VMs) is still a major challenge and cost driver in virtualization settings. Many VMs run applications with highly volatile memory demands, which either leads to massive overprovisioning in low-demand phases or poor QoS in high-demand phases. Memory hotplugging and ballooning have become established techniques (in Linux/KVM available via virtio-mem and virtio-balloon) to dynamically de/inflate the physical memory of a VM cooperatively, by having the guests give back unused memory to the hypervisor. However, current VM deflation techniques are either not DMA-safe, preventing the passthrough of important devices like GPUs or NICs, or are not flexible or fast enough to cope with the frequently changing demands of the guest. We present HyperAlloc, a DMA-safe and extremely efficient mechanism for virtual machine de/inflation. The core idea is to provide the hypervisor direct access to the guest’s page-frame allocator, greatly reducing the communication overhead. HyperAlloc can shrink virtual machines 362 times faster than virtio-balloon and 10 times faster than virtio-mem while having no measurable impact on the guest’s performance. HyperAlloc’s automatic reclamation provides for better memory elasticity by reducing the average memory footprint of a clang compilation by 17 percent compared to virtio-balloon’s free-page reporting while, again, having no measurable impact on the guest’s performance.

AB - The provisioning of the right amount of DRAM to virtual machines (VMs) is still a major challenge and cost driver in virtualization settings. Many VMs run applications with highly volatile memory demands, which either leads to massive overprovisioning in low-demand phases or poor QoS in high-demand phases. Memory hotplugging and ballooning have become established techniques (in Linux/KVM available via virtio-mem and virtio-balloon) to dynamically de/inflate the physical memory of a VM cooperatively, by having the guests give back unused memory to the hypervisor. However, current VM deflation techniques are either not DMA-safe, preventing the passthrough of important devices like GPUs or NICs, or are not flexible or fast enough to cope with the frequently changing demands of the guest. We present HyperAlloc, a DMA-safe and extremely efficient mechanism for virtual machine de/inflation. The core idea is to provide the hypervisor direct access to the guest’s page-frame allocator, greatly reducing the communication overhead. HyperAlloc can shrink virtual machines 362 times faster than virtio-balloon and 10 times faster than virtio-mem while having no measurable impact on the guest’s performance. HyperAlloc’s automatic reclamation provides for better memory elasticity by reducing the average memory footprint of a clang compilation by 17 percent compared to virtio-balloon’s free-page reporting while, again, having no measurable impact on the guest’s performance.

KW - Allocators

KW - Ballooning

KW - Overcommitment

KW - Virtual Machines

UR - http://www.scopus.com/inward/record.url?scp=105002248316&partnerID=8YFLogxK

U2 - 10.1145/3689031.3717484

DO - 10.1145/3689031.3717484

M3 - Conference contribution

AN - SCOPUS:105002248316

SP - 702

EP - 719

BT - EuroSys 2025 - Proceedings of the 2025 20th European Conference on Computer Systems

Y2 - 30 March 2025 through 3 April 2025

ER -