Collaborative Optimization of the Age of Information Under Partial Observability

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Anam Tahir
  • Kai Cui
  • Bastian Alt
  • Amr Rizk
  • Heinz Koeppl
View graph of relations

Details

Original languageEnglish
Title of host publication2024 IFIP Networking Conference, IFIP Networking 2024
Pages555-561
Number of pages7
ISBN (electronic)9783903176638
Publication statusPublished - 3 Jun 2024

Abstract

The significance of the freshness of sensor and control data at the receiver side, often referred to as Age of Information(AoI), is fundamentally constrained by contention for limited network resources. Evidently, network congestion is detrimental for AoI, where this congestion is partly self-induced by the sensor transmission process in addition to the contention from other transmitting sensors. In this work, we devise a decentralized AoI-minimizing transmission policy for a number of sensor agents sharing capacity-limited, non-FIFO duplex channels that introduce random delays in communication with a common receiver. By implementing the same policy, however with no explicit inter-agent communication, the agents minimize the expected AoI in this partially observable system. We cater to the partial observability due to random channel delays by designing a bootstrap particle filter that independently maintains a belief over the AoI of each agent. We also leverage mean-field control approximations and reinforcement learning to derive scalable and approximately optimal solutions for minimizing the expected AoI collaboratively.

Keywords

    age-of-information, mean-field control, network resources, partial observability, reinforcement learning

ASJC Scopus subject areas

Cite this

Collaborative Optimization of the Age of Information Under Partial Observability. / Tahir, Anam; Cui, Kai; Alt, Bastian et al.
2024 IFIP Networking Conference, IFIP Networking 2024. 2024. p. 555-561.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Tahir, A, Cui, K, Alt, B, Rizk, A & Koeppl, H 2024, Collaborative Optimization of the Age of Information Under Partial Observability. in 2024 IFIP Networking Conference, IFIP Networking 2024. pp. 555-561. https://doi.org/10.48550/arXiv.2312.12977, https://doi.org/10.23919/ifipnetworking62109.2024.10619823
Tahir, A., Cui, K., Alt, B., Rizk, A., & Koeppl, H. (2024). Collaborative Optimization of the Age of Information Under Partial Observability. In 2024 IFIP Networking Conference, IFIP Networking 2024 (pp. 555-561) https://doi.org/10.48550/arXiv.2312.12977, https://doi.org/10.23919/ifipnetworking62109.2024.10619823
Tahir A, Cui K, Alt B, Rizk A, Koeppl H. Collaborative Optimization of the Age of Information Under Partial Observability. In 2024 IFIP Networking Conference, IFIP Networking 2024. 2024. p. 555-561 doi: 10.48550/arXiv.2312.12977, 10.23919/ifipnetworking62109.2024.10619823
Tahir, Anam ; Cui, Kai ; Alt, Bastian et al. / Collaborative Optimization of the Age of Information Under Partial Observability. 2024 IFIP Networking Conference, IFIP Networking 2024. 2024. pp. 555-561
Download
@inproceedings{5198d85e3991491fa2c8383a280a12ed,
title = "Collaborative Optimization of the Age of Information Under Partial Observability",
abstract = "The significance of the freshness of sensor and control data at the receiver side, often referred to as Age of Information(AoI), is fundamentally constrained by contention for limited network resources. Evidently, network congestion is detrimental for AoI, where this congestion is partly self-induced by the sensor transmission process in addition to the contention from other transmitting sensors. In this work, we devise a decentralized AoI-minimizing transmission policy for a number of sensor agents sharing capacity-limited, non-FIFO duplex channels that introduce random delays in communication with a common receiver. By implementing the same policy, however with no explicit inter-agent communication, the agents minimize the expected AoI in this partially observable system. We cater to the partial observability due to random channel delays by designing a bootstrap particle filter that independently maintains a belief over the AoI of each agent. We also leverage mean-field control approximations and reinforcement learning to derive scalable and approximately optimal solutions for minimizing the expected AoI collaboratively.",
keywords = "age-of-information, mean-field control, network resources, partial observability, reinforcement learning",
author = "Anam Tahir and Kai Cui and Bastian Alt and Amr Rizk and Heinz Koeppl",
note = "Publisher Copyright: {\textcopyright} 2024 IFIP.",
year = "2024",
month = jun,
day = "3",
doi = "10.48550/arXiv.2312.12977",
language = "English",
isbn = "979-8-3503-9060-5",
pages = "555--561",
booktitle = "2024 IFIP Networking Conference, IFIP Networking 2024",

}

Download

TY - GEN

T1 - Collaborative Optimization of the Age of Information Under Partial Observability

AU - Tahir, Anam

AU - Cui, Kai

AU - Alt, Bastian

AU - Rizk, Amr

AU - Koeppl, Heinz

N1 - Publisher Copyright: © 2024 IFIP.

PY - 2024/6/3

Y1 - 2024/6/3

N2 - The significance of the freshness of sensor and control data at the receiver side, often referred to as Age of Information(AoI), is fundamentally constrained by contention for limited network resources. Evidently, network congestion is detrimental for AoI, where this congestion is partly self-induced by the sensor transmission process in addition to the contention from other transmitting sensors. In this work, we devise a decentralized AoI-minimizing transmission policy for a number of sensor agents sharing capacity-limited, non-FIFO duplex channels that introduce random delays in communication with a common receiver. By implementing the same policy, however with no explicit inter-agent communication, the agents minimize the expected AoI in this partially observable system. We cater to the partial observability due to random channel delays by designing a bootstrap particle filter that independently maintains a belief over the AoI of each agent. We also leverage mean-field control approximations and reinforcement learning to derive scalable and approximately optimal solutions for minimizing the expected AoI collaboratively.

AB - The significance of the freshness of sensor and control data at the receiver side, often referred to as Age of Information(AoI), is fundamentally constrained by contention for limited network resources. Evidently, network congestion is detrimental for AoI, where this congestion is partly self-induced by the sensor transmission process in addition to the contention from other transmitting sensors. In this work, we devise a decentralized AoI-minimizing transmission policy for a number of sensor agents sharing capacity-limited, non-FIFO duplex channels that introduce random delays in communication with a common receiver. By implementing the same policy, however with no explicit inter-agent communication, the agents minimize the expected AoI in this partially observable system. We cater to the partial observability due to random channel delays by designing a bootstrap particle filter that independently maintains a belief over the AoI of each agent. We also leverage mean-field control approximations and reinforcement learning to derive scalable and approximately optimal solutions for minimizing the expected AoI collaboratively.

KW - age-of-information

KW - mean-field control

KW - network resources

KW - partial observability

KW - reinforcement learning

UR - http://www.scopus.com/inward/record.url?scp=85202429618&partnerID=8YFLogxK

U2 - 10.48550/arXiv.2312.12977

DO - 10.48550/arXiv.2312.12977

M3 - Conference contribution

SN - 979-8-3503-9060-5

SP - 555

EP - 561

BT - 2024 IFIP Networking Conference, IFIP Networking 2024

ER -