Just-in-Time Transcoding of 360° Video Streams

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Felix Hechler
  • Michael Rudolph
  • Amr Rizk
View graph of relations

Details

Original languageEnglish
Title of host publicationMMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference
Pages89-99
Number of pages11
ISBN (electronic)9798400704123
Publication statusPublished - 15 Apr 2024

Abstract

Adaptive streaming of 360° tiled video requires encoding tiles to multiple qualities to support client decisions in the light of fluctuating bandwidth and dynamic view-ports. Some static approaches allocate fixed encoding resources independently of the scene complexity introducing a significant resource overhead while other static approaches add a substantial time delay relative to the source. As tiles of 360 ° video have a skewed popularity with a statistical concentration of the user requests static approaches are resource inefficient. Specifically, in live streaming the tile popularity and encoding time statistics are not present beforehand. We present JITENC, a 360° streaming backend for network edge deployment that employs just-in-time encoding in response to incoming tile requests. JITENC leverages encoding time prediction to optimize the scheduling of tile encoding tasks, hence, it can also be used for live streaming given a real-time transcoding time deadline. Our prototype demonstrates that JITENC can achieve a perceived quality that is comparable to oversized static systems that encode all tiles in every quality while significantly reducing the computing resource utilization and power consumption.

Keywords

    HTTP adaptive streaming, Transcoding time prediction, adaptive streaming, transcoding, video complexity, video encoding

ASJC Scopus subject areas

Cite this

Just-in-Time Transcoding of 360° Video Streams. / Hechler, Felix; Rudolph, Michael; Rizk, Amr.
MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference. 2024. p. 89-99.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Hechler, F, Rudolph, M & Rizk, A 2024, Just-in-Time Transcoding of 360° Video Streams. in MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference. pp. 89-99. https://doi.org/10.1145/3625468.3647614
Hechler, F., Rudolph, M., & Rizk, A. (2024). Just-in-Time Transcoding of 360° Video Streams. In MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference (pp. 89-99) https://doi.org/10.1145/3625468.3647614
Hechler F, Rudolph M, Rizk A. Just-in-Time Transcoding of 360° Video Streams. In MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference. 2024. p. 89-99 doi: 10.1145/3625468.3647614
Hechler, Felix ; Rudolph, Michael ; Rizk, Amr. / Just-in-Time Transcoding of 360° Video Streams. MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference. 2024. pp. 89-99
Download
@inproceedings{672d6bc3e19049dca29e1d733dbe42a7,
title = "Just-in-Time Transcoding of 360° Video Streams",
abstract = "Adaptive streaming of 360° tiled video requires encoding tiles to multiple qualities to support client decisions in the light of fluctuating bandwidth and dynamic view-ports. Some static approaches allocate fixed encoding resources independently of the scene complexity introducing a significant resource overhead while other static approaches add a substantial time delay relative to the source. As tiles of 360 ° video have a skewed popularity with a statistical concentration of the user requests static approaches are resource inefficient. Specifically, in live streaming the tile popularity and encoding time statistics are not present beforehand. We present JITENC, a 360° streaming backend for network edge deployment that employs just-in-time encoding in response to incoming tile requests. JITENC leverages encoding time prediction to optimize the scheduling of tile encoding tasks, hence, it can also be used for live streaming given a real-time transcoding time deadline. Our prototype demonstrates that JITENC can achieve a perceived quality that is comparable to oversized static systems that encode all tiles in every quality while significantly reducing the computing resource utilization and power consumption.",
keywords = "HTTP adaptive streaming, Transcoding time prediction, adaptive streaming, transcoding, video complexity, video encoding",
author = "Felix Hechler and Michael Rudolph and Amr Rizk",
note = "Publisher Copyright: {\textcopyright} 2024 ACM.",
year = "2024",
month = apr,
day = "15",
doi = "10.1145/3625468.3647614",
language = "English",
pages = "89--99",
booktitle = "MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference",

}

Download

TY - GEN

T1 - Just-in-Time Transcoding of 360° Video Streams

AU - Hechler, Felix

AU - Rudolph, Michael

AU - Rizk, Amr

N1 - Publisher Copyright: © 2024 ACM.

PY - 2024/4/15

Y1 - 2024/4/15

N2 - Adaptive streaming of 360° tiled video requires encoding tiles to multiple qualities to support client decisions in the light of fluctuating bandwidth and dynamic view-ports. Some static approaches allocate fixed encoding resources independently of the scene complexity introducing a significant resource overhead while other static approaches add a substantial time delay relative to the source. As tiles of 360 ° video have a skewed popularity with a statistical concentration of the user requests static approaches are resource inefficient. Specifically, in live streaming the tile popularity and encoding time statistics are not present beforehand. We present JITENC, a 360° streaming backend for network edge deployment that employs just-in-time encoding in response to incoming tile requests. JITENC leverages encoding time prediction to optimize the scheduling of tile encoding tasks, hence, it can also be used for live streaming given a real-time transcoding time deadline. Our prototype demonstrates that JITENC can achieve a perceived quality that is comparable to oversized static systems that encode all tiles in every quality while significantly reducing the computing resource utilization and power consumption.

AB - Adaptive streaming of 360° tiled video requires encoding tiles to multiple qualities to support client decisions in the light of fluctuating bandwidth and dynamic view-ports. Some static approaches allocate fixed encoding resources independently of the scene complexity introducing a significant resource overhead while other static approaches add a substantial time delay relative to the source. As tiles of 360 ° video have a skewed popularity with a statistical concentration of the user requests static approaches are resource inefficient. Specifically, in live streaming the tile popularity and encoding time statistics are not present beforehand. We present JITENC, a 360° streaming backend for network edge deployment that employs just-in-time encoding in response to incoming tile requests. JITENC leverages encoding time prediction to optimize the scheduling of tile encoding tasks, hence, it can also be used for live streaming given a real-time transcoding time deadline. Our prototype demonstrates that JITENC can achieve a perceived quality that is comparable to oversized static systems that encode all tiles in every quality while significantly reducing the computing resource utilization and power consumption.

KW - HTTP adaptive streaming

KW - Transcoding time prediction

KW - adaptive streaming

KW - transcoding

KW - video complexity

KW - video encoding

UR - http://www.scopus.com/inward/record.url?scp=85191950036&partnerID=8YFLogxK

U2 - 10.1145/3625468.3647614

DO - 10.1145/3625468.3647614

M3 - Conference contribution

SP - 89

EP - 99

BT - MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference

ER -