Loading [MathJax]/extensions/tex2jax.js

Immersive Networked Music Performance: Impact of Extended Reality on the Quality of Experience

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

  • Robert Hupke
  • Stephan Preihs
  • Jurgen Peissig

Organisationseinheiten

Details

OriginalspracheEnglisch
Titel des SammelwerksIEEE 5th International Symposium on the Internet of Sounds
Untertitel IS2 2024
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seitenumfang9
ISBN (elektronisch)9798350366525
ISBN (Print)979-8-3503-6653-2
PublikationsstatusVeröffentlicht - 30 Sept. 2024
Veranstaltung5th IEEE International Symposium on the Internet of Sounds, IS2 2024 - Erlangen, Deutschland
Dauer: 30 Sept. 20242 Okt. 2024

Abstract

The potential of integrating extended reality (XR) and spatial audio into immersive networked music performance (INMP) systems has not yet been the subject of extensive research. The advantages of a visual representation based on the transmission of position-dependent metadata seem to be evident, not just in terms of lower transmission latency. It enables the transformation of a virtual environment with spatial audio into an extended reality environment (XRE), simulating the experience of making music together in the same room. A rhythm-based experiment was conducted with 18 pairs of participants, using several XREs of the Immersive Room ExtensioN Environment (IRENE) system, an immersive real-Time system combining virtual reality with telepresence and providing spatial audio for an enhanced immersive experience. The experiment evaluated the influence of the XR system on participants' perceived quality of experience (QoE) and musical outcome. Results show a clear trend that the XREs of the IRENE system enhance participants' perceived coherence and immersion, as well as the overall perceived QoE, while having a minimal impact on the musical outcome. This study provides valuable insights into the benefits and challenges of using XR in NMP, contributing to a deeper understanding of how immersive technologies can improve networked music collaboration.

ASJC Scopus Sachgebiete

Zitieren

Immersive Networked Music Performance: Impact of Extended Reality on the Quality of Experience. / Hupke, Robert; Preihs, Stephan; Peissig, Jurgen.
IEEE 5th International Symposium on the Internet of Sounds: IS2 2024. Institute of Electrical and Electronics Engineers Inc., 2024.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Hupke, R, Preihs, S & Peissig, J 2024, Immersive Networked Music Performance: Impact of Extended Reality on the Quality of Experience. in IEEE 5th International Symposium on the Internet of Sounds: IS2 2024. Institute of Electrical and Electronics Engineers Inc., 5th IEEE International Symposium on the Internet of Sounds, IS2 2024, Erlangen, Deutschland, 30 Sept. 2024. https://doi.org/10.1109/IS262782.2024.10704092
Hupke, R., Preihs, S., & Peissig, J. (2024). Immersive Networked Music Performance: Impact of Extended Reality on the Quality of Experience. In IEEE 5th International Symposium on the Internet of Sounds: IS2 2024 Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IS262782.2024.10704092
Hupke R, Preihs S, Peissig J. Immersive Networked Music Performance: Impact of Extended Reality on the Quality of Experience. in IEEE 5th International Symposium on the Internet of Sounds: IS2 2024. Institute of Electrical and Electronics Engineers Inc. 2024 doi: 10.1109/IS262782.2024.10704092
Hupke, Robert ; Preihs, Stephan ; Peissig, Jurgen. / Immersive Networked Music Performance : Impact of Extended Reality on the Quality of Experience. IEEE 5th International Symposium on the Internet of Sounds: IS2 2024. Institute of Electrical and Electronics Engineers Inc., 2024.
Download
@inproceedings{6aa695fecbb04b6798fb2b21e2fa6a67,
title = "Immersive Networked Music Performance: Impact of Extended Reality on the Quality of Experience",
abstract = "The potential of integrating extended reality (XR) and spatial audio into immersive networked music performance (INMP) systems has not yet been the subject of extensive research. The advantages of a visual representation based on the transmission of position-dependent metadata seem to be evident, not just in terms of lower transmission latency. It enables the transformation of a virtual environment with spatial audio into an extended reality environment (XRE), simulating the experience of making music together in the same room. A rhythm-based experiment was conducted with 18 pairs of participants, using several XREs of the Immersive Room ExtensioN Environment (IRENE) system, an immersive real-Time system combining virtual reality with telepresence and providing spatial audio for an enhanced immersive experience. The experiment evaluated the influence of the XR system on participants' perceived quality of experience (QoE) and musical outcome. Results show a clear trend that the XREs of the IRENE system enhance participants' perceived coherence and immersion, as well as the overall perceived QoE, while having a minimal impact on the musical outcome. This study provides valuable insights into the benefits and challenges of using XR in NMP, contributing to a deeper understanding of how immersive technologies can improve networked music collaboration.",
keywords = "Extended Reality, Immersive Networked Music Performance, Quality of Experience, Spatial Audio, Virtual Reality",
author = "Robert Hupke and Stephan Preihs and Jurgen Peissig",
note = "Publisher Copyright: {\textcopyright} 2024 IEEE.; 5th IEEE International Symposium on the Internet of Sounds, IS2 2024 ; Conference date: 30-09-2024 Through 02-10-2024",
year = "2024",
month = sep,
day = "30",
doi = "10.1109/IS262782.2024.10704092",
language = "English",
isbn = "979-8-3503-6653-2",
booktitle = "IEEE 5th International Symposium on the Internet of Sounds",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Download

TY - GEN

T1 - Immersive Networked Music Performance

T2 - 5th IEEE International Symposium on the Internet of Sounds, IS2 2024

AU - Hupke, Robert

AU - Preihs, Stephan

AU - Peissig, Jurgen

N1 - Publisher Copyright: © 2024 IEEE.

PY - 2024/9/30

Y1 - 2024/9/30

N2 - The potential of integrating extended reality (XR) and spatial audio into immersive networked music performance (INMP) systems has not yet been the subject of extensive research. The advantages of a visual representation based on the transmission of position-dependent metadata seem to be evident, not just in terms of lower transmission latency. It enables the transformation of a virtual environment with spatial audio into an extended reality environment (XRE), simulating the experience of making music together in the same room. A rhythm-based experiment was conducted with 18 pairs of participants, using several XREs of the Immersive Room ExtensioN Environment (IRENE) system, an immersive real-Time system combining virtual reality with telepresence and providing spatial audio for an enhanced immersive experience. The experiment evaluated the influence of the XR system on participants' perceived quality of experience (QoE) and musical outcome. Results show a clear trend that the XREs of the IRENE system enhance participants' perceived coherence and immersion, as well as the overall perceived QoE, while having a minimal impact on the musical outcome. This study provides valuable insights into the benefits and challenges of using XR in NMP, contributing to a deeper understanding of how immersive technologies can improve networked music collaboration.

AB - The potential of integrating extended reality (XR) and spatial audio into immersive networked music performance (INMP) systems has not yet been the subject of extensive research. The advantages of a visual representation based on the transmission of position-dependent metadata seem to be evident, not just in terms of lower transmission latency. It enables the transformation of a virtual environment with spatial audio into an extended reality environment (XRE), simulating the experience of making music together in the same room. A rhythm-based experiment was conducted with 18 pairs of participants, using several XREs of the Immersive Room ExtensioN Environment (IRENE) system, an immersive real-Time system combining virtual reality with telepresence and providing spatial audio for an enhanced immersive experience. The experiment evaluated the influence of the XR system on participants' perceived quality of experience (QoE) and musical outcome. Results show a clear trend that the XREs of the IRENE system enhance participants' perceived coherence and immersion, as well as the overall perceived QoE, while having a minimal impact on the musical outcome. This study provides valuable insights into the benefits and challenges of using XR in NMP, contributing to a deeper understanding of how immersive technologies can improve networked music collaboration.

KW - Extended Reality

KW - Immersive Networked Music Performance

KW - Quality of Experience

KW - Spatial Audio

KW - Virtual Reality

UR - http://www.scopus.com/inward/record.url?scp=85207834649&partnerID=8YFLogxK

U2 - 10.1109/IS262782.2024.10704092

DO - 10.1109/IS262782.2024.10704092

M3 - Conference contribution

AN - SCOPUS:85207834649

SN - 979-8-3503-6653-2

BT - IEEE 5th International Symposium on the Internet of Sounds

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 30 September 2024 through 2 October 2024

ER -