Details
| Original language | English |
|---|---|
| Title of host publication | IEEE 5th International Symposium on the Internet of Sounds |
| Subtitle of host publication | IS2 2024 |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Number of pages | 9 |
| ISBN (electronic) | 9798350366525 |
| ISBN (print) | 979-8-3503-6653-2 |
| Publication status | Published - 30 Sept 2024 |
| Event | 5th IEEE International Symposium on the Internet of Sounds, IS2 2024 - Erlangen, Germany Duration: 30 Sept 2024 → 2 Oct 2024 |
Abstract
The potential of integrating extended reality (XR) and spatial audio into immersive networked music performance (INMP) systems has not yet been the subject of extensive research. The advantages of a visual representation based on the transmission of position-dependent metadata seem to be evident, not just in terms of lower transmission latency. It enables the transformation of a virtual environment with spatial audio into an extended reality environment (XRE), simulating the experience of making music together in the same room. A rhythm-based experiment was conducted with 18 pairs of participants, using several XREs of the Immersive Room ExtensioN Environment (IRENE) system, an immersive real-Time system combining virtual reality with telepresence and providing spatial audio for an enhanced immersive experience. The experiment evaluated the influence of the XR system on participants' perceived quality of experience (QoE) and musical outcome. Results show a clear trend that the XREs of the IRENE system enhance participants' perceived coherence and immersion, as well as the overall perceived QoE, while having a minimal impact on the musical outcome. This study provides valuable insights into the benefits and challenges of using XR in NMP, contributing to a deeper understanding of how immersive technologies can improve networked music collaboration.
Keywords
- Extended Reality, Immersive Networked Music Performance, Quality of Experience, Spatial Audio, Virtual Reality
ASJC Scopus subject areas
- Arts and Humanities(all)
- Music
- Computer Science(all)
- Artificial Intelligence
- Computer Science(all)
- Computer Networks and Communications
- Computer Science(all)
- Hardware and Architecture
- Computer Science(all)
- Signal Processing
- Engineering(all)
- Media Technology
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
IEEE 5th International Symposium on the Internet of Sounds: IS2 2024. Institute of Electrical and Electronics Engineers Inc., 2024.
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - Immersive Networked Music Performance
T2 - 5th IEEE International Symposium on the Internet of Sounds, IS2 2024
AU - Hupke, Robert
AU - Preihs, Stephan
AU - Peissig, Jurgen
N1 - Publisher Copyright: © 2024 IEEE.
PY - 2024/9/30
Y1 - 2024/9/30
N2 - The potential of integrating extended reality (XR) and spatial audio into immersive networked music performance (INMP) systems has not yet been the subject of extensive research. The advantages of a visual representation based on the transmission of position-dependent metadata seem to be evident, not just in terms of lower transmission latency. It enables the transformation of a virtual environment with spatial audio into an extended reality environment (XRE), simulating the experience of making music together in the same room. A rhythm-based experiment was conducted with 18 pairs of participants, using several XREs of the Immersive Room ExtensioN Environment (IRENE) system, an immersive real-Time system combining virtual reality with telepresence and providing spatial audio for an enhanced immersive experience. The experiment evaluated the influence of the XR system on participants' perceived quality of experience (QoE) and musical outcome. Results show a clear trend that the XREs of the IRENE system enhance participants' perceived coherence and immersion, as well as the overall perceived QoE, while having a minimal impact on the musical outcome. This study provides valuable insights into the benefits and challenges of using XR in NMP, contributing to a deeper understanding of how immersive technologies can improve networked music collaboration.
AB - The potential of integrating extended reality (XR) and spatial audio into immersive networked music performance (INMP) systems has not yet been the subject of extensive research. The advantages of a visual representation based on the transmission of position-dependent metadata seem to be evident, not just in terms of lower transmission latency. It enables the transformation of a virtual environment with spatial audio into an extended reality environment (XRE), simulating the experience of making music together in the same room. A rhythm-based experiment was conducted with 18 pairs of participants, using several XREs of the Immersive Room ExtensioN Environment (IRENE) system, an immersive real-Time system combining virtual reality with telepresence and providing spatial audio for an enhanced immersive experience. The experiment evaluated the influence of the XR system on participants' perceived quality of experience (QoE) and musical outcome. Results show a clear trend that the XREs of the IRENE system enhance participants' perceived coherence and immersion, as well as the overall perceived QoE, while having a minimal impact on the musical outcome. This study provides valuable insights into the benefits and challenges of using XR in NMP, contributing to a deeper understanding of how immersive technologies can improve networked music collaboration.
KW - Extended Reality
KW - Immersive Networked Music Performance
KW - Quality of Experience
KW - Spatial Audio
KW - Virtual Reality
UR - http://www.scopus.com/inward/record.url?scp=85207834649&partnerID=8YFLogxK
U2 - 10.1109/IS262782.2024.10704092
DO - 10.1109/IS262782.2024.10704092
M3 - Conference contribution
AN - SCOPUS:85207834649
SN - 979-8-3503-6653-2
BT - IEEE 5th International Symposium on the Internet of Sounds
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 30 September 2024 through 2 October 2024
ER -