Web-based Interactive Free-Viewpoint Streaming: A framework for high quality interactive free viewpoint navigation

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Matthias Ueberheide
  • Felix Klose
  • Tilak Varisetty
  • Markus Fidler
  • Marcus Magnor

External Research Organisations

  • Technische Universität Braunschweig
View graph of relations

Details

Original languageEnglish
Title of host publicationMM 2015 - Proceedings of the 2015 ACM Multimedia Conference
Pages1031-1034
Number of pages4
ISBN (electronic)9781450334594
Publication statusPublished - 13 Oct 2015
Event23rd ACM International Conference on Multimedia, MM 2015 - Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015

Abstract

Recent advances in free-viewpoint rendering techniques as well as the continued improvements of the internet network infrastructure open the door for challenging new applica-tions. In this paper, we present a framework for interac-tive free-viewpoint streaming with open standards and soft-ware. Network bandwidth, encoding strategy as well as codec support for open source browsers are key constraints to be considered for our interactive streaming applications. Our framework is capable of real-Time server-side rendering and interactively streaming the output by means of open source streaming. To enable viewer interaction with the free-viewpoint video rendering back-end in a standard browser, user events are captured with Javascript and transmitted using WebSockets. The rendered video is streamed to the browser using the FFmpeg free software project. This pa-per discusses the applicability of open source streaming and presents timing measurements for video-frame transmission over network.

Keywords

    HTML5, Real-Time streaming, Viewpoint

ASJC Scopus subject areas

Cite this

Web-based Interactive Free-Viewpoint Streaming: A framework for high quality interactive free viewpoint navigation. / Ueberheide, Matthias; Klose, Felix; Varisetty, Tilak et al.
MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. 2015. p. 1031-1034.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Ueberheide, M, Klose, F, Varisetty, T, Fidler, M & Magnor, M 2015, Web-based Interactive Free-Viewpoint Streaming: A framework for high quality interactive free viewpoint navigation. in MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. pp. 1031-1034, 23rd ACM International Conference on Multimedia, MM 2015, Brisbane, Australia, 26 Oct 2015. https://doi.org/10.1145/2733373.2806394
Ueberheide, M., Klose, F., Varisetty, T., Fidler, M., & Magnor, M. (2015). Web-based Interactive Free-Viewpoint Streaming: A framework for high quality interactive free viewpoint navigation. In MM 2015 - Proceedings of the 2015 ACM Multimedia Conference (pp. 1031-1034) https://doi.org/10.1145/2733373.2806394
Ueberheide M, Klose F, Varisetty T, Fidler M, Magnor M. Web-based Interactive Free-Viewpoint Streaming: A framework for high quality interactive free viewpoint navigation. In MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. 2015. p. 1031-1034 doi: 10.1145/2733373.2806394
Ueberheide, Matthias ; Klose, Felix ; Varisetty, Tilak et al. / Web-based Interactive Free-Viewpoint Streaming : A framework for high quality interactive free viewpoint navigation. MM 2015 - Proceedings of the 2015 ACM Multimedia Conference. 2015. pp. 1031-1034
Download
@inproceedings{1eff8ed0d429402f8b2a2d433bc7f604,
title = "Web-based Interactive Free-Viewpoint Streaming: A framework for high quality interactive free viewpoint navigation",
abstract = "Recent advances in free-viewpoint rendering techniques as well as the continued improvements of the internet network infrastructure open the door for challenging new applica-tions. In this paper, we present a framework for interac-tive free-viewpoint streaming with open standards and soft-ware. Network bandwidth, encoding strategy as well as codec support for open source browsers are key constraints to be considered for our interactive streaming applications. Our framework is capable of real-Time server-side rendering and interactively streaming the output by means of open source streaming. To enable viewer interaction with the free-viewpoint video rendering back-end in a standard browser, user events are captured with Javascript and transmitted using WebSockets. The rendered video is streamed to the browser using the FFmpeg free software project. This pa-per discusses the applicability of open source streaming and presents timing measurements for video-frame transmission over network.",
keywords = "HTML5, Real-Time streaming, Viewpoint",
author = "Matthias Ueberheide and Felix Klose and Tilak Varisetty and Markus Fidler and Marcus Magnor",
year = "2015",
month = oct,
day = "13",
doi = "10.1145/2733373.2806394",
language = "English",
pages = "1031--1034",
booktitle = "MM 2015 - Proceedings of the 2015 ACM Multimedia Conference",
note = "23rd ACM International Conference on Multimedia, MM 2015 ; Conference date: 26-10-2015 Through 30-10-2015",

}

Download

TY - GEN

T1 - Web-based Interactive Free-Viewpoint Streaming

T2 - 23rd ACM International Conference on Multimedia, MM 2015

AU - Ueberheide, Matthias

AU - Klose, Felix

AU - Varisetty, Tilak

AU - Fidler, Markus

AU - Magnor, Marcus

PY - 2015/10/13

Y1 - 2015/10/13

N2 - Recent advances in free-viewpoint rendering techniques as well as the continued improvements of the internet network infrastructure open the door for challenging new applica-tions. In this paper, we present a framework for interac-tive free-viewpoint streaming with open standards and soft-ware. Network bandwidth, encoding strategy as well as codec support for open source browsers are key constraints to be considered for our interactive streaming applications. Our framework is capable of real-Time server-side rendering and interactively streaming the output by means of open source streaming. To enable viewer interaction with the free-viewpoint video rendering back-end in a standard browser, user events are captured with Javascript and transmitted using WebSockets. The rendered video is streamed to the browser using the FFmpeg free software project. This pa-per discusses the applicability of open source streaming and presents timing measurements for video-frame transmission over network.

AB - Recent advances in free-viewpoint rendering techniques as well as the continued improvements of the internet network infrastructure open the door for challenging new applica-tions. In this paper, we present a framework for interac-tive free-viewpoint streaming with open standards and soft-ware. Network bandwidth, encoding strategy as well as codec support for open source browsers are key constraints to be considered for our interactive streaming applications. Our framework is capable of real-Time server-side rendering and interactively streaming the output by means of open source streaming. To enable viewer interaction with the free-viewpoint video rendering back-end in a standard browser, user events are captured with Javascript and transmitted using WebSockets. The rendered video is streamed to the browser using the FFmpeg free software project. This pa-per discusses the applicability of open source streaming and presents timing measurements for video-frame transmission over network.

KW - HTML5

KW - Real-Time streaming

KW - Viewpoint

UR - http://www.scopus.com/inward/record.url?scp=84962890391&partnerID=8YFLogxK

U2 - 10.1145/2733373.2806394

DO - 10.1145/2733373.2806394

M3 - Conference contribution

AN - SCOPUS:84962890391

SP - 1031

EP - 1034

BT - MM 2015 - Proceedings of the 2015 ACM Multimedia Conference

Y2 - 26 October 2015 through 30 October 2015

ER -

By the same author(s)