TIB AV-Analytics: A Web-based Platform for Scholarly Video Analysis and Film Studies

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

  • Matthias Springstein
  • Markos Stamatakis
  • Margret Plank
  • Julian Sittel
  • Roman Mauer
  • Oksana Bulgakowa
  • Ralph Ewerth
  • Eric Müller-Budack

Organisationseinheiten

Externe Organisationen

  • Technische Informationsbibliothek (TIB) Leibniz-Informationszentrum Technik und Naturwissenschaften und Universitätsbibliothek
  • Johannes Gutenberg-Universität Mainz
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksSIGIR`23
UntertitelProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
Seiten3195-3199
Seitenumfang5
ISBN (elektronisch)9781450394086
PublikationsstatusVeröffentlicht - 18 Juli 2023
Veranstaltung46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023 - Taipei, Taiwan
Dauer: 23 Juli 202327 Juli 2023

Abstract

Video analysis platforms that integrate automatic solutions for multimedia and information retrieval enable various applications in many disciplines including film and media studies, communication science, and education. However, current platforms for video analysis either focus on manual annotations or include only a few tools for automatic content analysis. In this paper, we present a novel web-based video analysis platform called TIB AV-Analytics (TIB-AV-A). Unlike previous platforms, TIB-AV-A integrates state-of-the-art approaches in the fields of computer vision, audio analysis, and natural language processing for many relevant video analysis tasks. To facilitate future extensions and to ensure interoperability with existing tools, the video analysis approaches are implemented in a plugin structure with appropriate interfaces and import-export functions. TIB-AV-A leverages modern web technologies to provide users with a responsive and interactive web interface that enables manual annotation and provides access to powerful deep learning tools without a requirement for specific hardware dependencies. Source code and demo are publicly available at: https://service.tib.eu/tibava.

ASJC Scopus Sachgebiete

Zitieren

TIB AV-Analytics: A Web-based Platform for Scholarly Video Analysis and Film Studies. / Springstein, Matthias; Stamatakis, Markos; Plank, Margret et al.
SIGIR`23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023. S. 3195-3199.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Springstein, M, Stamatakis, M, Plank, M, Sittel, J, Mauer, R, Bulgakowa, O, Ewerth, R & Müller-Budack, E 2023, TIB AV-Analytics: A Web-based Platform for Scholarly Video Analysis and Film Studies. in SIGIR`23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. S. 3195-3199, 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023, Taipei, Taiwan, 23 Juli 2023. https://doi.org/10.1145/3539618.3591820
Springstein, M., Stamatakis, M., Plank, M., Sittel, J., Mauer, R., Bulgakowa, O., Ewerth, R., & Müller-Budack, E. (2023). TIB AV-Analytics: A Web-based Platform for Scholarly Video Analysis and Film Studies. In SIGIR`23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval (S. 3195-3199) https://doi.org/10.1145/3539618.3591820
Springstein M, Stamatakis M, Plank M, Sittel J, Mauer R, Bulgakowa O et al. TIB AV-Analytics: A Web-based Platform for Scholarly Video Analysis and Film Studies. in SIGIR`23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023. S. 3195-3199 doi: 10.1145/3539618.3591820
Springstein, Matthias ; Stamatakis, Markos ; Plank, Margret et al. / TIB AV-Analytics : A Web-based Platform for Scholarly Video Analysis and Film Studies. SIGIR`23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2023. S. 3195-3199
Download
@inproceedings{a57b7f9e028d41fcb70c5bf6d1849bb1,
title = "TIB AV-Analytics: A Web-based Platform for Scholarly Video Analysis and Film Studies",
abstract = "Video analysis platforms that integrate automatic solutions for multimedia and information retrieval enable various applications in many disciplines including film and media studies, communication science, and education. However, current platforms for video analysis either focus on manual annotations or include only a few tools for automatic content analysis. In this paper, we present a novel web-based video analysis platform called TIB AV-Analytics (TIB-AV-A). Unlike previous platforms, TIB-AV-A integrates state-of-the-art approaches in the fields of computer vision, audio analysis, and natural language processing for many relevant video analysis tasks. To facilitate future extensions and to ensure interoperability with existing tools, the video analysis approaches are implemented in a plugin structure with appropriate interfaces and import-export functions. TIB-AV-A leverages modern web technologies to provide users with a responsive and interactive web interface that enables manual annotation and provides access to powerful deep learning tools without a requirement for specific hardware dependencies. Source code and demo are publicly available at: https://service.tib.eu/tibava.",
keywords = "audio analysis, computer vision, multimedia indexing, multimodal video analysis platform, natural language processing",
author = "Matthias Springstein and Markos Stamatakis and Margret Plank and Julian Sittel and Roman Mauer and Oksana Bulgakowa and Ralph Ewerth and Eric M{\"u}ller-Budack",
note = "Funding Information: This work was funded by the German Research Foundation (DFG) under the project number 442397862. We would like to thank Jim Rhotert and Junaid Ghauri (both TIB – Leibniz Information Centre for Science and Technology) for their help in developing TIB-AV-A.; 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023 ; Conference date: 23-07-2023 Through 27-07-2023",
year = "2023",
month = jul,
day = "18",
doi = "10.1145/3539618.3591820",
language = "English",
pages = "3195--3199",
booktitle = "SIGIR`23",

}

Download

TY - GEN

T1 - TIB AV-Analytics

T2 - 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023

AU - Springstein, Matthias

AU - Stamatakis, Markos

AU - Plank, Margret

AU - Sittel, Julian

AU - Mauer, Roman

AU - Bulgakowa, Oksana

AU - Ewerth, Ralph

AU - Müller-Budack, Eric

N1 - Funding Information: This work was funded by the German Research Foundation (DFG) under the project number 442397862. We would like to thank Jim Rhotert and Junaid Ghauri (both TIB – Leibniz Information Centre for Science and Technology) for their help in developing TIB-AV-A.

PY - 2023/7/18

Y1 - 2023/7/18

N2 - Video analysis platforms that integrate automatic solutions for multimedia and information retrieval enable various applications in many disciplines including film and media studies, communication science, and education. However, current platforms for video analysis either focus on manual annotations or include only a few tools for automatic content analysis. In this paper, we present a novel web-based video analysis platform called TIB AV-Analytics (TIB-AV-A). Unlike previous platforms, TIB-AV-A integrates state-of-the-art approaches in the fields of computer vision, audio analysis, and natural language processing for many relevant video analysis tasks. To facilitate future extensions and to ensure interoperability with existing tools, the video analysis approaches are implemented in a plugin structure with appropriate interfaces and import-export functions. TIB-AV-A leverages modern web technologies to provide users with a responsive and interactive web interface that enables manual annotation and provides access to powerful deep learning tools without a requirement for specific hardware dependencies. Source code and demo are publicly available at: https://service.tib.eu/tibava.

AB - Video analysis platforms that integrate automatic solutions for multimedia and information retrieval enable various applications in many disciplines including film and media studies, communication science, and education. However, current platforms for video analysis either focus on manual annotations or include only a few tools for automatic content analysis. In this paper, we present a novel web-based video analysis platform called TIB AV-Analytics (TIB-AV-A). Unlike previous platforms, TIB-AV-A integrates state-of-the-art approaches in the fields of computer vision, audio analysis, and natural language processing for many relevant video analysis tasks. To facilitate future extensions and to ensure interoperability with existing tools, the video analysis approaches are implemented in a plugin structure with appropriate interfaces and import-export functions. TIB-AV-A leverages modern web technologies to provide users with a responsive and interactive web interface that enables manual annotation and provides access to powerful deep learning tools without a requirement for specific hardware dependencies. Source code and demo are publicly available at: https://service.tib.eu/tibava.

KW - audio analysis

KW - computer vision

KW - multimedia indexing

KW - multimodal video analysis platform

KW - natural language processing

UR - http://www.scopus.com/inward/record.url?scp=85168671954&partnerID=8YFLogxK

U2 - 10.1145/3539618.3591820

DO - 10.1145/3539618.3591820

M3 - Conference contribution

AN - SCOPUS:85168671954

SP - 3195

EP - 3199

BT - SIGIR`23

Y2 - 23 July 2023 through 27 July 2023

ER -