NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publication2021 IEEE International Conference on Image Processing, ICIP 2021
PublisherIEEE Computer Society
Pages2114-2118
Number of pages5
ISBN (electronic)9781665441155
ISBN (print)978-1-6654-3102-6
Publication statusPublished - 2021
Event2021 IEEE International Conference on Image Processing, ICIP 2021 - Anchorage, United States
Duration: 19 Sept 202122 Sept 2021

Publication series

NameProceedings - International Conference on Image Processing, ICIP
Volume2021-September
ISSN (Print)1522-4880

Abstract

In this paper we introduce an error concealment method for VVC based on deep recurrent neural networks, which employs the PredNet model to estimate missing video frames by using past decoded frames. The network is trained using the BVI-DVC data set to infer even full-HD frames. We integrated our proposed model in the VVC reference software VTM for its evaluation. It performs, in average, 6 dB or up to 5 dB better than the frame copy model in terms of PSNR measurements for a concealed I-frame or P-frame, respectively.

Keywords

    Error concealment, Video coding, Video communication, VVC

ASJC Scopus subject areas

Cite this

NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC. / Benjak, Martin; Samayoa, Yasser; Ostermann, Jörn.
2021 IEEE International Conference on Image Processing, ICIP 2021. IEEE Computer Society, 2021. p. 2114-2118 (Proceedings - International Conference on Image Processing, ICIP; Vol. 2021-September).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Benjak, M, Samayoa, Y & Ostermann, J 2021, NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC. in 2021 IEEE International Conference on Image Processing, ICIP 2021. Proceedings - International Conference on Image Processing, ICIP, vol. 2021-September, IEEE Computer Society, pp. 2114-2118, 2021 IEEE International Conference on Image Processing, ICIP 2021, Anchorage, United States, 19 Sept 2021. https://doi.org/10.1109/ICIP42928.2021.9506399
Benjak, M., Samayoa, Y., & Ostermann, J. (2021). NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC. In 2021 IEEE International Conference on Image Processing, ICIP 2021 (pp. 2114-2118). (Proceedings - International Conference on Image Processing, ICIP; Vol. 2021-September). IEEE Computer Society. https://doi.org/10.1109/ICIP42928.2021.9506399
Benjak M, Samayoa Y, Ostermann J. NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC. In 2021 IEEE International Conference on Image Processing, ICIP 2021. IEEE Computer Society. 2021. p. 2114-2118. (Proceedings - International Conference on Image Processing, ICIP). doi: 10.1109/ICIP42928.2021.9506399
Benjak, Martin ; Samayoa, Yasser ; Ostermann, Jörn. / NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC. 2021 IEEE International Conference on Image Processing, ICIP 2021. IEEE Computer Society, 2021. pp. 2114-2118 (Proceedings - International Conference on Image Processing, ICIP).
Download
@inproceedings{aa0c20cab6c547ccb60ef100ed330b76,
title = "NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC",
abstract = "In this paper we introduce an error concealment method for VVC based on deep recurrent neural networks, which employs the PredNet model to estimate missing video frames by using past decoded frames. The network is trained using the BVI-DVC data set to infer even full-HD frames. We integrated our proposed model in the VVC reference software VTM for its evaluation. It performs, in average, 6 dB or up to 5 dB better than the frame copy model in terms of PSNR measurements for a concealed I-frame or P-frame, respectively.",
keywords = "Error concealment, Video coding, Video communication, VVC",
author = "Martin Benjak and Yasser Samayoa and J{\"o}rn Ostermann",
year = "2021",
doi = "10.1109/ICIP42928.2021.9506399",
language = "English",
isbn = "978-1-6654-3102-6",
series = "Proceedings - International Conference on Image Processing, ICIP",
publisher = "IEEE Computer Society",
pages = "2114--2118",
booktitle = "2021 IEEE International Conference on Image Processing, ICIP 2021",
address = "United States",
note = "2021 IEEE International Conference on Image Processing, ICIP 2021 ; Conference date: 19-09-2021 Through 22-09-2021",

}

Download

TY - GEN

T1 - NEURAL NETWORK-BASED ERROR CONCEALMENT FOR VVC

AU - Benjak, Martin

AU - Samayoa, Yasser

AU - Ostermann, Jörn

PY - 2021

Y1 - 2021

N2 - In this paper we introduce an error concealment method for VVC based on deep recurrent neural networks, which employs the PredNet model to estimate missing video frames by using past decoded frames. The network is trained using the BVI-DVC data set to infer even full-HD frames. We integrated our proposed model in the VVC reference software VTM for its evaluation. It performs, in average, 6 dB or up to 5 dB better than the frame copy model in terms of PSNR measurements for a concealed I-frame or P-frame, respectively.

AB - In this paper we introduce an error concealment method for VVC based on deep recurrent neural networks, which employs the PredNet model to estimate missing video frames by using past decoded frames. The network is trained using the BVI-DVC data set to infer even full-HD frames. We integrated our proposed model in the VVC reference software VTM for its evaluation. It performs, in average, 6 dB or up to 5 dB better than the frame copy model in terms of PSNR measurements for a concealed I-frame or P-frame, respectively.

KW - Error concealment

KW - Video coding

KW - Video communication

KW - VVC

UR - http://www.scopus.com/inward/record.url?scp=85125596598&partnerID=8YFLogxK

U2 - 10.1109/ICIP42928.2021.9506399

DO - 10.1109/ICIP42928.2021.9506399

M3 - Conference contribution

AN - SCOPUS:85125596598

SN - 978-1-6654-3102-6

T3 - Proceedings - International Conference on Image Processing, ICIP

SP - 2114

EP - 2118

BT - 2021 IEEE International Conference on Image Processing, ICIP 2021

PB - IEEE Computer Society

T2 - 2021 IEEE International Conference on Image Processing, ICIP 2021

Y2 - 19 September 2021 through 22 September 2021

ER -

By the same author(s)