Fast label propagation for real-time superpixels for video content

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

External Research Organisations

  • Technicolor Research & Innovation
View graph of relations

Details

Original languageEnglish
Title of host publication2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings
PublisherIEEE Computer Society
Pages902-906
Number of pages5
ISBN (electronic)9781479983391
Publication statusPublished - 9 Dec 2015
EventIEEE International Conference on Image Processing, ICIP 2015 - Quebec City, Canada
Duration: 27 Sept 201530 Sept 2015

Publication series

NameProceedings - International Conference on Image Processing, ICIP
Volume2015-December
ISSN (Print)1522-4880

Abstract

Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.

Keywords

    optical flow, Superpixel, supervoxel

ASJC Scopus subject areas

Cite this

Fast label propagation for real-time superpixels for video content. / Reso, Matthias; Jachalsky, Jorn; Rosenhahn, Bodo et al.
2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings. IEEE Computer Society, 2015. p. 902-906 7350930 (Proceedings - International Conference on Image Processing, ICIP; Vol. 2015-December).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Reso, M, Jachalsky, J, Rosenhahn, B & Ostermann, J 2015, Fast label propagation for real-time superpixels for video content. in 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings., 7350930, Proceedings - International Conference on Image Processing, ICIP, vol. 2015-December, IEEE Computer Society, pp. 902-906, IEEE International Conference on Image Processing, ICIP 2015, Quebec City, Canada, 27 Sept 2015. https://doi.org/10.1109/icip.2015.7350930
Reso, M., Jachalsky, J., Rosenhahn, B., & Ostermann, J. (2015). Fast label propagation for real-time superpixels for video content. In 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings (pp. 902-906). Article 7350930 (Proceedings - International Conference on Image Processing, ICIP; Vol. 2015-December). IEEE Computer Society. https://doi.org/10.1109/icip.2015.7350930
Reso M, Jachalsky J, Rosenhahn B, Ostermann J. Fast label propagation for real-time superpixels for video content. In 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings. IEEE Computer Society. 2015. p. 902-906. 7350930. (Proceedings - International Conference on Image Processing, ICIP). doi: 10.1109/icip.2015.7350930
Reso, Matthias ; Jachalsky, Jorn ; Rosenhahn, Bodo et al. / Fast label propagation for real-time superpixels for video content. 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings. IEEE Computer Society, 2015. pp. 902-906 (Proceedings - International Conference on Image Processing, ICIP).
Download
@inproceedings{a867dada3ea340649267ccccfc9e8642,
title = "Fast label propagation for real-time superpixels for video content",
abstract = "Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.",
keywords = "optical flow, Superpixel, supervoxel",
author = "Matthias Reso and Jorn Jachalsky and Bodo Rosenhahn and J{\"o}rn Ostermann",
year = "2015",
month = dec,
day = "9",
doi = "10.1109/icip.2015.7350930",
language = "English",
series = "Proceedings - International Conference on Image Processing, ICIP",
publisher = "IEEE Computer Society",
pages = "902--906",
booktitle = "2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings",
address = "United States",
note = "IEEE International Conference on Image Processing, ICIP 2015 ; Conference date: 27-09-2015 Through 30-09-2015",

}

Download

TY - GEN

T1 - Fast label propagation for real-time superpixels for video content

AU - Reso, Matthias

AU - Jachalsky, Jorn

AU - Rosenhahn, Bodo

AU - Ostermann, Jörn

PY - 2015/12/9

Y1 - 2015/12/9

N2 - Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.

AB - Many recent superpixel algorithms for video content rely on dense optical flow vectors to propagate segmentation results from one frame to the next. In this paper, we assess the impact of the optical flow quality on the over-segmentation quality. Our evaluation shows that it is indispensable for videos with large object displacement and camera motion. But due to the high computational costs high-quality, dense optical flow is not suitable for real-time applications. Therefore, we propose a fast propagation scheme that is based on sparse feature tracking and mesh-based image warping. In a thorough evaluation, we compare our proposed scheme to the results of other state-of-the-art propagation methods using established benchmarks. The results show that our method speeds up the propagation process by a factor of 100 while producing a comparable segmentation quality.

KW - optical flow

KW - Superpixel

KW - supervoxel

UR - http://www.scopus.com/inward/record.url?scp=84956658538&partnerID=8YFLogxK

U2 - 10.1109/icip.2015.7350930

DO - 10.1109/icip.2015.7350930

M3 - Conference contribution

AN - SCOPUS:84956658538

T3 - Proceedings - International Conference on Image Processing, ICIP

SP - 902

EP - 906

BT - 2015 IEEE International Conference on Image Processing, ICIP 2015 - Proceedings

PB - IEEE Computer Society

T2 - IEEE International Conference on Image Processing, ICIP 2015

Y2 - 27 September 2015 through 30 September 2015

ER -

By the same author(s)