Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • T. Ortmaier
  • M. A. Vitrani
  • G. Morel
  • S. Pinault

External Research Organisations

  • German Aerospace Center (DLR) (e.V.) Location Oberpfaffenhofen
  • Universite Paris 6
View graph of relations

Details

Original languageEnglish
Title of host publicationProceedings of the 2005 IEEE International Conference on Robotics and Automation
Pages2167-2172
Number of pages6
Publication statusPublished - 2005
Externally publishedYes
Event2005 IEEE International Conference on Robotics and Automation - Barcelona, Spain
Duration: 18 Apr 200522 Apr 2005

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
Volume2005
ISSN (Print)1050-4729

Abstract

Minimally invasive surgery in combination with ultrasound (US) imaging imposes high demands on the surgeon's hand-eye-coordination capabilities. A possible solution to reduce these requirements is minimally invasive robotic surgery in which the instrument is guided by visual servoing towards the goal defined by the surgeon in the US image. This approach requires robust tracking of the instrument in the US image sequences which is known to be difficult due to poor image quality. This paper presents computer vision algorithms and results of visual servoing experiments. Adaptive thresholding according to Otsu's method allows to cope with large intensity variations of the instrument echo. Subsequently applied morphological operations suppress noise and echo artefacts. A fast labelling algorithm based on run length coding allows for realtime labelling of the regions. A heuristic exploiting region size and region velocity helps to overcome ambiguities. The overall computation time is less than 10 ms per frame on a standard PC. The tracking algorithm requires no information about texture and shape which are known to be very unreliable in US image sequences. Experimental results for different instrument materials (polyvinyl chloride, polyurethane, nylon, and plexiglas) are given, illustrating the performance of the proposed approach: when chosing the appropriate material the reconstructed trajectories are smooth and only few outliers occur. As a consequence, the visual servoing loop showed to be robust and stable.

Keywords

    Minimally invasive surgery, Ultrasound tracking, Visual servoing

ASJC Scopus subject areas

Cite this

Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing. / Ortmaier, T.; Vitrani, M. A.; Morel, G. et al.
Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 2005. p. 2167-2172 1570434 (Proceedings - IEEE International Conference on Robotics and Automation; Vol. 2005).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Ortmaier, T, Vitrani, MA, Morel, G & Pinault, S 2005, Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing. in Proceedings of the 2005 IEEE International Conference on Robotics and Automation., 1570434, Proceedings - IEEE International Conference on Robotics and Automation, vol. 2005, pp. 2167-2172, 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, 18 Apr 2005. https://doi.org/10.1109/ROBOT.2005.1570434
Ortmaier, T., Vitrani, M. A., Morel, G., & Pinault, S. (2005). Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation (pp. 2167-2172). Article 1570434 (Proceedings - IEEE International Conference on Robotics and Automation; Vol. 2005). https://doi.org/10.1109/ROBOT.2005.1570434
Ortmaier T, Vitrani MA, Morel G, Pinault S. Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 2005. p. 2167-2172. 1570434. (Proceedings - IEEE International Conference on Robotics and Automation). doi: 10.1109/ROBOT.2005.1570434
Ortmaier, T. ; Vitrani, M. A. ; Morel, G. et al. / Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing. Proceedings of the 2005 IEEE International Conference on Robotics and Automation. 2005. pp. 2167-2172 (Proceedings - IEEE International Conference on Robotics and Automation).
Download
@inproceedings{06c6f5ac0b254906b7b64f30a3b78015,
title = "Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing",
abstract = "Minimally invasive surgery in combination with ultrasound (US) imaging imposes high demands on the surgeon's hand-eye-coordination capabilities. A possible solution to reduce these requirements is minimally invasive robotic surgery in which the instrument is guided by visual servoing towards the goal defined by the surgeon in the US image. This approach requires robust tracking of the instrument in the US image sequences which is known to be difficult due to poor image quality. This paper presents computer vision algorithms and results of visual servoing experiments. Adaptive thresholding according to Otsu's method allows to cope with large intensity variations of the instrument echo. Subsequently applied morphological operations suppress noise and echo artefacts. A fast labelling algorithm based on run length coding allows for realtime labelling of the regions. A heuristic exploiting region size and region velocity helps to overcome ambiguities. The overall computation time is less than 10 ms per frame on a standard PC. The tracking algorithm requires no information about texture and shape which are known to be very unreliable in US image sequences. Experimental results for different instrument materials (polyvinyl chloride, polyurethane, nylon, and plexiglas) are given, illustrating the performance of the proposed approach: when chosing the appropriate material the reconstructed trajectories are smooth and only few outliers occur. As a consequence, the visual servoing loop showed to be robust and stable.",
keywords = "Minimally invasive surgery, Ultrasound tracking, Visual servoing",
author = "T. Ortmaier and Vitrani, {M. A.} and G. Morel and S. Pinault",
year = "2005",
doi = "10.1109/ROBOT.2005.1570434",
language = "English",
isbn = "078038914X",
series = "Proceedings - IEEE International Conference on Robotics and Automation",
pages = "2167--2172",
booktitle = "Proceedings of the 2005 IEEE International Conference on Robotics and Automation",
note = "2005 IEEE International Conference on Robotics and Automation ; Conference date: 18-04-2005 Through 22-04-2005",

}

Download

TY - GEN

T1 - Robust Real-Time Instrument Tracking in Ultrasound Images for Visual Servoing

AU - Ortmaier, T.

AU - Vitrani, M. A.

AU - Morel, G.

AU - Pinault, S.

PY - 2005

Y1 - 2005

N2 - Minimally invasive surgery in combination with ultrasound (US) imaging imposes high demands on the surgeon's hand-eye-coordination capabilities. A possible solution to reduce these requirements is minimally invasive robotic surgery in which the instrument is guided by visual servoing towards the goal defined by the surgeon in the US image. This approach requires robust tracking of the instrument in the US image sequences which is known to be difficult due to poor image quality. This paper presents computer vision algorithms and results of visual servoing experiments. Adaptive thresholding according to Otsu's method allows to cope with large intensity variations of the instrument echo. Subsequently applied morphological operations suppress noise and echo artefacts. A fast labelling algorithm based on run length coding allows for realtime labelling of the regions. A heuristic exploiting region size and region velocity helps to overcome ambiguities. The overall computation time is less than 10 ms per frame on a standard PC. The tracking algorithm requires no information about texture and shape which are known to be very unreliable in US image sequences. Experimental results for different instrument materials (polyvinyl chloride, polyurethane, nylon, and plexiglas) are given, illustrating the performance of the proposed approach: when chosing the appropriate material the reconstructed trajectories are smooth and only few outliers occur. As a consequence, the visual servoing loop showed to be robust and stable.

AB - Minimally invasive surgery in combination with ultrasound (US) imaging imposes high demands on the surgeon's hand-eye-coordination capabilities. A possible solution to reduce these requirements is minimally invasive robotic surgery in which the instrument is guided by visual servoing towards the goal defined by the surgeon in the US image. This approach requires robust tracking of the instrument in the US image sequences which is known to be difficult due to poor image quality. This paper presents computer vision algorithms and results of visual servoing experiments. Adaptive thresholding according to Otsu's method allows to cope with large intensity variations of the instrument echo. Subsequently applied morphological operations suppress noise and echo artefacts. A fast labelling algorithm based on run length coding allows for realtime labelling of the regions. A heuristic exploiting region size and region velocity helps to overcome ambiguities. The overall computation time is less than 10 ms per frame on a standard PC. The tracking algorithm requires no information about texture and shape which are known to be very unreliable in US image sequences. Experimental results for different instrument materials (polyvinyl chloride, polyurethane, nylon, and plexiglas) are given, illustrating the performance of the proposed approach: when chosing the appropriate material the reconstructed trajectories are smooth and only few outliers occur. As a consequence, the visual servoing loop showed to be robust and stable.

KW - Minimally invasive surgery

KW - Ultrasound tracking

KW - Visual servoing

UR - http://www.scopus.com/inward/record.url?scp=33750277596&partnerID=8YFLogxK

U2 - 10.1109/ROBOT.2005.1570434

DO - 10.1109/ROBOT.2005.1570434

M3 - Conference contribution

AN - SCOPUS:33750277596

SN - 078038914X

SN - 9780780389144

T3 - Proceedings - IEEE International Conference on Robotics and Automation

SP - 2167

EP - 2172

BT - Proceedings of the 2005 IEEE International Conference on Robotics and Automation

T2 - 2005 IEEE International Conference on Robotics and Automation

Y2 - 18 April 2005 through 22 April 2005

ER -