Scanning the surface of soft tissues with a micrometer precision thanks to endomicroscopy based visual servoing

Benoit Rosa, Mustapha Suphi Erden, Tom Vercauteren, Jerome Szewczyk, Guillaume Morel, Mustafa Suphi Erden

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)


Probe-based confocal laser endomicroscopy is a recent tissue imaging technology that requires placing a probe in contact with the tissue to be imaged and provides real time images with a microscopic resolution. Additionally, generating adequate probe movements to sweep the tissue surface can be used to reconstruct a wide mosaic of the scanned region while increasing the resolution which is appropriate for anatomicopathological cancer diagnosis.

However, properly controlling the motion along the scanning trajectory is a major problem. Indeed, the tissue exhibits deformations under friction forces exerted by the probe leading to deformed mosaics. In this paper we propose a visual servoing approach for controlling the probe movements relative to the tissue while rejecting the tissue deformation disturbance. The probe displacement with respect to the tissue is firstly estimated using the confocal images and an image registration real-time algorithm. Secondly, from this real-time image-based position measurement, the probe motion is controlled thanks to a simple proportional-integral compensator and a feedforward term. Ex vivo experiments using a Staubli TX40 robot and a Mauna Kea Technologies Cellvizio imaging device demonstrate the effectiveness of the approach on liver and muscle tissue.

Original languageEnglish
Title of host publication2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Place of PublicationNew York
Number of pages7
Publication statusPublished - 2012
Event25th IEEE\RSJ International Conference on Intelligent Robots and Systems 2012 - Algarve, Portugal
Duration: 7 Oct 201212 Oct 2012

Publication series

NameIEEE International Conference on Intelligent Robots and Systems
ISSN (Print)2153-0858


Conference25th IEEE\RSJ International Conference on Intelligent Robots and Systems 2012
Abbreviated titleIROS 2012


  • Medical robotics
  • medical imaging
  • image registration
  • probe-based confocal laser endomicroscopy
  • soft tissue deformation
  • visual servoing
  • VIVO

Cite this