Vision-based haptic feedback for capsule endoscopy navigation: a proof of concept

Marco Mura, Yasmeen Abu-Kheil, Gastone Ciuti, Marco Visentini-Scarzanella, Arianna Menciassi, Paolo Dario, Jorge Dias, Lakmal Seneviratne

Research output: Contribution to journalArticlepeer-review

19 Scopus citations


In this paper, a vision-based haptic feedback system has been proposed with the aim to assist the movement of an endoscopic device during capsule endoscopy (CE) procedures. We present a general system architecture consisting of three modules responsible for vision, haptic guidance and control of movements. The vision module generates 3D local maps as well as local navigation trajectory for endoluminal navigation. The haptic guidance module consists of a haptic device that allows the user to control the movement of the capsule along the generated path. The haptics module also helps the operator by transforming the 3D maps and the relative paths into a guiding virtual force. Measuring the current relative distance between the user input and the maps boundaries, the haptic guidance module will check if the user is moving away or toward the colonic walls and will generate a feedback force with the aim to assist the operator during the navigation procedure. The user will also sense an attractive virtual feedback force toward the generated path that will help the user in the navigation. Finally, the movement control module is the interface between the haptics module and the chosen manipulator. The final goal is to develop a complete active CE robotic platform with haptic feedback in order to enhance safety, to reduce cost (using the same system as a training simulator as well as real endoscopic platform) and to help the operator during the navigation by combining all 3D local maps into a full 3D reconstructed colon.

Original languageBritish English
Pages (from-to)35-45
Number of pages11
JournalJournal of Micro-Bio Robotics
Issue number1-4
StatePublished - 1 Jun 2016


  • 3D reconstruction
  • Colonoscopy
  • Haptic guidance
  • Robotic endoscopic capsule
  • Vision-based haptic feedback


Dive into the research topics of 'Vision-based haptic feedback for capsule endoscopy navigation: a proof of concept'. Together they form a unique fingerprint.

Cite this