Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control

by   Changyeob Shin, et al.

Tissue manipulation is a frequently used fundamental subtask of any surgical procedures, and in some cases it may require the involvement of a surgeon's assistant. The complex dynamics of soft tissue as an unstructured environment is one of the main challenges in any attempt to automate the manipulation of it via a surgical robotic system. Two AI learning based model predictive control algorithms using vision strategies are proposed and studied: (1) reinforcement learning and (2) learning from demonstration. Comparison of the performance of these AI algorithms in a simulation setting indicated that the learning from demonstration algorithm can boost the learning policy by initializing the predicted dynamics with given demonstrations. Furthermore, the learning from demonstration algorithm is implemented on a Raven IV surgical robotic system and successfully demonstrated feasibility of the proposed algorithm using an experimental approach. This study is part of a profound vision in which the role of a surgeon will be redefined as a pure decision maker whereas the vast majority of the manipulation will be conducted autonomously by a surgical robotic system. A supplementary video can be found at:


page 1

page 4

page 5

page 6


Learning Soft Tissue Dynamics in Image Space for Automated Bimanual Tissue Manipulation with Surgical Robots

In this paper, reinforcement learning and learning from demonstration in...

Vitreoretinal Surgical Robotic System with Autonomous Orbital Manipulation using Vector-Field Inequalities

Vitreoretinal surgery pertains to the treatment of delicate tissues on t...

Autonomous Soft Tissue Retraction Using Demonstration-Guided Reinforcement Learning

In the context of surgery, robots can provide substantial assistance by ...

SmartArm: Suturing Feasibility of a Surgical Robotic System on a Neonatal Chest Model

Commercially available surgical-robot technology currently addresses man...

SuPer: A Surgical Perception Framework for Endoscopic Tissue Manipulation with Surgical Robotics

Traditional control and task automation have been successfully demonstra...

Toward Synergic Learning for Autonomous Manipulation of Deformable Tissues via Surgical Robots: An Approximate Q-Learning Approach

In this paper, we present a synergic learning algorithm to address the t...

Deep Reinforcement Learning Based Semi-Autonomous Control for Robotic Surgery

In recent decades, the tremendous benefits surgical robots have brought ...

Please sign up or login with your details

Forgot password? Click here to reset