Incorporating Prior Knowledge into Reinforcement Learning for Soft Tissue Manipulation with Autonomous Grasping Point Selection

by   Xian He, et al.
Hefei University of Technology
NetEase, Inc

Previous soft tissue manipulation studies assumed that the grasping point was known and the target deformation can be achieved. During the operation, the constraints are supposed to be constant, and there is no obstacles around the soft tissue. To go beyond these assumptions, a deep reinforcement learning framework with prior knowledge is proposed for soft tissue manipulation under unknown constraints, such as the force applied by fascia. The prior knowledge is represented through an intuitive manipulation strategy. As an action of the agent, a regulator factor is used to coordinate the intuitive approach and the deliberate network. A reward function is designed to balance the exploration and exploitation for large deformation. Successful simulation results verify that the proposed framework can manipulate the soft tissue while avoiding obstacles and adding new position constraints. Compared with the soft actor-critic (SAC) algorithm, the proposed framework can accelerate the training procedure and improve the generalization.


page 1

page 5

page 7


Learning Soft Tissue Dynamics in Image Space for Automated Bimanual Tissue Manipulation with Surgical Robots

In this paper, reinforcement learning and learning from demonstration in...

Autonomous Soft Tissue Retraction Using Demonstration-Guided Reinforcement Learning

In the context of surgery, robots can provide substantial assistance by ...

Distributed Soft Actor-Critic with Multivariate Reward Representation and Knowledge Distillation

In this paper, we describe NeurIPS 2019 Learning to Move - Walk Around c...

Dext-Gen: Dexterous Grasping in Sparse Reward Environments with Full Orientation Control

Reinforcement learning is a promising method for robotic grasping as it ...

New approaches in modeling belt-flesh-pelvis interaction using obese GHBMC models

Obesity is associated with higher fatality risk and altered distribution...

Please sign up or login with your details

Forgot password? Click here to reset