Stochastic Motion Planning under Partial Observability for Mobile Robots with Continuous Range Measurements

by   Ke Sun, et al.

In this paper, we address the problem of stochastic motion planning under partial observability, more specifically, how to navigate a mobile robot equipped with continuous range sensors such as LIDAR. In contrast to many existing robotic motion planning methods, we explicitly consider the uncertainty of the robot state by modeling the system as a POMDP. Recent work on general purpose POMDP solvers is typically limited to discrete observation spaces, and does not readily apply to the proposed problem due to the continuous measurements from LIDAR. In this work, we build upon an existing Monte Carlo Tree Search method, POMCP, and propose a new algorithm POMCP++. Our algorithm can handle continuous observation spaces with a novel measurement selection strategy. The POMCP++ algorithm overcomes over-optimism in the value estimation of a rollout policy by removing the implicit perfect state assumption at the rollout phase. We validate POMCP++ in theory by proving it is a Monte Carlo Tree Search algorithm. Through comparisons with other methods that can also be applied to the proposed problem, we show that POMCP++ yields significantly higher success rate and total reward.


page 2

page 10

page 11

page 12

page 13

page 18


A Reachability Tree-Based Algorithm for Robot Task and Motion Planning

This paper presents a novel algorithm for robot task and motion planning...

Stochastic 2-D Motion Planning with a POMDP Framework

Motion planning is challenging when it comes to the case of imperfect st...

An On-Line POMDP Solver for Continuous Observation Spaces

Planning under partial obervability is essential for autonomous robots. ...

A Unifying Variational Framework for Gaussian Process Motion Planning

To control how a robot moves, motion planning algorithms must compute pa...

Multi-Stage Monte Carlo Tree Search for Non-Monotone Object Rearrangement Planning in Narrow Confined Environments

Non-monotone object rearrangement planning in confined spaces such as ca...

Toward Optimal FDM Toolpath Planning with Monte Carlo Tree Search

The most widely used methods for toolpath planning in fused deposition 3...

A Multi-Behavior Planning Framework for Robot Guide

The guiding task of a mobile robot requires not only human-aware navigat...

Please sign up or login with your details

Forgot password? Click here to reset