Conformal Temporal Logic Planning using Large Language Models: Knowing When to Do What and When to Ask for Help

by   Jun Wang, et al.

This paper addresses a new motion planning problem for mobile robots tasked with accomplishing multiple high-level sub-tasks, expressed using natural language (NL), in a temporal and logical order. To formally define such missions, we leverage LTL defined over NL-based atomic predicates modeling the considered NL-based sub-tasks. This is contrast to related planning approaches that define LTL tasks over atomic predicates capturing desired low-level system configurations. Our goal is to design robot plans that satisfy LTL tasks defined over NL-based atomic propositions. A novel technical challenge arising in this setup lies in reasoning about correctness of a robot plan with respect to such LTL-encoded tasks. To address this problem, we propose HERACLEs, a hierarchical conformal natural language planner, that relies on a novel integration of existing tools that include (i) automata theory to determine the NL-specified sub-task the robot should accomplish next to make mission progress; (ii) Large Language Models to design robot plans satisfying these sub-tasks; and (iii) conformal prediction to reason probabilistically about correctness of the designed plans and mission satisfaction and to determine if external assistance is required. We provide extensive comparative experiments on mobile manipulation tasks. The project website is


page 1

page 2

page 8

page 9


Resilient Temporal Logic Planning in the Presence of Robot Failures

Several task and motion planning algorithms have been proposed recently ...

Temporal Logic Task Allocation in Heterogeneous Multi-Robot Systems

In this paper, we consider the problem of optimally allocating tasks, ex...

RoCo: Dialectic Multi-Robot Collaboration with Large Language Models

We propose a novel approach to multi-robot collaboration that harnesses ...

Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents

Can world knowledge learned by large language models (LLMs) be used to a...

AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation

We propose a novel framework for learning high-level cognitive capabilit...

Multi-robot Motion Planning based on Nets-within-Nets Modeling and Simulation

This paper focuses on designing motion plans for a heterogeneous team of...

Levels of Integration between Low-Level Reasoning and Task Planning

We provide a systematic analysis of levels of integration between discre...

Please sign up or login with your details

Forgot password? Click here to reset