Learning Neuro-Symbolic Skills for Bilevel Planning

06/21/2022
by   Tom Silver, et al.
1

Decision-making is challenging in robotics environments with continuous object-centric states, continuous actions, long horizons, and sparse feedback. Hierarchical approaches, such as task and motion planning (TAMP), address these challenges by decomposing decision-making into two or more levels of abstraction. In a setting where demonstrations and symbolic predicates are given, prior work has shown how to learn symbolic operators and neural samplers for TAMP with manually designed parameterized policies. Our main contribution is a method for learning parameterized polices in combination with operators and samplers. These components are packaged into modular neuro-symbolic skills and sequenced together with search-then-sample TAMP to solve new tasks. In experiments in four robotics domains, we show that our approach – bilevel planning with neuro-symbolic skills – can solve a wide range of tasks with varying initial states, goals, and objects, outperforming six baselines and ablations. Video: https://youtu.be/PbFZP8rPuGg Code: https://tinyurl.com/skill-learning

READ FULL TEXT
research
08/16/2022

Learning Operators with Ignore Effects for Bilevel Planning in Continuous Domains

Bilevel planning, in which a high-level search over an abstraction of an...
research
07/11/2022

Learning Temporally Extended Skills in Continuous Domains as Symbolic Actions for Planning

Problems which require both long-horizon planning and continuous control...
research
03/08/2023

Embodied Active Learning of Relational State Abstractions for Bilevel Planning

State abstraction is an effective technique for planning in robotics env...
research
06/02/2023

Egocentric Planning for Scalable Embodied Task Achievement

Embodied agents face significant challenges when tasked with performing ...
research
02/28/2021

Learning Symbolic Operators for Task and Motion Planning

Robotic planning problems in hybrid state and action spaces can be solve...
research
12/24/2020

SPOTTER: Extending Symbolic Planning Operators through Targeted Reinforcement Learning

Symbolic planning models allow decision-making agents to sequence action...
research
03/17/2022

Inventing Relational State and Action Abstractions for Effective and Efficient Bilevel Planning

Effective and efficient planning in continuous state and action spaces i...

Please sign up or login with your details

Forgot password? Click here to reset