AI Chat

On Learning Paradigms for the Travelling Salesman Problem

10/16/2019

∙

by Chaitanya K. Joshi, et al.

∙

∙

We explore the impact of learning paradigms on training deep neural networks for the Travelling Salesman Problem. We design controlled experiments to train supervised learning (SL) and reinforcement learning (RL) models on fixed graph sizes up to 100 nodes, and evaluate them on variable sized graphs up to 500 nodes. Beyond not needing labelled data, out results reveal favorable properties of RL over SL: RL training leads to better emergent generalization to variable graph sizes and is a key component for learning scale-invariant solvers for novel combinatorial problems.

Chaitanya K. Joshi
11 publications
Thomas Laurent
23 publications
Xavier Bresson
30 publications

page 1

page 2

page 3

page 4

∙ 10/07/2021

Generalization in Deep RL for TSP Problems via Equivariance and Local Search

Deep reinforcement learning (RL) has proved to be a competitive heuristi...

0 Wenbin Ouyang, et al. ∙

∙ 03/11/2022

Deep Binary Reinforcement Learning for Scalable Verification

The use of neural networks as function approximators has enabled many ad...

0 Christopher Lazarus, et al. ∙

∙ 10/21/2018

RLgraph: Flexible Computation Graphs for Deep Reinforcement Learning

Reinforcement learning (RL) tasks are challenging to implement, execute ...

0 Michael Schaarschmidt, et al. ∙

∙ 10/11/2020

How to Stop Epidemics: Controlling Graph Dynamics with Reinforcement Learning and Graph Neural Networks

We consider the problem of monitoring and controlling a partially-observ...

0 Eli A. Meirom, et al. ∙

∙ 11/12/2019

Combinatorial Optimization by Graph Pointer Networks and Hierarchical Reinforcement Learning

In this work, we introduce Graph Pointer Networks (GPNs) trained using r...

0 Qiang Ma, et al. ∙

∙ 06/12/2020

Learning TSP Requires Rethinking Generalization

End-to-end training of neural network solvers for combinatorial problems...

36 Chaitanya K. Joshi, et al. ∙

∙ 02/16/2021

Training Larger Networks for Deep Reinforcement Learning

The success of deep learning in the computer vision and natural language...

127 Kei Ota, et al. ∙

Code Repositories

graph-convnet-tsp

Code for the paper 'An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problem' (INFORMS Annual Meeting 2019)

view repo

learning-paradigms-for-tsp

Code for the paper 'On Learning Paradigms for the Travelling Salesman Problem' (NeurIPS 2019 Graph Representation Learning Workshop)

view repo