Tutorial and Survey on Probabilistic Graphical Model and Variational Inference in Deep Reinforcement Learning

by   Xudong Sun, et al.

Probabilistic Graphical Modeling and Variational Inference play an important role in recent advances in Deep Reinforcement Learning. Aiming at a self-consistent tutorial survey, this article illustrates basic concepts of reinforcement learning with Probabilistic Graphical Models, as well as derivation of some basic formula as a recap. Reviews and comparisons on recent advances in deep reinforcement learning with different research directions are made from various aspects. We offer Probabilistic Graphical Models, detailed explanation and derivation to several use cases of Variational Inference, which serve as a complementary material on top of the original contributions.


page 1

page 2

page 3

page 4


Composing graphical models with neural networks for structured representations and fast inference

We propose a general modeling and inference framework that composes prob...

Probabilistic Discriminative Learning with Layered Graphical Models

Probabilistic graphical models are traditionally known for their success...

Towards Bayesian Deep Learning: A Survey

While perception tasks such as visual object recognition and text unders...

Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review

The framework of reinforcement learning or optimal control provides a ma...

Correlated Equilibria for Approximate Variational Inference in MRFs

Almost all of the work in graphical models for game theory has mirrored ...

CARE: Certifiably Robust Learning with Reasoning via Variational Inference

Despite great recent advances achieved by deep neural networks (DNNs), t...

Probabilistic Models with Deep Neural Networks

Recent advances in statistical inference have significantly expanded the...

Please sign up or login with your details

Forgot password? Click here to reset