EDDI: Efficient Dynamic Discovery of High-Value Information with Partial VAE

by   Chao Ma, et al.

Making decisions requires information relevant to the task at hand. Many real-life decision-making situations allow acquiring further relevant information at a specific cost. For example, in assessing the health status of a patient we may decide to take additional measurements such as diagnostic tests or imaging scans before making a final assessment. More information that is relevant allows for better decisions but it may be costly to acquire all of this information. How can we trade off the desire to make good decisions with the option to acquire further information at a cost? To this end, we propose a principled framework, named EDDI (Efficient Dynamic Discovery of high-value Information), based on the theory of Bayesian experimental design. In EDDI we propose a novel partial variational autoencoder (Partial VAE), to efficiently handle missing data over varying subsets of known information. EDDI combines this Partial VAE with an acquisition function that maximizes expected information gain on a set of target variables. EDDI is efficient and demonstrates that dynamic discovery of high-value information is possible; we show cost reduction at the same decision quality and improved decision quality at the same cost in benchmarks and in two health-care applications.. We believe there is great potential for realizing these gains in real-world decision support systems.


page 7

page 14


Icebreaker: Element-wise Active Information Acquisition with Bayesian Deep Latent Gaussian Model

In this paper we introduce the ice-start problem, i.e., the challenge of...

Reinforcement Learning with Efficient Active Feature Acquisition

Solving real-life sequential decision making problems under partial obse...

Value of Information Lattice: Exploiting Probabilistic Independence for Effective Feature Subset Acquisition

We address the cost-sensitive feature acquisition problem, where misclas...

High Dimensional Decision Making, Upper and Lower Bounds

A decision maker's utility depends on her action a∈ A ⊂ℝ^d and the payof...

Optimal Immunization Policy Using Dynamic Programming

Decisions in public health are almost always made in the context of unce...

Value of Information in Probabilistic Logic Programs

In medical decision making, we have to choose among several expensive di...

Data-Driven Online Decision Making with Costly Information Acquisition

In most real-world settings such as recommender systems, finance, and he...

Please sign up or login with your details

Forgot password? Click here to reset