Monte Carlo Fusion

01/01/2019
by   Hongsheng Dai, et al.
0

This paper proposes a new theory and methodology to tackle the problem of unifying distributed analyses and inferences on shared parameters from multiple sources, into a single coherent inference. This surprisingly challenging problem arises in many settings (for instance, expert elicitation, multi-view learning, distributed 'big data' problems etc.), but to-date the framework and methodology proposed in this paper (Monte Carlo Fusion) is the first general approach which avoids any form of approximation error in obtaining the unified inference. In this paper we focus on the key theoretical underpinnings of this new methodology, and simple (direct) Monte Carlo interpretations of the theory. There is considerable scope to tailor the theory introduced in this paper to particular application settings (such as the big data setting), construct efficient parallelised schemes, understand the approximation and computational efficiencies of other such unification paradigms, and explore new theoretical and methodological directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2021

Bayesian Fusion: Scalable unification of distributed statistical analyses

There has recently been considerable interest in addressing the problem ...
research
10/14/2021

Divide-and-Conquer Monte Carlo Fusion

Combining several (sample approximations of) distributions, which we ter...
research
06/11/2021

DG-LMC: A Turn-key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo within Gibbs

Performing reliable Bayesian inference on a big data scale is becoming a...
research
02/23/2020

Generalized Bayesian Filtering via Sequential Monte Carlo

We introduce a framework for inference in general state-space hidden Mar...
research
05/02/2020

An Extensible, Scalable Spark Platform for Alignment-free Genomic Analysis – Version 2

Motivation: Alignment-free distance and similarity functions (AF functio...
research
07/20/2023

A Fully Parallelized and Budgeted Multi-Level Monte Carlo Method and the Application to Acoustic Waves

We present a novel variant of the multi-level Monte Carlo method that ef...
research
10/11/2020

On Spatial Lag Models estimated using crowdsourcing, web-scraping or other unconventionally collected data

The Big Data revolution is challenging the state-of-the-art statistical ...

Please sign up or login with your details

Forgot password? Click here to reset