State-Dependent Kernel Selection for Conditional Sampling of Graphs

09/18/2018
by   James Scott, et al.
0

This paper introduces new efficient algorithms for two problems: sampling conditional on vertex degrees in unweighted graphs, and sampling conditional on vertex strengths in weighted graphs. The algorithms can sample conditional on the presence or absence of an arbitrary number of edges. The resulting conditional distributions provide the basis for exact tests. Existing samplers based on MCMC or sequential importance sampling are generally not scalable; their efficiency degrades in sparse graphs. MCMC methods usually require explicit computation of a Markov basis to navigate the complex state space; this is computationally intensive even for small graphs. We use state-dependent kernel selection to develop new MCMC samplers. These do not require a Markov basis, and are efficient both in sparse and dense graphs. The key idea is to intelligently select a Markov kernel on the basis of the current state of the chain. We apply our methods to testing hypotheses on a real network and contingency table. The algorithms appear orders of magnitude more efficient than existing methods in the test cases considered.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/26/2017

Markov Chain Monte Carlo sampling for conditional tests: A link between permutation tests and algebraic statistics

We consider conditional tests for non-negative discrete exponential fami...
research
12/07/2020

Sequential Stratified Regeneration: MCMC for Large State Spaces with an Application to Subgraph Counting Estimation

This work considers the general task of estimating the sum of a bounded ...
research
05/01/2018

Scalable Importance Tempering and Bayesian Variable Selection

We propose a Monte Carlo algorithm to sample from high-dimensional proba...
research
07/01/2022

Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes

A determinantal point process (DPP) is an elegant model that assigns a p...
research
06/24/2020

Sequential Gibbs Sampling Algorithm for Cognitive Diagnosis Models with Many Attributes

Cognitive diagnosis models (CDMs) are useful statistical tools to provid...
research
11/21/2018

Self-Adversarially Learned Bayesian Sampling

Scalable Bayesian sampling is playing an important role in modern machin...
research
09/19/2021

Approximate Conditional Sampling for Pattern Detection in Weighted Networks

Assessing the statistical significance of network patterns is crucial fo...

Please sign up or login with your details

Forgot password? Click here to reset