Stick-breaking processes, clumping, and Markov chain occupation laws

01/23/2019
by   Zach Dietz, et al.
0

We consider the connections among `clumped' residual allocation models (RAMs), a general class of stick-breaking processes including Dirichlet processes, and the occupation laws of certain discrete space time-inhomogeneous Markov chains related to simulated annealing and other applications. An intermediate structure is introduced in a given RAM, where proportions between successive indices in a list are added or clumped together to form another RAM. In particular, when the initial RAM is a Griffiths-Engen-McCloskey (GEM) sequence and the indices are given by the random times that an auxiliary Markov chain jumps away from its current state, the joint law of the intermediate RAM and the locations visited in the sojourns is given in terms of a `disordered' GEM sequence, and an induced Markov chain. Through this joint law, we identify a large class of `stick breaking' processes as the limits of empirical occupation measures for associated time-inhomogeneous Markov chains.

READ FULL TEXT
research
08/24/2021

On the use of Markovian stick-breaking priors

In [10], a `Markovian stick-breaking' process which generalizes the Diri...
research
10/25/2022

Enabling Quantum Speedup of Markov Chains using a Multi-level Approach

Quantum speedup for mixing a Markov chain can be achieved based on the c...
research
10/14/2019

Drift, Minorization, and Hitting Times

The “drift-and-minorization” method, introduced and popularized in (Rose...
research
07/15/2020

Stationarity and ergodic properties for some observation-driven models in random environments

The first motivation of this paper is to study stationarity and ergodic ...
research
02/25/2007

Linking Microscopic and Macroscopic Models for Evolution: Markov Chain Network Training and Conservation Law Approximations

In this paper, a general framework for the analysis of a connection betw...
research
11/13/2017

Circularly-Coupled Markov Chain Sampling

I show how to run an N-time-step Markov chain simulation in a circular f...
research
01/24/2022

Linear Laws of Markov Chains with an Application for Anomaly Detection in Bitcoin Prices

The goals of this paper are twofold: (1) to present a new method that is...

Please sign up or login with your details

Forgot password? Click here to reset