The Benefits of Probability-Proportional-to-Size Sampling in Cluster-Randomized Experiments

02/19/2020
by   Yeng Xiong, et al.
0

In a cluster-randomized experiment, treatment is assigned to clusters of individual units of interest–households, classrooms, villages, etc.–instead of the units themselves. The number of clusters sampled and the number of units sampled within each cluster is typically restricted by a budget constraint. Previous analysis of cluster randomized experiments under the Neyman-Rubin potential outcomes model of response have assumed a simple random sample of clusters. Estimators of the population average treatment effect (PATE) under this assumption are often either biased or not invariant to location shifts of potential outcomes. We demonstrate that, by sampling clusters with probability proportional to the number of units within a cluster, the Horvitz-Thompson estimator (HT) is invariant to location shifts and unbiasedly estimates PATE. We derive standard errors of HT and discuss how to estimate these standard errors. We also show that results hold for stratified random samples when samples are drawn proportionally to cluster size within each stratum. We demonstrate the efficacy of this sampling scheme using a simulation based on data from an experiment measuring the efficacy of the National Solidarity Programme in Afghanistan.

READ FULL TEXT

page 17

page 18

research
04/18/2022

Inference for Cluster Randomized Experiments with Non-ignorable Cluster Sizes

This paper considers the problem of inference in cluster randomized expe...
research
05/09/2017

Spatial Random Sampling: A Structure-Preserving Data Sketching Tool

Random column sampling is not guaranteed to yield data sketches that pre...
research
10/03/2017

Bayesian Inference under Cluster Sampling with Probability Proportional to Size

Cluster sampling is common in survey practice, and the corresponding inf...
research
12/18/2020

Statistical Properties of Exclusive and Non-exclusive Online Randomized Experiments using Bucket Reuse

Randomized experiments is a key part of product development in the tech ...
research
04/09/2021

Model-assisted analyses of cluster-randomized experiments

Cluster-randomized experiments are widely used due to their logistical c...
research
09/13/2023

A Study of Symbiosis Bias in A/B Tests of Recommendation Algorithms

One assumption underlying the unbiasedness of global treatment effect es...

Please sign up or login with your details

Forgot password? Click here to reset