Missing Values and the Dimensionality of Expected Returns

07/21/2022
by   Andrew Y. Chen, et al.
0

Combining 100+ cross-sectional predictors requires either dropping 90 data or imputing missing values. We compare imputation using the expectation-maximization algorithm with simple ad-hoc methods. Surprisingly, expectation-maximization and ad-hoc methods lead to similar results. This similarity happens because predictors are largely independent: Correlations cluster near zero and more than 10 principal components are required to span 50 uninformative about missing predictors, making ad-hoc methods valid. In an out-of-sample principal components (PC) regression test, 50 PCs are required to capture equal-weighted long-short expected returns (30 PCs value-weighted), regardless of the imputation method.

READ FULL TEXT
research
02/01/2018

Bootstrapping and Multiple Imputation Ensemble Approaches for Missing Data

Presence of missing values in a dataset can adversely affect the perform...
research
06/06/2019

Estimation and imputation in Probabilistic Principal Component Analysis with Missing Not At Random data

Missing Not At Random values are considered to be non-ignorable and requ...
research
03/01/2021

Expected Value of Communication for Planning in Ad Hoc Teamwork

A desirable goal for autonomous agents is to be able to coordinate on th...
research
04/22/2020

DeepFake Detection by Analyzing Convolutional Traces

The Deepfake phenomenon has become very popular nowadays thanks to the p...
research
08/02/2021

Data-driven Clustering in Ad-hoc Networks based on Community Detection

High demands for industrial networks lead to increasingly large sensor n...
research
08/29/2022

High-dimensional imputation for the social sciences: a comparison of state-of-the-art methods

Including a large number of predictors in the imputation model underlyin...
research
04/28/2023

Counterfactual Explanation with Missing Values

Counterfactual Explanation (CE) is a post-hoc explanation method that pr...

Please sign up or login with your details

Forgot password? Click here to reset