How well can we learn large factor models without assuming strong factors?

by   Yinchu Zhu, et al.

In this paper, we consider the problem of learning models with a latent factor structure. The focus is to find what is possible and what is impossible if the usual strong factor condition is not imposed. We study the minimax rate and adaptivity issues in two problems: pure factor models and panel regression with interactive fixed effects. For pure factor models, if the number of factors is known, we develop adaptive estimation and inference procedures that attain the minimax rate. However, when the number of factors is not specified a priori, we show that there is a tradeoff between validity and efficiency: any confidence interval that has uniform validity for arbitrary factor strength has to be conservative; in particular its width is bounded away from zero even when the factors are strong. Conversely, any data-driven confidence interval that does not require as an input the exact number of factors (including weak ones) and has shrinking width under strong factors does not have uniform coverage and the worst-case coverage probability is at most 1/2. For panel regressions with interactive fixed effects, the tradeoff is much better. We find that the minimax rate for learning the regression coefficient does not depend on the factor strength and propose a simple estimator that achieves this rate.


page 1

page 2

page 3

page 4


Robust Estimation and Inference in Panels with Interactive Fixed Effects

We consider estimation and inference for a regression coefficient in a p...

Adaptive Estimation and Uniform Confidence Bands for Nonparametric IV

We introduce computationally simple, data-driven procedures for estimati...

High-dimensional Adaptive Minimax Sparse Estimation with Interactions

High-dimensional linear regression with interaction effects is broadly a...

Learning Latent Factors from Diversified Projections and its Applications to Over-Estimated and Weak Factors

Estimations and applications of factor models often rely on the crucial ...

Project Makespan Estimation: Computational Load of Interval and Point Estimates

The estimation of project completion time is to be repeated several time...

On the Dimensional Indeterminacy of One-Wave Factor Analysis Under Causal Effects

It is shown, with two sets of survey items that separately load on two d...

An optimal unrestricted learning procedure

We study learning problems in the general setup, for arbitrary classes o...

Please sign up or login with your details

Forgot password? Click here to reset