The Population Resemblance Statistic: A Chi-Square Measure of Fit for Banking

by   Nelis Potgieter, et al.

The Population Stability Index (PSI) is a widely used measure in credit risk modeling and monitoring within the banking industry. Its purpose is to monitor for changes in the population underlying a model, such as a scorecard, to ensure that the current population closely resembles the one used during model development. If substantial differences between populations are detected, model reconstruction may be necessary. Despite its widespread use, the origins and properties of the PSI are not well documented. Previous literature has suggested using arbitrary constants as a rule-of-thumb to assess stability, regardless of sample size. However, this approach too often calls for model reconstruction in small sample sizes while not detecting the need often enough in large sample sizes. This paper introduces an alternative discrepancy measure called the Population Resemblance statistic (PRS). It is based on the Pearson chi-square statistic. Properties of the PRS follow from the non-central chi-square distribution. Notably, the PRS accommodates sample-size dependent critical values and enables the specification of risk tolerances. Its efficacy is demonstrated in a simulation study and with real-world examples.


page 20

page 21


A critical review of existing and new population stability testing procedures in credit risk scoring

Credit scorecards are models used for the modelling of the probability o...

Geometry of the sample frequency spectrum and the perils of demographic inference

The sample frequency spectrum (SFS), which describes the distribution of...

A sample size heuristic for network scale-up studies

The network scale-up method (NSUM) is a survey-based method for estimati...

Second Order Expansions for Sample Median with Random Sample Size

In practice, we often encounter situations where a sample size is not de...

IQ: Intrinsic measure for quantifying the heterogeneity in meta-analysis

Quantifying the heterogeneity is an important issue in meta-analysis, an...

ERStruct: An Eigenvalue Ratio Approach to Inferring Population Structure from Sequencing Data

Inference of population structure from genetic data plays an important r...

Maximum value of the standardized log of odds ratio and celestial mechanics

The odds ratio (OR) is a widely used measure of the effect size in obser...

Please sign up or login with your details

Forgot password? Click here to reset