Detection of Interacting Variables for Generalized Linear Models via Neural Networks

09/16/2022
by   Yevhen Havrylenko, et al.
0

The quality of generalized linear models (GLMs), frequently used by insurance companies, depends on the choice of interacting variables. The search for interactions is time-consuming, especially for data sets with a large number of variables, depends much on expert judgement of actuaries, and often relies on visual performance indicators. Therefore, we present an approach to automating the process of finding interactions that should be added to GLMs to improve their predictive power. Our approach relies on neural networks and a model-specific interaction detection method, which is computationally faster than the traditionally used methods like Friedman H-Statistic or SHAP values. In numerical studies, we provide the results of our approach on different data sets: open-source data, artificial data, and proprietary data.

READ FULL TEXT
research
06/11/2020

A new inference approach for training shallow and deep generalized linear models of noisy interacting neurons

Generalized linear models are one of the most efficient paradigms for pr...
research
10/17/2019

Ranking variables and interactions using predictive uncertainty measures

For complex nonlinear supervised learning models, assessing the relevanc...
research
12/03/2020

Locating the source of interacting signal in complex networks

We investigate the problem of locating the source of a self-interacting ...
research
12/20/2017

On the Relation of External and Internal Feature Interactions: A Case Study

Detecting feature interactions is imperative for accurately predicting p...
research
02/22/2021

You Only Compress Once: Optimal Data Compression for Estimating Linear Models

Linear models are used in online decision making, such as in machine lea...
research
09/11/2020

Visual Neural Decomposition to Explain Multivariate Data Sets

Investigating relationships between variables in multi-dimensional data ...
research
05/04/2018

Modeling Dengue Vector Population Using Remotely Sensed Data and Machine Learning

Mosquitoes are vectors of many human diseases. In particular, Aedes æ gy...

Please sign up or login with your details

Forgot password? Click here to reset