yaglm: a Python package for fitting and tuning generalized linear models that supports structured, adaptive and non-convex penalties

by   Iain Carmichael, et al.
University of Washington

The yaglm package aims to make the broader ecosystem of modern generalized linear models accessible to data analysts and researchers. This ecosystem encompasses a range of loss functions (e.g. linear, logistic, quantile regression), constraints (e.g. positive, isotonic) and penalties. Beyond the basic lasso/ridge, the package supports structured penalties such as the nuclear norm as well as the group, exclusive, fused, and generalized lasso. It also supports more accurate adaptive and non-convex (e.g. SCAD) versions of these penalties that often come with strong statistical guarantees at limited additional computational expense. yaglm comes with a variety of tuning parameter selection methods including: cross-validation, information criteria that have favorable model selection properties, and degrees of freedom estimators. While several solvers are built in (e.g. FISTA), a key design choice allows users to employ their favorite state of the art optimization algorithms. Designed to be user friendly, the package automatically creates tuning parameter grids, supports tuning with fast path algorithms along with parallelization, and follows a unified scikit-learn compatible API.


page 1

page 2

page 3

page 4


Efficient algorithm to select tuning parameters in sparse regression modeling with regularization

In sparse regression modeling via regularization such as the lasso, it i...

Cyanure: An Open-Source Toolbox for Empirical Risk Minimization for Python, C++, and soon more

Cyanure is an open-source C++ software package with a Python interface. ...

A User-Friendly Computational Framework for Robust Structured Regression Using the L_2 Criterion

We introduce a user-friendly computational framework for implementing ro...

A unified algorithm for the non-convex penalized estimation: The ncpen package

Various R packages have been developed for the non-convex penalized esti...

Asgl: A Python Package for Penalized Linear and Quantile Regression

Asg is a Python package that solves penalized linear regression and quan...

Degrees of Freedom: Search Cost and Self-consistency

Model degrees of freedom () is a fundamental concept in statistics becau...

Holistic Generalized Linear Models

Holistic linear regression extends the classical best subset selection p...

Code Repositories


A python package for penalized generalized linear models that supports fitting and model selection for structured, adaptive and non-convex penalties.

view repo

Please sign up or login with your details

Forgot password? Click here to reset