Fast Gaussian Process Posterior Mean Prediction via Local Cross Validation and Precomputation

by   Alec M. Dunton, et al.
Lawrence Livermore National Laboratory

Gaussian processes (GPs) are Bayesian non-parametric models useful in a myriad of applications. Despite their popularity, the cost of GP predictions (quadratic storage and cubic complexity with respect to the number of training points) remains a hurdle in applying GPs to large data. We present a fast posterior mean prediction algorithm called FastMuyGPs to address this shortcoming. FastMuyGPs is based upon the MuyGPs hyperparameter estimation algorithm and utilizes a combination of leave-one-out cross-validation, batching, nearest neighbors sparsification, and precomputation to provide scalable, fast GP prediction. We demonstrate several benchmarks wherein FastMuyGPs prediction attains superior accuracy and competitive or superior runtime to both deep neural networks and state-of-the-art scalable GP algorithms.


MuyGPs: Scalable Gaussian Process Hyperparameter Estimation Using Local Cross-Validation

Gaussian processes (GPs) are non-linear probabilistic models popular in ...

Scalable Cross Validation Losses for Gaussian Process Models

We introduce a simple and scalable method for training Gaussian process ...

Light curve completion and forecasting using fast and scalable Gaussian processes (MuyGPs)

Temporal variations of apparent magnitude, called light curves, are obse...

Cross-Validation Based Adaptive Sampling for Multi-Level Gaussian Process Models

Complex computer codes or models can often be run in a hierarchy of diff...

Robust Filtering and Smoothing with Gaussian Processes

We propose a principled algorithm for robust Bayesian filtering and smoo...

Wireless Traffic Prediction with Scalable Gaussian Process: Framework, Algorithms, and Verification

The cloud radio access network (C-RAN) is a promising paradigm to meet t...

Scaling Gaussian Process Optimization by Evaluating a Few Unique Candidates Multiple Times

Computing a Gaussian process (GP) posterior has a computational cost cub...

Please sign up or login with your details

Forgot password? Click here to reset