Fixed Integral Neural Networks

07/26/2023
by   Ryan Kortvelesy, et al.
0

It is often useful to perform integration over learned functions represented by neural networks. However, this integration is usually performed numerically, as analytical integration over learned functions (especially neural networks) is generally viewed as intractable. In this work, we present a method for representing the analytical integral of a learned function f. This allows the exact integral of a neural network to be computed, and enables constrained neural networks to be parametrised by applying constraints directly to the integral. Crucially, we also introduce a method to constrain f to be positive, a necessary condition for many applications (e.g. probability distributions, distance metrics, etc). Finally, we introduce several applications where our fixed-integral neural network (FINN) can be utilised.

READ FULL TEXT
research
09/04/2019

Deep kernel learning for integral measurements

Deep kernel learning refers to a Gaussian process that incorporates neur...
research
07/04/2019

Neural Networks, Hypersurfaces, and Radon Transforms

Connections between integration along hypersufaces, Radon transforms, an...
research
04/19/2020

A Universal Approximation Theorem of Deep Neural Networks for Expressing Distributions

This paper studies the universal approximation property of deep neural n...
research
07/04/2021

Interval probability density functions constructed from a generalization of the Moore and Yang integral

Moore and Yang defined an integral notion, based on an extension of Riem...
research
06/25/2020

Q-NET: A Formula for Numerical Integration of a Shallow Feed-forward Neural Network

Numerical integration is a computational procedure that is widely encoun...
research
03/09/2023

Fredholm integral equations for function approximation and the training of neural networks

We present a novel and mathematically transparent approach to function a...
research
02/02/2019

Numerical Integration Method for Training Neural Network

We propose a new numerical integration method for training a shallow neu...

Please sign up or login with your details

Forgot password? Click here to reset