Reconciled Polynomial Machine: A Unified Representation of Shallow and Deep Learning Models

05/19/2018
by   Jiawei Zhang, et al.
0

In this paper, we aim at introducing a new machine learning model, namely reconciled polynomial machine, which can provide a unified representation of existing shallow and deep machine learning models. Reconciled polynomial machine predicts the output by computing the inner product of the feature kernel function and variable reconciling function. Analysis of several concrete models, including Linear Models, FM, MVM, Perceptron, MLP and Deep Neural Networks, will be provided in this paper, which can all be reduced to the reconciled polynomial machine representations. Detailed analysis of the learning error by these models will also be illustrated in this paper based on their reduced representations from the function approximation perspective.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/12/2022

Categories of Differentiable Polynomial Circuits for Machine Learning

Reverse derivative categories (RDCs) have recently been shown to be a su...
research
04/08/2022

Exploring the Universality of Hadronic Jet Classification

The modeling of jet substructure significantly differs between Parton Sh...
research
06/18/2021

It's FLAN time! Summing feature-wise latent representations for interpretability

Interpretability has become a necessary feature for machine learning mod...
research
10/21/2019

Shallow Art: Art Extension Through Simple Machine Learning

Shallow Art presents, implements, and tests the use of simple single-out...
research
03/21/2023

The Representational Status of Deep Learning Models

This paper aims to clarify the representational status of Deep Learning ...
research
06/18/2021

An Empirical Investigation into Deep and Shallow Rule Learning

Inductive rule learning is arguably among the most traditional paradigms...
research
04/26/2013

An Algorithm for Training Polynomial Networks

We consider deep neural networks, in which the output of each node is a ...

Please sign up or login with your details

Forgot password? Click here to reset