What is an equivariant neural network?

05/15/2022
by   Lek-Heng Lim, et al.
0

We explain equivariant neural networks, a notion underlying breakthroughs in machine learning from deep convolutional neural networks for computer vision to AlphaFold 2 for protein structure prediction, without assuming knowledge of equivariance or neural networks. The basic mathematical ideas are simple but are often obscured by engineering complications that come with practical realizations. We extract and focus on the mathematical aspects, and limit ourselves to a cursory treatment of the engineering issues at the end.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2018

Universality of Deep Convolutional Neural Networks

Deep learning has been widely applied and brought breakthroughs in speec...
research
11/13/2020

Investigating Learning in Deep Neural Networks using Layer-Wise Weight Change

Understanding the per-layer learning dynamics of deep neural networks is...
research
05/09/2022

Statistical Guarantees for Approximate Stationary Points of Simple Neural Networks

Since statistical guarantees for neural networks are usually restricted ...
research
04/27/2021

Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

The last decade has witnessed an experimental revolution in data science...
research
06/29/2023

Seeing in Words: Learning to Classify through Language Bottlenecks

Neural networks for computer vision extract uninterpretable features des...
research
01/08/2023

Neural network models

This work presents the current collection of mathematical models related...

Please sign up or login with your details

Forgot password? Click here to reset