Boosting Deep Neural Networks with Geometrical Prior Knowledge: A Survey

06/30/2020
by   Matthias Rath, et al.
0

While Deep Neural Networks (DNNs) achieve state-of-the-art results in many different problem settings, they are affected by some crucial weaknesses. On the one hand, DNNs depend on exploiting a vast amount of training data, whose labeling process is time-consuming and expensive. On the other hand, DNNs are often treated as black box systems, which complicates their evaluation and validation. Both problems can be mitigated by incorporating prior knowledge into the DNN. One promising field, inspired by the success of convolutional neural networks (CNNs) in computer vision tasks, is to incorporate knowledge about symmetric geometrical transformations of the problem to solve. This promises an increased data-efficiency and filter responses that are interpretable more easily. In this survey, we try to give a concise overview about different approaches to incorporate geometrical prior knowledge into DNNs. Additionally, we try to connect those methods to the field of 3D object detection for autonomous driving, where we expect promising results applying those methods.

READ FULL TEXT
research
06/24/2021

Towards Fully Interpretable Deep Neural Networks: Are We There Yet?

Despite the remarkable performance, Deep Neural Networks (DNNs) behave a...
research
08/20/2019

Efficient Deep Neural Networks

The success of deep neural networks (DNNs) is attributable to three fact...
research
11/21/2021

Differentiable Projection for Constrained Deep Learning

Deep neural networks (DNNs) have achieved extraordinary performance in s...
research
01/11/2021

Deep Neural Networks to Recover Unknown Physical Parameters from Oscillating Time Series

Deep neural networks (DNNs) are widely used in pattern-recognition tasks...
research
11/27/2019

Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Survey

Deep Learning is a state-of-the-art technique to make inference on exten...
research
12/05/2018

Training Competitive Binary Neural Networks from Scratch

Convolutional neural networks have achieved astonishing results in diffe...
research
05/18/2020

Data Represention for Deep Learning with Priori Knowledge of Symmetric Wireless Tasks

Deep neural networks (DNNs) have been applied to address various wireles...

Please sign up or login with your details

Forgot password? Click here to reset