Injecting Domain Knowledge in Neural Networks: a Controlled Experiment on a Constrained Problem

by   Mattia Silvestri, et al.
University of Bologna

Given enough data, Deep Neural Networks (DNNs) are capable of learning complex input-output relations with high accuracy. In several domains, however, data is scarce or expensive to retrieve, while a substantial amount of expert knowledge is available. It seems reasonable that if we can inject this additional information in the DNN, we could ease the learning process. One such case is that of Constraint Problems, for which declarative approaches exists and pure ML solutions have obtained mixed success. Using a classical constrained problem as a case study, we perform controlled experiments to probe the impact of progressively adding domain and empirical knowledge in the DNN. Our results are very encouraging, showing that (at least in our setup) embedding domain knowledge at training time can have a considerable effect and that a small amount of empirical knowledge is sufficient to obtain practically useful results.


page 1

page 2

page 3

page 4


Injective Domain Knowledge in Neural Networks for Transprecision Computing

Machine Learning (ML) models are very effective in many learning tasks, ...

Improving Deep Learning Models via Constraint-Based Domain Knowledge: a Brief Survey

Deep Learning (DL) models proved themselves to perform extremely well on...

Knowledge Enhanced Machine Learning Pipeline against Diverse Adversarial Attacks

Despite the great successes achieved by deep neural networks (DNNs), rec...

The Optimal ANN Model for Predicting Bearing Capacity of Shallow Foundations Trained on Scarce Data

This study is focused on determining the potential of using deep neural ...

Label-Free Supervision of Neural Networks with Physics and Domain Knowledge

In many machine learning applications, labeled data is scarce and obtain...

IL-Net: Using Expert Knowledge to Guide the Design of Furcated Neural Networks

Deep neural networks (DNN) excel at extracting patterns. Through represe...

Asymptotic-Preserving Neural Networks for hyperbolic systems with diffusive scaling

With the rapid advance of Machine Learning techniques and the deep incre...

Please sign up or login with your details

Forgot password? Click here to reset