Making Logic Learnable With Neural Networks

02/10/2020
by   Tobias Brudermueller, et al.
0

While neural networks are good at learning unspecified functions from training samples, they cannot be directly implemented in hardware and are often not interpretable or formally verifiable. On the other hand, logic circuits are implementable, verifiable, and interpretable but are not able to learn from training data in a generalizable way. We propose a novel logic learning pipeline that combines the advantages of neural networks and logic circuits. Our pipeline first trains a neural network on a classification task, and then translates this, first to random forests or look-up tables, and then to AND-Inverter logic. We show that our pipeline maintains greater accuracy than naive translations to logic, and minimizes the logic such that it is more interpretable and has decreased hardware cost. We show the utility of our pipeline on a network that is trained on biomedical data from patients presenting with gastrointestinal bleeding with the prediction task of determining if patients need immediate hospital-based intervention. This approach could be applied to patient care to provide risk stratification and guide clinical decision-making.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/07/2019

Interpretable Outcome Prediction with Sparse Bayesian Neural Networks in Intensive Care

Clinical decision making is challenging because of pathological complexi...
research
11/27/2012

Neuro-Fuzzy Computing System with the Capacity of Implementation on Memristor-Crossbar and Optimization-Free Hardware Training

In this paper, first we present a new explanation for the relation betwe...
research
07/03/2019

Circuit-Based Intrinsic Methods to Detect Overfitting

The focus of this paper is on intrinsic methods to detect overfitting. T...
research
02/21/2020

An Investigation of Interpretability Techniques for Deep Learning in Predictive Process Analytics

This paper explores interpretability techniques for two of the most succ...
research
12/01/2019

Hepatocellular Carcinoma Intra-arterial Treatment Response Prediction for Improved Therapeutic Decision-Making

This work proposes a pipeline to predict treatment response to intra-art...
research
05/04/2021

NeuralLog: a Neural Logic Language

Application domains that require considering relationships among objects...
research
01/19/2023

Building Concise Logical Patterns by Constraining Tsetlin Machine Clause Size

Tsetlin machine (TM) is a logic-based machine learning approach with the...

Please sign up or login with your details

Forgot password? Click here to reset