A Tsetlin Machine with Multigranular Clauses

09/16/2019
by   Saeed Rahimi Gorji, et al.
0

The recently introduced Tsetlin Machine (TM) has provided competitive pattern recognition accuracy in several benchmarks, however, requires a 3-dimensional hyperparameter search. In this paper, we introduce the Multigranular Tsetlin Machine (MTM). The MTM eliminates the specificity hyperparameter, used by the TM to control the granularity of the conjunctive clauses that it produces for recognizing patterns. Instead of using a fixed global specificity, we encode varying specificity as part of the clauses, rendering the clauses multigranular. This makes it easier to configure the TM because the dimensionality of the hyperparameter search space is reduced to only two dimensions. Indeed, it turns out that there is significantly less hyperparameter tuning involved in applying the MTM to new problems. Further, we demonstrate empirically that the MTM provides similar performance to what is achieved with a finely specificity-optimized TM, by comparing their performance on both synthetic and real-world datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/20/2023

Quantum Machine Learning hyperparameter search

This paper presents a quantum-based Fourier-regression approach for mach...
research
11/03/2022

Revisiting Hyperparameter Tuning with Differential Privacy

Hyperparameter tuning is a common practice in the application of machine...
research
07/12/2023

Efficient and Joint Hyperparameter and Architecture Search for Collaborative Filtering

Automated Machine Learning (AutoML) techniques have recently been introd...
research
04/24/2019

Reducing The Search Space For Hyperparameter Optimization Using Group Sparsity

We propose a new algorithm for hyperparameter selection in machine learn...
research
08/17/2022

Random Search Hyper-Parameter Tuning: Expected Improvement Estimation and the Corresponding Lower Bound

Hyperparameter tuning is a common technique for improving the performanc...
research
10/25/2020

Hyperparameter Transfer Across Developer Adjustments

After developer adjustments to a machine learning (ML) algorithm, how ca...
research
06/30/2021

A Critical Analysis of Recursive Model Indexes

The recursive model index (RMI) has recently been introduced as a machin...

Please sign up or login with your details

Forgot password? Click here to reset