IEO: Intelligent Evolutionary Optimisation for Hyperparameter Tuning

09/10/2020
by   Yuxi Huan, et al.
0

Hyperparameter optimisation is a crucial process in searching the optimal machine learning model. The efficiency of finding the optimal hyperparameter settings has been a big concern in recent researches since the optimisation process could be time-consuming, especially when the objective functions are highly expensive to evaluate. In this paper, we introduce an intelligent evolutionary optimisation algorithm which applies machine learning technique to the traditional evolutionary algorithm to accelerate the overall optimisation process of tuning machine learning models in classification problems. We demonstrate our Intelligent Evolutionary Optimisation (IEO)in a series of controlled experiments, comparing with traditional evolutionary optimisation in hyperparameter tuning. The empirical study shows that our approach accelerates the optimisation speed by 30.40 scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/20/2022

evoML Yellow Paper: Evolutionary AI and Optimisation Studio

Machine learning model development and optimisation can be a rather cumb...
06/12/2017

Practical Gauss-Newton Optimisation for Deep Learning

We present an efficient block-diagonal ap- proximation to the Gauss-Newt...
10/22/2018

LAMVI-2: A Visual Tool for Comparing and Tuning Word Embedding Models

Tuning machine learning models, particularly deep learning architectures...
11/23/2012

Ecosystem-Oriented Distributed Evolutionary Computing

We create a novel optimisation technique inspired by natural ecosystems,...
12/06/2018

Comparative Document Summarisation via Classification

This paper considers extractive summarisation in a comparative setting: ...
06/29/2023

Obeying the Order: Introducing Ordered Transfer Hyperparameter Optimisation

We introduce ordered transfer hyperparameter optimisation (OTHPO), a ver...

Please sign up or login with your details

Forgot password? Click here to reset