Optimizing Neural Network Weights using Nature-Inspired Algorithms

05/20/2021
by   Wael Korani, et al.
0

This study aims to optimize Deep Feedforward Neural Networks (DFNNs) training using nature-inspired optimization algorithms, such as PSO, MTO, and its variant called MTOCL. We show how these algorithms efficiently update the weights of DFNNs when learning from data. We evaluate the performance of DFNN fused with optimization algorithms using three Wisconsin breast cancer datasets, Original, Diagnostic, and Prognosis, under different experimental scenarios. The empirical analysis demonstrates that MTOCL is the most performing in most scenarios across the three datasets. Also, MTOCL is comparable to past weight optimization algorithms for the original dataset, and superior for the other datasets, especially for the challenging Prognostic dataset.

READ FULL TEXT
research
07/28/2020

A Comparison of Optimization Algorithms for Deep Learning

In recent years, we have witnessed the rise of deep learning. Deep neura...
research
01/17/2019

Optimizing Deep Neural Networks with Multiple Search Neuroevolution

This paper presents an evolutionary metaheuristic called Multiple Search...
research
12/14/2013

CACO : Competitive Ant Colony Optimization, A Nature-Inspired Metaheuristic For Large-Scale Global Optimization

Large-scale problems are nonlinear problems that need metaheuristics, or...
research
12/11/2020

The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks

Despite their overwhelming capacity to overfit, deep neural networks tra...
research
03/01/2017

Learning to Optimize Neural Nets

Learning to Optimize is a recently proposed framework for learning optim...
research
07/19/2023

BCDDO: Binary Child Drawing Development Optimization

A lately created metaheuristic algorithm called Child Drawing Developmen...
research
08/30/2023

Ten New Benchmarks for Optimization

Benchmarks are used for testing new optimization algorithms and their va...

Please sign up or login with your details

Forgot password? Click here to reset