Survey on Evolutionary Deep Learning: Principles, Algorithms, Applications and Open Issues

by   Nan Li, et al.
Northeastern University
Victoria University of Wellington
Bielefeld University
East China Universtiy of Science and Technology

Over recent years, there has been a rapid development of deep learning (DL) in both industry and academia fields. However, finding the optimal hyperparameters of a DL model often needs high computational cost and human expertise. To mitigate the above issue, evolutionary computation (EC) as a powerful heuristic search approach has shown significant merits in the automated design of DL models, so-called evolutionary deep learning (EDL). This paper aims to analyze EDL from the perspective of automated machine learning (AutoML). Specifically, we firstly illuminate EDL from machine learning and EC and regard EDL as an optimization problem. According to the DL pipeline, we systematically introduce EDL methods ranging from feature engineering, model generation, to model deployment with a new taxonomy (i.e., what and how to evolve/optimize), and focus on the discussions of solution representation and search paradigm in handling the optimization problem by EC. Finally, key applications, open issues and potentially promising lines of future research are suggested. This survey has reviewed recent developments of EDL and offers insightful guidelines for the development of EDL.


page 1

page 2

page 3

page 4


AutoML: A Survey of the State-of-the-Art

Deep learning has penetrated all aspects of our lives and brought us gre...

The Deep Learning Compiler: A Comprehensive Survey

The difficulty of deploying various deep learning (DL) models on diverse...

Entity Linking Meets Deep Learning: Techniques and Solutions

Entity linking (EL) is the process of linking entity mentions appearing ...

A Survey of Deep Active Learning

Active learning (AL) attempts to maximize the performance gain of the mo...

WARC-DL: Scalable Web Archive Processing for Deep Learning

Web archives have grown to petabytes. In addition to providing invaluabl...

A Survey on Large-scale Machine Learning

Machine learning can provide deep insights into data, allowing machines ...

Please sign up or login with your details

Forgot password? Click here to reset