Noisy Optimization: Convergence with a Fixed Number of Resamplings

04/09/2014
by   Marie-Liesse Cauwet, et al.
0

It is known that evolution strategies in continuous domains might not converge in the presence of noise. It is also known that, under mild assumptions, and using an increasing number of resamplings, one can mitigate the effect of additive noise and recover convergence. We show new sufficient conditions for the convergence of an evolutionary algorithm with constant number of resamplings; in particular, we get fast rates (log-linear convergence) provided that the variance decreases around the optimum slightly faster than in the so-called multiplicative noise model. Keywords: Noisy optimization, evolutionary algorithm, theory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2012

Sufficient conditions for convergence of Loopy Belief Propagation

We derive novel sufficient conditions for convergence of Loopy Belief Pr...
research
04/30/2015

Average Convergence Rate of Evolutionary Algorithms

In evolutionary optimization, it is important to understand how fast evo...
research
03/01/2023

Pathwise Uniform Convergence of Time Discretisation Schemes for SPDEs

In this paper we prove convergence rates for time discretisation schemes...
research
08/31/2023

A Note on Randomized Kaczmarz Algorithm for Solving Doubly-Noisy Linear Systems

Large-scale linear systems, Ax=b, frequently arise in practice and deman...
research
08/20/2011

Convergence of a Recombination-Based Elitist Evolutionary Algorithm on the Royal Roads Test Function

We present an analysis of the performance of an elitist Evolutionary alg...
research
11/20/2013

Analyzing Evolutionary Optimization in Noisy Environments

Many optimization tasks have to be handled in noisy environments, where ...
research
07/08/2018

A New Noise-Assistant LMS Algorithm for Preventing the Stalling Effect

In this paper, we introduce a new algorithm to deal with the stalling ef...

Please sign up or login with your details

Forgot password? Click here to reset