Ilya Loshchilov | DeepAI

AI Chat

Featured Co-authors

Frank Hutter
116 publications
Marc Schoenauer
41 publications
Tobias Glasmachers
33 publications
Michèle Sebag
25 publications
Nikolaus Hansen
14 publications
Hans-Georg Beyer
7 publications
Patryk Chrabaszcz
5 publications

∙ 02/24/2018

Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari

Evolution Strategies (ES) have recently been demonstrated to be a viable...

0 Patryk Chrabaszcz, et al. ∙

∙ 11/14/2017

Fixing Weight Decay Regularization in Adam

We note that common implementations of adaptive gradient algorithms, suc...

0 Ilya Loshchilov, et al. ∙

∙ 07/27/2017

A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets

The original ImageNet dataset is a popular large-scale benchmark for tra...

0 Patryk Chrabaszcz, et al. ∙

∙ 05/18/2017

Limited-Memory Matrix Adaptation for Large Scale Black-box Optimization

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is a popula...

0 Ilya Loshchilov, et al. ∙

∙ 08/13/2016

SGDR: Stochastic Gradient Descent with Warm Restarts

Restart techniques are common in gradient-free optimization to deal with...

0 Ilya Loshchilov, et al. ∙

∙ 05/09/2016

Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)

We propose a multi-objective optimization algorithm aimed at achieving g...

0 Ilya Loshchilov, et al. ∙

∙ 04/25/2016

CMA-ES for Hyperparameter Optimization of Deep Neural Networks

Hyperparameters of deep neural networks are often optimized by grid sear...

0 Ilya Loshchilov, et al. ∙

∙ 11/19/2015

Online Batch Selection for Faster Training of Neural Networks

Deep neural networks are commonly trained using stochastic non-convex op...

0 Ilya Loshchilov, et al. ∙

∙ 11/01/2015

LM-CMA: an Alternative to L-BFGS for Large Scale Black-box Optimization

The limited memory BFGS method (L-BFGS) of Liu and Nocedal (1989) is oft...

0 Ilya Loshchilov, et al. ∙

∙ 06/10/2014

Maximum Likelihood-based Online Adaptation of Hyper-parameters in CMA-ES

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely a...

0 Ilya Loshchilov, et al. ∙

∙ 04/21/2014

A Computationally Efficient Limited Memory CMA-ES for Large Scale Optimization

We propose a computationally efficient limited memory Covariance Matrix ...

0 Ilya Loshchilov, et al. ∙

∙ 08/12/2013

KL-based Control of the Learning Schedule for Surrogate Black-Box Optimization

This paper investigates the control of an ML component within the Covari...

0 Ilya Loshchilov, et al. ∙

∙ 07/01/2012

Alternative Restart Strategies for CMA-ES

This paper focuses on the restart strategy of CMA-ES on multi-modal func...

0 Ilya Loshchilov, et al. ∙

∙ 04/24/2012

Black-box optimization benchmarking of IPOP-saACM-ES and BIPOP-saACM-ES on the BBOB-2012 noiseless testbed

In this paper, we study the performance of IPOP-saACM-ES and BIPOP-saACM...

0 Ilya Loshchilov, et al. ∙

∙ 04/24/2012

Black-box optimization benchmarking of IPOP-saACM-ES on the BBOB-2012 noisy testbed

In this paper, we study the performance of IPOP-saACM-ES, recently propo...

0 Ilya Loshchilov, et al. ∙

∙ 04/11/2012

Self-Adaptive Surrogate-Assisted Covariance Matrix Adaptation Evolution Strategy

This paper presents a novel mechanism to adapt surrogate-assisted popula...

0 Ilya Loshchilov, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world