High dimensions and heavy tails for natural evolution strategies

Tom Schaul, Tobias Glasmachers, Jürgen Schmidhuber

Research output: Chapter in Book/Report/Conference proceedingConference contribution

81 Scopus citations

Abstract

The family of natural evolution strategies (NES) offers a principled approach to real-valued evolutionary optimization. NES follows the natural gradient of the expected fitness on the parameters of its search distribution. While general in its formulation, previous research has focused on multivariate Gaussian search distributions. Here we exhibit problem classes for which other search distributions are more appropriate, and then derive corresponding NES-variants. First, for separable distributions we obtain SNES, whose complexity is only O(d) instead of O(d 3). We apply SNES to problems of previously unattainable dimensionality, recovering lowest-energy structures on the Lennard-Jones atom clusters, and obtaining state-of-the-art results on neuro-evolution benchmarks. Second, we develop a new, equivalent formulation based on invariances. This allows for generalizing NES to heavy-tailed distributions, even those with undefined variance, which aids in overcoming deceptive local optima. Copyright 2011 ACM.
Original languageEnglish (US)
Title of host publicationGenetic and Evolutionary Computation Conference, GECCO'11
Pages845-852
Number of pages8
DOIs
StatePublished - Aug 24 2011
Externally publishedYes

Fingerprint

Dive into the research topics of 'High dimensions and heavy tails for natural evolution strategies'. Together they form a unique fingerprint.

Cite this