General-Purpose Optimization Through Information Maximization

Alan J. Lockett

ISBN 10: 3662620065 / ISBN 13: 9783662620069

Published by Springer Berlin Heidelberg Aug 2020, 2020

About this Item

This item is printed on demand - it takes 3-4 days longer - Neuware -This book examines the mismatch betweendiscrete programs,which lie at the center ofmodern applied mathematics, and the continuous space phenomena they simulate. The author considers whether we can imagine continuous spacesof programs, and asks what thestructure of such spaceswould beand how they would beconstituted. He proposesa functional analysisof program spaces focused through the lens of iterative optimization.The author begins with the observation that optimization methods such as Genetic Algorithms, Evolution Strategies, and Particle Swarm Optimization can be analyzed as Estimation of Distributions Algorithms (EDAs) in that they can be formulated as conditional probability distributions. The probabilities themselves are mathematical objects that can be compared and operated on, and thus many methods in Evolutionary Computation can be placed in a shared vector space and analyzed using techniques of functional analysis. The core ideas of this book expand from that concept, eventually incorporating all iterative stochastic search methods, including gradient-based methods. Inspired by work on Randomized Search Heuristics, the author covers all iterative optimization methods and not just evolutionary methods. The No Free Lunch Theorem is viewed as a useful introduction to the broader field of analysis that comes from developing a shared mathematical space for optimization algorithms. The author brings in intuitions from several branches of mathematics such as topology, probability theory, and stochastic processes and provides substantial background material to make the work as self-contained as possible.The book will be valuable for researchers in the areas of global optimization, machine learning, evolutionary theory, and control theory. 580 pp. Englisch.

Seller Inventory # 9783662620069

Bibliographic Details

• Title: General-Purpose Optimization Through Information Maximization
• Publisher: Springer Berlin Heidelberg Aug 2020
• Publication Date: 2020
• Language: English
• ISBN 10: 3662620065
• ISBN 13: 9783662620069
• Binding: Buch
• Condition: Neu
• Dimensions: 241W x 160H x 37D millimeters 241 millimeters width by 160 millimeters height by 37 millimeters depth
• Weight: 1027 grams

About this title

Synopsis

This book examines the mismatch between discrete programs, which lie at the center of modern applied mathematics, and the continuous space phenomena they simulate. The author considers whether we can imagine continuous spaces of programs, and asks what the structure of such spaces would be and how they would be constituted. He proposes a functional analysis of program spaces focused through the lens of iterative optimization.

The author begins with the observation that optimization methods such as Genetic Algorithms, Evolution Strategies, and Particle Swarm Optimization can be analyzed as Estimation of Distributions Algorithms (EDAs) in that they can be formulated as conditional probability distributions. The probabilities themselves are mathematical objects that can be compared and operated on, and thus many methods in Evolutionary Computation can be placed in a shared vector space and analyzed using techniques of functionalanalysis. The core ideas of this book expand from that concept, eventually incorporating all iterative stochastic search methods, including gradient-based methods. Inspired by work on Randomized Search Heuristics, the author covers all iterative optimization methods and not just evolutionary methods. The No Free Lunch Theorem is viewed as a useful introduction to the broader field of analysis that comes from developing a shared mathematical space for optimization algorithms. The author brings in intuitions from several branches of mathematics such as topology, probability theory, and stochastic processes and provides substantial background material to make the work as self-contained as possible.

The book will be valuable for researchers in the areas of global optimization, machine learning, evolutionary theory, and control theory.

About the Author

Alan J. Lockett received his PhD in 2012 at the University of Texas at Austin under the supervision of Risto Miikkulainen, where his research topics included estimation of temporal probabilistic models, evolutionary computation theory, and learning neural network controllers for robotics. After a postdoc in IDSIA (Lugano) with Jürgen Schmidhuber he now works for CS Disco in Houston.