Optimization and Learning via Stochastic Gradient Search

Bernd Heidergott

ISBN 10: 069124586X / ISBN 13: 9780691245867

Published by Princeton University Press Okt 2025, 2025

About this Item

Neuware - An introduction to gradient-based stochastic optimization that integrates theory and implementationThis book explains gradient-based stochastic optimization, exploiting the methodologies of stochastic approximation and gradient estimation. Although the approach is theoretical, the book emphasizes developing algorithms that implement the methods. The underlying philosophy of this book is that when solving real problems, mathematical theory, the art of modeling, and numerical algorithms complement each other, with no one outlook dominating the others. The book first covers the theory of stochastic approximation including advanced models and state-of-the-art analysis methodology, treating applications that do not require the use of gradient estimation. It then presents gradient estimation, developing a modern approach that incorporates cutting-edge numerical algorithms. Finally, the book culminates in a rich set of case studies that integrate the concepts previously discussed into fully worked models. The use of stochastic approximation in statistics and machine learning is discussed, and in-depth theoretical treatments for selected gradient estimation approaches are included. Numerous examples show how the methods are applied concretely, and end-of-chapter exercises enable readers to consolidate their knowledge. Many chapters end with a section on 'Practical Considerations' that addresses typical tradeoffs encountered in implementation. The book provides the first unified treatment of the topic, written for a wide audience that includes researchers and graduate students in applied mathematics, engineering, computer science, physics, and economics.

Seller Inventory # 9780691245867

Bibliographic Details

• Title: Optimization and Learning via Stochastic Gradient Search
• Publisher: Princeton University Press Okt 2025
• Publication Date: 2025
• Language: English
• ISBN 10: 069124586X
• ISBN 13: 9780691245867
• Binding: Buch
• Condition: Neu
• Dimensions: 260W x 189H x 32D millimeters 260 millimeters width by 189 millimeters height by 32 millimeters depth
• Weight: 999 grams

About this title

Synopsis

An introduction to gradient-based stochastic optimization that integrates theory and implementation

This book explains gradient-based stochastic optimization, exploiting the methodologies of stochastic approximation and gradient estimation. Although the approach is theoretical, the book emphasizes developing algorithms that implement the methods. The underlying philosophy of this book is that when solving real problems, mathematical theory, the art of modeling, and numerical algorithms complement each other, with no one outlook dominating the others.

The book first covers the theory of stochastic approximation including advanced models and state-of-the-art analysis methodology, treating applications that do not require the use of gradient estimation. It then presents gradient estimation, developing a modern approach that incorporates cutting-edge numerical algorithms. Finally, the book culminates in a rich set of case studies that integrate the concepts previously discussed into fully worked models. The use of stochastic approximation in statistics and machine learning is discussed, and in-depth theoretical treatments for selected gradient estimation approaches are included.

Numerous examples show how the methods are applied concretely, and end-of-chapter exercises enable readers to consolidate their knowledge. Many chapters end with a section on “Practical Considerations” that addresses typical tradeoffs encountered in implementation. The book provides the first unified treatment of the topic, written for a wide audience that includes researchers and graduate students in applied mathematics, engineering, computer science, physics, and economics.

About the Author

Felisa Vázquez-Abad is professor of computer science at City University of New York and principal investigator in the School of Computing and Information Systems at the University of Melbourne. Bernd Heidergott is professor of stochastic optimization in the Department of Operations Analytics at the School of Business and Economics and research fellow at Tinbergen Institute, Amsterdam.