Optimization, Control, and Applications of Stochastic Systems

This volume provides a general overview of discrete- and continuous-time Markov control processes and stochastic games, along with a look at the range of applications of stochastic control and some of its recent theoretical developments. These topics include various aspects of dynamic programming, approximation algorithms, and infinite-dimensional linear programming. In all, the work comprises 18 carefully selected papers written by experts in their respective fields.

Optimization, Control, and Applications of Stochastic Systems will be a valuable resource for all practitioners, researchers, and professionals in applied mathematics and operations research who work in the areas of stochastic control, mathematical finance, queueing theory, and inventory systems. It may also serve as a supplemental text for graduate courses in optimal control and dynamic games.

Compiled in honor of Onésimo Hernández-Lerma, this volume offers a broad presentation of the main concepts, techniques, and methodologies in the fields of optimization and control of stochastic systems. At the same time, the book provides an overview of their wide-ranging applications and theoretical developments. These topics include various aspects of dynamic programming, discounted and average optimality criteria for discrete- and continuous-time control processes, approximation algorithms, optimal stopping, and games.

The work comprises 18 carefully selected papers written by experts in their respective fields, and explores five major themes:

* discrete-time Markov control processes;
* several optimality criteria;
* applications in inventory systems and finance;
* stochastic optimal control problems for diffusion;
* optimization.

This book will be a valuable resource for all practitioners, researchers, and professionals in applied mathematics and operations research who work in the areas of stochastic control, mathematical finance, queueing theory, and inventory systems. It may also serve as a supplemental text for graduate courses in optimal control and its applications.