Controlled Diffusion Processes (Stochastic Modelling and Applied Probability, 14) - Softcover

Nikolai Vladimirovich Krylov

Softcover

ISBN 10: 3540709134 ISBN 13: 9783540709138

Publisher: Springer, 2008

Synopsis

Stochastic control theory is a relatively young branch of mathematics. The beginning of its intensive development falls in the late 1950s and early 1960s. ~urin~ that period an extensive literature appeared on optimal stochastic control using the quadratic performance criterion (see references in Wonham [76]). At the same time, Girsanov [25] and Howard [26] made the first steps in constructing a general theory, based on Bellman's technique of dynamic programming, developed by him somewhat earlier [4]. Two types of engineering problems engendered two different parts of stochastic control theory. Problems of the first type are associated with multistep decision making in discrete time, and are treated in the theory of discrete stochastic dynamic programming. For more on this theory, we note in addition to the work of Howard and Bellman, mentioned above, the books by Derman [8], Mine and Osaki [55], and Dynkin and Yushkevich [12]. Another class of engineering problems which encouraged the development of the theory of stochastic control involves time continuous control of a dynamic system in the presence of random noise. The case where the system is described by a differential equation and the noise is modeled as a time continuous random process is the core of the optimal control theory of diffusion processes. This book deals with this latter theory.

About this title

From the Back Cover

This book deals with the optimal control of solutions of fully observable Itô-type stochastic differential equations. The validity of the Bellman differential equation for payoff functions is proved and rules for optimal control strategies are developed.

Topics include optimal stopping; one dimensional controlled diffusion; the Lp-estimates of stochastic integral distributions; the existence theorem for stochastic equations; the Itô formula for functions; and the Bellman principle, equation, and normalized equation.

Review

From the reviews:

“The book treats a large class of fully nonlinear parabolic PDEs via probabilistic methods. ... The monograph may be strongly recommended as an excellent reading to PhD students, postdocs et al working in the area of controlled stochastic processes and/or nonlinear partial differential equations of the second order. ... recommended to a wider audience of all students specializing in stochastic analysis or stochastic finance starting from MSc level.” (Alexander Yu Veretennikov, Zentralblatt MATH, Vol. 1171, 2009)

Edition details

• Publisher: Springer
• Publication date: 2008
• ISBN 10: 3540709134
• ISBN 13: 9783540709138
• Binding: Paperback
• Language: English
• Number of pages: 322