Numerical Methods for Stochastic Control Problems in Continuous Time

Harold J. Kushner and Paul G. Dupuis

ISBN 10: 0387978348 / ISBN 13: 9780387978345

Published by Springer Verlag, New York, NY, 1992

About this Item

First Edition (1992) , First Printing indicated by a complete numerical sequence. Fine: flawless; the binding is square and secure; the text is clean. Free of creased or dog-eared pages in the text. Free of underlining, hi-lighting, notations, or marginalia. Free of ownership names, dates, addresses, notations, inscriptions, stamps, or labels. Bright, crisp and clean. Virtually 'As New'. NOT a Remainder, Book-Club, or Ex-Library. 8vo. (9.55 x 6.35 x 1 inches) . 40 Illustrations in 43 parts. Language: English. Weight: 27.6 ounces. Hardback: No DJ 'as issued'. The book presents a comprehensive development of effective numerical methods for stochastic control problems in continuous time. The process models are diffusions, jump-diffusions or reflected diffusions of the type that occur in the majority of current applications. All the usual problem formulations are included, as well as those of more recent interest such as ergodic control, singular control and the types of reflected diffusions used as models of queuing networks. ; Applications of Mathematics; Vol. 24; Large 8vo 9" - 10" tall; ix, 439 pages.

Seller Inventory # 58264

Bibliographic Details

• Title: Numerical Methods for Stochastic Control Problems in Continuous Time
• Publisher: Springer Verlag, New York, NY
• Publication Date: 1992
• Language: English
• ISBN 10: 0387978348
• ISBN 13: 9780387978345
• Binding: Hardcover
• Edition: First Edition; First Printing.
• Condition: Fine
• Dust Jacket Condition: No Dust Jacket As Issued

About this title

Synopsis

The book presents a comprehensive development of effective numerical methods for stochastic control problems in continuous time. The process models are diffusions, jump-diffusions or reflected diffusions of the type that occur in the majority of current applications. All the usual problem formulations are included, as well as those of more recent interest such as ergodic control, singular control and the types of reflected diffusions used as models of queuing networks. Convergence of the numerical approximations is proved via the efficient probabilistic methods of weak convergence theory. The methods also apply to the calculation of functionals of uncontrolled processes and for the appropriate to optimal nonlinear filters as well. Applications to complex deterministic problems are illustrated via application to a large class of problems from the calculus of variations. The general approach is known as the Markov Chain Approximation Method. Essentially all that is required of the approximations are some natural local consistency conditions. The approximations are consistent with standard methods of numerical analysis. The required background in stochastic processes is surveyed, there is an extensive development of methods of approximation, and a chapter is devoted to computational techniques. The book is written on two levels, that of practice (algorithms and applications), and that of the mathematical development. Thus the methods and use should be broadly accessible.

About the Author

Harold J. Kushner is Professor of Applied Mathematics and Engineering at Brown University and is one of the leading researchers in the area of stochastic processes concerned with analysis and synthesis in control and communications theory.