Ergodic Control of Diffusion Processes (Hardcover)

Ari Arapostathis

ISBN 10: 0521768403 / ISBN 13: 9780521768405

Published by Cambridge University Press, Cambridge, 2011

About this Item

Hardcover. This comprehensive volume on ergodic control for diffusions highlights intuition alongside technical arguments. A concise account of Markov process theory is followed by a complete development of the fundamental issues and formalisms in control of diffusions. This then leads to a comprehensive treatment of ergodic control, a problem that straddles stochastic control and the ergodic theory of Markov processes. The interplay between the probabilistic and ergodic-theoretic aspects of the problem, notably the asymptotics of empirical measures on one hand, and the analytic aspects leading to a characterization of optimality via the associated Hamilton-Jacobi-Bellman equation on the other, is clearly revealed. The more abstract controlled martingale problem is also presented, in addition to many other related issues and models. Assuming only graduate-level probability and analysis, the authors develop the theory in a manner that makes it accessible to users in applied mathematics, engineering, finance and operations research. This is the first comprehensive account of controlled diffusions with a focus on ergodic or 'long run average' control. Assuming only graduate-level probability and analysis, it develops the theory in a manner that makes it accessible to users in applied mathematics, engineering, finance and operations research. This item is printed on demand. Shipping may be from our UK warehouse or from our Australian or US warehouses, depending on stock availability.

Seller Inventory # 9780521768405

Bibliographic Details

• Title: Ergodic Control of Diffusion Processes (Hardcover)
• Publisher: Cambridge University Press, Cambridge
• Publication Date: 2011
• Language: English
• ISBN 10: 0521768403
• ISBN 13: 9780521768405
• Binding: Hardcover
• Condition: new

About this title

Synopsis

This comprehensive volume on ergodic control for diffusions highlights intuition alongside technical arguments. A concise account of Markov process theory is followed by a complete development of the fundamental issues and formalisms in control of diffusions. This then leads to a comprehensive treatment of ergodic control, a problem that straddles stochastic control and the ergodic theory of Markov processes. The interplay between the probabilistic and ergodic-theoretic aspects of the problem, notably the asymptotics of empirical measures on one hand, and the analytic aspects leading to a characterization of optimality via the associated Hamilton–Jacobi–Bellman equation on the other, is clearly revealed. The more abstract controlled martingale problem is also presented, in addition to many other related issues and models. Assuming only graduate-level probability and analysis, the authors develop the theory in a manner that makes it accessible to users in applied mathematics, engineering, finance and operations research.

About the Authors

Ari Arapostathis is a Professor in the Department of Electrical and Computer Engineering at the University of Texas, Austin.

Vivek S. Borkar is a Senior Professor in the School of Technology and Computer Science at the Tata Institute of Fundamental Research in Mumbai.

Mrinal K. Ghosh is a Professor in the Department of Mathematics at the Indian Institute of Science in Bangalore.