Items related to Topics in the Constructive Theory of Countable Markov...

Topics in the Constructive Theory of Countable Markov Chains - Softcover

Fayolle, G.; Malyshev, V. A.; Menshikov, M. V.

 
9780521064477: Topics in the Constructive Theory of Countable Markov Chains
Softcover
ISBN 10: 0521064473 ISBN 13: 9780521064477
Publisher: Cambridge University Press, 2008

Synopsis

Markov chains are an important idea, related to random walks, which crops up widely in applied stochastic analysis. They are used for example in performance modeling and evaluation of computer networks, queuing networks, and telecommunication systems. The main point of the present book is to provide methods, based on the construction of Lyapunov functions, of determining when a Markov chain is ergodic, null recurrent, or transient. These methods, which are on the whole original and new, can also be extended to the study of questions of stability. Of particular concern are reflected random walks and reflected Brownian motion. Here, the authors provide a self-contained introduction to the theory and details of how the required Lyapunov functions are constructed in various situations.

"synopsis" may belong to another edition of this title.

About the Author

Rocquencourt

Review

"...collects together, for the first time, a number of important results and techniques for countable Markov chains....The writing is clear and concise....an important and valuable addition." Kyle Siegrist, Mathematical Reviews

"About this title" may belong to another edition of this title.

Publisher
Cambridge University Press
Publication date
2008
Language
English
ISBN 10 
0521064473
ISBN 13 
9780521064477
Binding
Paperback
Edition number
1
Number of pages
180