Markov Chains: Models, Algorithms and Applications (International Series in Operations Research & Management Science)

4 avg rating
( 2 ratings by Goodreads )
 
9781461463115: Markov Chains: Models, Algorithms and Applications (International Series in Operations Research & Management Science)
View all copies of this ISBN edition:
 
 

This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with end-of-chapter exercises, a new focus on management science, new applications of the models, and new examples with applications in financial risk management and modeling of financial data.

This book consists of eight chapters.  Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods for solving linear systems will be introduced for finding the stationary distribution of a Markov chain. The chapter then covers the basic theories and algorithms for hidden Markov models (HMMs) and Markov decision processes (MDPs).

Chapter 2 discusses the applications of continuous time Markov chains to model queueing systems and discrete time Markov chain for computing the PageRank, the ranking of websites on the Internet. Chapter 3 studies Markovian models for manufacturing and re-manufacturing systems and presents closed form solutions and fast numerical algorithms for solving the captured systems. In Chapter 4, the authors present a simple hidden Markov model (HMM) with fast numerical algorithms for estimating the model parameters. An application of the HMM for customer classification is also presented.


Chapter 5 discusses Markov decision processes for customer lifetime values. Customer Lifetime Values (CLV) is an important concept and quantity in marketing management. The authors present an approach based on Markov decision processes for the calculation of CLV using real data.

Chapter 6 considers higher-order Markov chain models, particularly a class of parsimonious higher-order Markov chain models. Efficient estimation methods for model parameters based on linear programming are presented. Contemporary research results on applications to demand predictions, inventory control and financial risk measurement are also presented. In Chapter 7, a class of parsimonious multivariate Markov models is introduced. Again, efficient estimation methods based on linear programming are presented. Applications to demand predictions, inventory control policy and modeling credit ratings data are discussed. Finally, Chapter 8 re-visits hidden Markov models, and the authors present a new class of hidden Markov models with efficient algorithms for estimating the model parameters. Applications to modeling interest rates, credit ratings and default data are discussed.
 
This book is aimed at senior undergraduate students, postgraduate students, professionals, practitioners, and researchers in applied mathematics, computational science, operational research, management science and finance, who are interested in the formulation and computation of queueing networks, Markov chain models and related topics. Readers are expected to have some basic knowledge of probability theory, Markov processes and matrix theory.

"synopsis" may belong to another edition of this title.

Review:

From the reviews of the First Edition:

"The authors outline recent developments of Markov chain models ... . This book is aimed at students, professionals, practitioners, and researchers in scientific computing and operational research, who are interested in the formulation and computation of queuing and manufacturing systems. It gives a number of useful tools for researchers in real applications ... ." (Alexander I. Zejfman, Zentralblatt MATH, Vol. 1089 (15), 2006)

"In this book’s ... essential notions on Markov chains, hidden Markov models, and Markov decision processes are covered, with special emphasis on iterative methods for solving linear systems. ... Each chapter finishes with a short summary and sometimes a selection of open problems. ... This book is intended for students and researchers in applied mathematics, scientific computing, and operations research ... . Overall, this book offers much interesting and up-to-date material on a wide variety of topics, dealing with finite-space Markov processes." (Jozef L. Teugels, Journal of the American Statistical Association, Vol. 103 (483), September, 2008)

"About this title" may belong to another edition of this title.

Buy New View Book
List Price: US$ 139.99
US$ 115.05

Convert currency

Shipping: FREE
From United Kingdom to U.S.A.

Destination, rates & speeds

Add to Basket

Other Popular Editions of the Same Title

9781489997524: Markov Chains: Models, Algorithms and Applications (International Series in Operations Research & Management Science)

Featured Edition

ISBN 10:  1489997520 ISBN 13:  9781489997524
Publisher: Springer, 2015
Softcover

Top Search Results from the AbeBooks Marketplace

1.

Wai-Ki Ching, Ximin Huang, Michael K. Ng
Published by Springer-Verlag New York Inc., United States (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Hardcover Quantity Available: 1
Seller:
The Book Depository
(London, United Kingdom)
Rating
[?]

Book Description Springer-Verlag New York Inc., United States, 2013. Hardback. Condition: New. 2nd ed. 2013. Language: English . Brand New Book. This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with end-of-chapter exercises, a new focus on management science, new applications of the models, and new examples with applications in financial risk management and modeling of financial data. This book consists of eight chapters. Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods for solving linear systems will be introduced for finding the stationary distribution of a Markov chain. The chapter then covers the basic theories and algorithms for hidden Markov models (HMMs) and Markov decision processes (MDPs). Chapter 2 discusses the applications of continuous time Markov chains to model queueing systems and discrete time Markov chain for computing the PageRank, the ranking of websites on the Internet. Chapter 3 studies Markovian models for manufacturing and re-manufacturing systems and presents closed form solutions and fast numerical algorithms for solving the captured systems. In Chapter 4, the authors present a simple hidden Markov model (HMM) with fast numerical algorithms for estimating the model parameters. An application of the HMM for customer classification is also presented. Chapter 5 discusses Markov decision processes for customer lifetime values. Customer Lifetime Values (CLV) is an important concept and quantity in marketing management. The authors present an approach based on Markov decision processes for the calculation of CLV using real data. Chapter 6 considers higher-order Markov chain models, particularly a class of parsimonious higher-order Markov chain models. Efficient estimation methods for model parameters based on linear programming are presented. Contemporary research results on applications to demand predictions, inventory control and financial risk measurement are also presented. In Chapter 7, a class of parsimonious multivariate Markov models is introduced. Again, efficient estimation methods based on linear programming are presented. Applications to demand predictions, inventory control policy and modeling credit ratings data are discussed. Finally, Chapter 8 re-visits hidden Markov models, and the authors present a new class of hidden Markov models with efficient algorithms for estimating the model parameters. Applications to modeling interest rates, credit ratings and default data are discussed. This book is aimed at senior undergraduate students, postgraduate students, professionals, practitioners, and researchers in applied mathematics, computational science, operational research, management science and finance, who are interested in the formulation and computation of queueing networks, Markov chain models and related topics. Readers are expected to have some basic knowledge of probability theory, Markov processes and matrix theory. Seller Inventory # SPR9781461463115

More information about this seller | Contact this seller

Buy New
US$ 115.05
Convert currency

Add to Basket

Shipping: FREE
From United Kingdom to U.S.A.
Destination, rates & speeds

2.

Wai-Ki Ching (author), Ximin Huang (author), Michael K. Ng (author), Tak-Kuen Siu (author)
Published by Springer US 2013-03-28, New York, N.Y. (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Hardcover Quantity Available: > 20
Seller:
Blackwell's
(Oxford, OX, United Kingdom)
Rating
[?]

Book Description Springer US 2013-03-28, New York, N.Y., 2013. hardback. Condition: New. Seller Inventory # 9781461463115

More information about this seller | Contact this seller

Buy New
US$ 114.32
Convert currency

Add to Basket

Shipping: US$ 9.79
From United Kingdom to U.S.A.
Destination, rates & speeds

3.

Wai-Ki Ching, Ximin Huang, Michael K. Ng
Published by Springer-Verlag New York Inc., United States (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Hardcover Quantity Available: 1
Seller:
Book Depository International
(London, United Kingdom)
Rating
[?]

Book Description Springer-Verlag New York Inc., United States, 2013. Hardback. Condition: New. 2nd ed. 2013. Language: English . Brand New Book. This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with end-of-chapter exercises, a new focus on management science, new applications of the models, and new examples with applications in financial risk management and modeling of financial data. This book consists of eight chapters. Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods for solving linear systems will be introduced for finding the stationary distribution of a Markov chain. The chapter then covers the basic theories and algorithms for hidden Markov models (HMMs) and Markov decision processes (MDPs). Chapter 2 discusses the applications of continuous time Markov chains to model queueing systems and discrete time Markov chain for computing the PageRank, the ranking of websites on the Internet. Chapter 3 studies Markovian models for manufacturing and re-manufacturing systems and presents closed form solutions and fast numerical algorithms for solving the captured systems. In Chapter 4, the authors present a simple hidden Markov model (HMM) with fast numerical algorithms for estimating the model parameters. An application of the HMM for customer classification is also presented. Chapter 5 discusses Markov decision processes for customer lifetime values. Customer Lifetime Values (CLV) is an important concept and quantity in marketing management. The authors present an approach based on Markov decision processes for the calculation of CLV using real data. Chapter 6 considers higher-order Markov chain models, particularly a class of parsimonious higher-order Markov chain models. Efficient estimation methods for model parameters based on linear programming are presented. Contemporary research results on applications to demand predictions, inventory control and financial risk measurement are also presented. In Chapter 7, a class of parsimonious multivariate Markov models is introduced. Again, efficient estimation methods based on linear programming are presented. Applications to demand predictions, inventory control policy and modeling credit ratings data are discussed. Finally, Chapter 8 re-visits hidden Markov models, and the authors present a new class of hidden Markov models with efficient algorithms for estimating the model parameters. Applications to modeling interest rates, credit ratings and default data are discussed. This book is aimed at senior undergraduate students, postgraduate students, professionals, practitioners, and researchers in applied mathematics, computational science, operational research, management science and finance, who are interested in the formulation and computation of queueing networks, Markov chain models and related topics. Readers are expected to have some basic knowledge of probability theory, Markov processes and matrix theory. Seller Inventory # SPR9781461463115

More information about this seller | Contact this seller

Buy New
US$ 124.49
Convert currency

Add to Basket

Shipping: FREE
From United Kingdom to U.S.A.
Destination, rates & speeds

4.

Ching, Wai-Ki
Published by Springer-Verlag New York Inc. (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Quantity Available: 5
Seller:
Books2Anywhere
(Fairford, GLOS, United Kingdom)
Rating
[?]

Book Description Springer-Verlag New York Inc., 2013. HRD. Condition: New. New Book. Shipped from UK in 4 to 14 days. Established seller since 2000. Seller Inventory # S0-9781461463115

More information about this seller | Contact this seller

Buy New
US$ 116.93
Convert currency

Add to Basket

Shipping: US$ 11.75
From United Kingdom to U.S.A.
Destination, rates & speeds

5.

Wai-Ki Ching
Published by Springer (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Quantity Available: > 20
Print on Demand
Seller:
Pbshop
(Wood Dale, IL, U.S.A.)
Rating
[?]

Book Description Springer, 2013. HRD. Condition: New. New Book. Shipped from US within 10 to 14 business days. THIS BOOK IS PRINTED ON DEMAND. Established seller since 2000. Seller Inventory # IQ-9781461463115

More information about this seller | Contact this seller

Buy New
US$ 125.85
Convert currency

Add to Basket

Shipping: US$ 3.99
Within U.S.A.
Destination, rates & speeds

6.

Ching, Wai-KI
Published by Springer (2016)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Paperback Quantity Available: 1
Print on Demand
Seller:
Ria Christie Collections
(Uxbridge, United Kingdom)
Rating
[?]

Book Description Springer, 2016. Paperback. Condition: New. PRINT ON DEMAND Book; New; Publication Year 2016; Not Signed; Fast Shipping from the UK. No. book. Seller Inventory # ria9781461463115_lsuk

More information about this seller | Contact this seller

Buy New
US$ 136.69
Convert currency

Add to Basket

Shipping: US$ 5.05
From United Kingdom to U.S.A.
Destination, rates & speeds

7.

Wai-KI Ching; Ximin Huang; Michael K. Ng
Published by Springer (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Hardcover Quantity Available: 1
Seller:
Rating
[?]

Book Description Springer, 2013. Condition: New. Seller Inventory # L9781461463115

More information about this seller | Contact this seller

Buy New
US$ 139.74
Convert currency

Add to Basket

Shipping: US$ 3.45
From Germany to U.S.A.
Destination, rates & speeds

8.

WAI-KI CHING
Published by Springer (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Hardcover Quantity Available: 1
Seller:
Herb Tandree Philosophy Books
(Stroud, GLOS, United Kingdom)
Rating
[?]

Book Description Springer, 2013. Hardback. Condition: NEW. 9781461463115 This listing is a new book, a title currently in-print which we order directly and immediately from the publisher. For all enquiries, please contact Herb Tandree Philosophy Books directly - customer service is our primary goal. Seller Inventory # HTANDREE0305657

More information about this seller | Contact this seller

Buy New
US$ 134.50
Convert currency

Add to Basket

Shipping: US$ 10.42
From United Kingdom to U.S.A.
Destination, rates & speeds

9.

Wai-Ki Ching; Ximin Huang; Michael K. Ng; Tak-Kuen Siu
Published by Springer (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Hardcover Quantity Available: 1
Seller:
Irish Booksellers
(Portland, ME, U.S.A.)
Rating
[?]

Book Description Springer, 2013. Condition: New. book. Seller Inventory # M1461463114

More information about this seller | Contact this seller

Buy New
US$ 148.13
Convert currency

Add to Basket

Shipping: US$ 3.27
Within U.S.A.
Destination, rates & speeds

10.

Wai-Ki Ching
Published by Springer-Verlag Gmbh Mrz 2013 (2013)
ISBN 10: 1461463114 ISBN 13: 9781461463115
New Quantity Available: 1
Seller:
Rating
[?]

Book Description Springer-Verlag Gmbh Mrz 2013, 2013. Buch. Condition: Neu. Neuware - This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with end-of-chapter exercises, a new focus on management science, new applications of the models, and new examples with applications in financial risk management and modeling of financial data. This book consists of eight chapters. Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods for solving linear systems will be introduced for finding the stationary distribution of a Markov chain. The chapter then covers the basic theories and algorithms for hidden Markov models (HMMs) and Markov decision processes (MDPs). Chapter 2 discusses the applications of continuous time Markov chains to model queueing systems and discrete time Markov chain for computing the PageRank, the ranking of websites on the Internet. Chapter 3 studies Markovian models for manufacturing and re-manufacturing systems and presents closed form solutions and fast numerical algorithms for solving the captured systems. In Chapter 4, the authors present a simple hidden Markov model (HMM) with fast numerical algorithms for estimating the model parameters. An application of the HMM for customer classification is also presented. Chapter 5 discusses Markov decision processes for customer lifetime values. Customer Lifetime Values (CLV) is an important concept and quantity in marketing management. The authors present an approach based on Markov decision processes for the calculation of CLV using real data. Chapter 6 considers higher-order Markov chain models, particularly a class of parsimonious higher-order Markov chain models. Efficient estimation methods for model parameters based on linear programming are presented. Contemporary research results on applications to demand predictions, inventory control and financial risk measurement are also presented. In Chapter 7, a class of parsimonious multivariate Markov models is introduced. Again, efficient estimation methods based on linear programming are presented. Applications to demand predictions, inventory control policy and modeling credit ratings data are discussed. Finally, Chapter 8 re-visits hidden Markov models, and the authors present a new class of hidden Markov models with efficient algorithms for estimating the model parameters. Applications to modeling interest rates, credit ratings and default data are discussed. This book is aimed at senior undergraduate students, postgraduate students, professionals, practitioners, and researchers in applied mathematics, computational science, operational research, management science and finance, who are interested in the formulation and computation of queueing networks, Markov chain models and related topics. Readers are expected to have some basic knowledge of probability theory, Markov processes and matrix theory. 243 pp. Englisch. Seller Inventory # 9781461463115

More information about this seller | Contact this seller

Buy New
US$ 139.74
Convert currency

Add to Basket

Shipping: US$ 13.83
From Germany to U.S.A.
Destination, rates & speeds

There are more copies of this book

View all search results for this book