This text presents selected applications of discrete-time stochastic processes that involve random interactions and algorithms, and revolve around the Markov property. It covers recurrence properties of (excited) random walks, convergence and mixing of Markov chains, distribution modeling using phase-type distributions, applications to search engines and probabilistic automata, and an introduction to the Ising model used in statistical physics. Applications to data science are also considered via hidden Markov models and Markov decision processes. A total of 32 exercises and 17 longer problems are provided with detailed solutions and cover various topics of interest, including statistical learning.

About the Author

Nicolas Privault received a PhD degree from the University of Paris VI, France. He was with the University of Evry, France, the University of La Rochelle, France, and the University of Poitiers, France. He is currently a Professor with the School of Physical and Mathematical Sciences, Nanyang Technological University, Singapore. His research interests are in the areas of stochastic analysis and its applications.

"About this title" may belong to another edition of this title.

Store Description

We sell Brand New University Textbooks to students at very affordable prices. All orders are shipped by Trackable methods only and the tracking number is available within 48 hours of placing the order. We also offer free shipping to USA, Canada and Europe and lowest shipping charges in other countries. We have multiple warehouses to save on the transit time.

Visit Seller's Storefront

Seller's business information

SMASS Group LLC
1944 Loma Linda Dr, Irving, TX, 75063, U.S.A.

Sale & Shipping Terms

Terms of Sale

We sell Brand New Textbooks requied for studies in the Univesity. We have been in this business for the past 14 years and we know how to keep our customers happy and satisfies by providing them the required course material and the most affordable prices.

Shipping Terms

We ship all orders from our Multiple warehouses by Tracakble method only. We have tie up with Fedex, DHL, UPS and USPS for our logistics requirements. All tracking numbers are available within 48 hours of processing the order.

Shipping rates within U.S.A.

Shipping rates within U.S.A.
Order quantity	5 to 10 business days	3 to 6 business days
First item	US$ 0.00	US$ 0.00

Delivery times are set by sellers and vary by carrier and location. Orders passing through Customs may face delays and buyers are responsible for any associated duties or fees. Sellers may contact you regarding additional charges to cover any increased costs to ship your items.