Constrained Markov Decision Processes (Stochastic Modeling Series)

0 avg rating
( 0 ratings by Goodreads )
 
9780849303821: Constrained Markov Decision Processes (Stochastic Modeling Series)

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction.
The book is then divided into three sections that build upon each other.
The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques.
In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework.
The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given.

"synopsis" may belong to another edition of this title.

Review:

"an outstanding addition to the MDPs literature and it complements." tstanding addition to the MDPs literature and it complements."

"About this title" may belong to another edition of this title.

Top Search Results from the AbeBooks Marketplace

1.

Altman, Eitan
Published by Chapman and Hall/CRC (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover Quantity Available: 2
Seller:
Murray Media
(North Miami Beach, FL, U.S.A.)
Rating
[?]

Book Description Chapman and Hall/CRC, 1999. Hardcover. Book Condition: New. Never used!. Bookseller Inventory # P110849303826

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 88.98
Convert Currency

Add to Basket

Shipping: US$ 1.99
Within U.S.A.
Destination, Rates & Speeds

2.

Etan Altman
Published by Taylor Francis Ltd, United States (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover Quantity Available: 1
Seller:
The Book Depository US
(London, United Kingdom)
Rating
[?]

Book Description Taylor Francis Ltd, United States, 1999. Hardback. Book Condition: New. Language: English . Brand New Book. This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given. Bookseller Inventory # AA69780849303821

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 142.49
Convert Currency

Add to Basket

Shipping: FREE
From United Kingdom to U.S.A.
Destination, Rates & Speeds

3.

Etan Altman
Published by Taylor Francis Ltd, United States (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover Quantity Available: 1
Seller:
The Book Depository
(London, United Kingdom)
Rating
[?]

Book Description Taylor Francis Ltd, United States, 1999. Hardback. Book Condition: New. Language: English . Brand New Book. This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given. Bookseller Inventory # AA69780849303821

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 144.51
Convert Currency

Add to Basket

Shipping: FREE
From United Kingdom to U.S.A.
Destination, Rates & Speeds

4.

Eitan Altman
Published by Chapman and Hall/CRC (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Quantity Available: 9
Seller:
Books2Anywhere
(Fairford, GLOS, United Kingdom)
Rating
[?]

Book Description Chapman and Hall/CRC, 1999. HRD. Book Condition: New. New Book. Shipped from UK in 4 to 14 days. Established seller since 2000. Bookseller Inventory # FT-9780849303821

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 136.23
Convert Currency

Add to Basket

Shipping: US$ 11.97
From United Kingdom to U.S.A.
Destination, Rates & Speeds

5.

Altman, Eitan
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Quantity Available: 2
Seller:
Paperbackshop-US
(Wood Dale, IL, U.S.A.)
Rating
[?]

Book Description 1999. HRD. Book Condition: New. New Book. Shipped from US within 10 to 14 business days. Established seller since 2000. Bookseller Inventory # VT-9780849303821

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 153.20
Convert Currency

Add to Basket

Shipping: US$ 3.99
Within U.S.A.
Destination, Rates & Speeds

6.

Etan Altman
Published by Taylor & Francis Ltd 1999-03-30 (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover Quantity Available: 1
Seller:
Blackwell's
(Oxford, OX, United Kingdom)
Rating
[?]

Book Description Taylor & Francis Ltd 1999-03-30, 1999. hardback. Book Condition: New. Bookseller Inventory # 9780849303821

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 154.65
Convert Currency

Add to Basket

Shipping: US$ 7.97
From United Kingdom to U.S.A.
Destination, Rates & Speeds

7.

Eitan Altman
Published by Chapman and Hall/CRC
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover Quantity Available: 1
Seller:
THE SAINT BOOKSTORE
(Southport, United Kingdom)
Rating
[?]

Book Description Chapman and Hall/CRC. Hardcover. Book Condition: New. New copy - Usually dispatched within 2 working days. Bookseller Inventory # B9780849303821

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 166.24
Convert Currency

Add to Basket

Shipping: US$ 9.22
From United Kingdom to U.S.A.
Destination, Rates & Speeds

8.

Eitan Altman
Published by Chapman and Hall/CRC (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover First Edition Quantity Available: 1
Seller:
Irish Booksellers
(Rumford, ME, U.S.A.)
Rating
[?]

Book Description Chapman and Hall/CRC, 1999. Hardcover. Book Condition: New. book. Bookseller Inventory # M0849303826

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 177.35
Convert Currency

Add to Basket

Shipping: FREE
Within U.S.A.
Destination, Rates & Speeds

9.

Etan Altman
Published by Taylor Francis Ltd, United States (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover Quantity Available: 1
Seller:
Book Depository hard to find
(London, United Kingdom)
Rating
[?]

Book Description Taylor Francis Ltd, United States, 1999. Hardback. Book Condition: New. Language: English . This book usually ship within 10-15 business days and we will endeavor to dispatch orders quicker than this where possible. Brand New Book. This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs. It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives. This framework describes dynamic decision problems arising frequently in many engineering fields. A thorough overview of these applications is presented in the introduction. The book is then divided into three sections that build upon each other. The first part explains the theory for the finite state space. The author characterizes the set of achievable expected occupation measures as well as performance vectors, and identifies simple classes of policies among which optimal policies exist. This allows the reduction of the original dynamic into a linear program. A Lagranian approach is then used to derive the dual linear program using dynamic programming techniques. In the second part, these results are extended to the infinite state space and action spaces. The author provides two frameworks: the case where costs are bounded below and the contracting framework. The third part builds upon the results of the first two parts and examines asymptotical results of the convergence of both the value and the policies in the time horizon and in the discount factor. Finally, several state truncation algorithms that enable the approximation of the solution of the original control problem via finite linear programs are given. Bookseller Inventory # BTE9780849303821

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 192.64
Convert Currency

Add to Basket

Shipping: FREE
From United Kingdom to U.S.A.
Destination, Rates & Speeds

10.

Eitan Altman
Published by Chapman and Hall/CRC (1999)
ISBN 10: 0849303826 ISBN 13: 9780849303821
New Hardcover Quantity Available: 1
Seller:
Ergodebooks
(RICHMOND, TX, U.S.A.)
Rating
[?]

Book Description Chapman and Hall/CRC, 1999. Hardcover. Book Condition: New. 1. Bookseller Inventory # DADAX0849303826

More Information About This Seller | Ask Bookseller a Question

Buy New
US$ 193.06
Convert Currency

Add to Basket

Shipping: US$ 3.99
Within U.S.A.
Destination, Rates & Speeds

There are more copies of this book

View all search results for this book