Discrete-Time Markov Control Processes : Basic Optimality Criteria
Hernandez-Lerma, Onesimo; Lasserre, Jean B.
ISBN 10: 1461268842 ISBN 13: 9781461268840
Published by Springer, 2012
Used
Soft cover
From
GreatBookPrices, Columbia, MD, U.S.A.
Seller rating 5 out of 5 stars
AbeBooks Seller since April 6, 2009
This specific item is no longer available.
About this Item
Description:
Unread book in perfect condition. Seller Inventory # 19849987
Synopsis:
This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.
"About this title" may belong to another edition of this title.
Bibliographic Details
Title: Discrete-Time Markov Control Processes : ...
Publisher: Springer
Publication Date: 2012
Binding: Soft cover
Condition: As New
Top Search Results from the AbeBooks Marketplace
Stock Image
Discrete-Time Markov Control Processes: Basic Optimality Criteria (Stochastic Modelling and Applied Probability)
Seller: Ria Christie Collections, Uxbridge, United Kingdom
Seller rating 5 out of 5 stars
Condition: New. In. Seller Inventory # ria9781461268840_new
Quantity: Over 20 available
Stock Image
Discrete-Time Markov Control Processes: Basic Optimality Criteria
Published by
Springer-Verlag New York Inc., 2012
ISBN 10: 1461268842
ISBN 13: 9781461268840
New
Paperback / softback
Seller: THE SAINT BOOKSTORE, Southport, United Kingdom
Seller rating 5 out of 5 stars
Paperback / softback. Condition: New. This item is printed on demand. New copy - Usually dispatched within 5-9 working days 366. Seller Inventory # C9781461268840
Quantity: Over 20 available
Seller Image
Discrete-Time Markov Control Processes
Print on DemandSeller: moluna, Greven, Germany
Seller rating 4 out of 5 stars
Condition: New. Dieser Artikel ist ein Print on Demand Artikel und wird nach Ihrer Bestellung fuer Sie gedruckt. This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control . Seller Inventory # 4189520
Quantity: Over 20 available
Discrete-Time Markov Control Processes | Basic Optimality Criteria
Seller: preigu, Osnabrück, Germany
Seller rating 5 out of 5 stars
Taschenbuch. Condition: Neu. Discrete-Time Markov Control Processes | Basic Optimality Criteria | Jean B. Lasserre (u. a.) | Taschenbuch | xiv | Englisch | 2012 | Springer New York | EAN 9781461268840 | Verantwortliche Person für die EU: Springer Verlag GmbH, Tiergartenstr. 17, 69121 Heidelberg, juergen[dot]hartmann[at]springer[dot]com | Anbieter: preigu. Seller Inventory # 105721268
Quantity: 5 available
Stock Image
Discrete-Time Markov Control Processes: Basic Optimality Criteria (Stochastic Modelling and Applied Probability)
Seller: Lucky's Textbooks, Dallas, TX, U.S.A.
Seller rating 5 out of 5 stars
Condition: New. Seller Inventory # ABLIING23Mar2716030028354
Quantity: Over 20 available
Seller Image
Discrete-Time Markov Control Processes
Published by
Springer New York, Springer US Sep 2012, 2012
ISBN 10: 1461268842
ISBN 13: 9781461268840
New
Taschenbuch
Seller: buchversandmimpf2000, Emtmannsberg, BAYE, Germany
Seller rating 5 out of 5 stars
Taschenbuch. Condition: Neu. This item is printed on demand - Print on Demand Titel. Neuware -This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with 'partially observable' systems) a standard approach is to transform them into equivalent 'completely observable' sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.Springer-Verlag GmbH, Tiergartenstr. 17, 69121 Heidelberg 236 pp. Englisch. Seller Inventory # 9781461268840
Quantity: 1 available
Seller Image
Discrete-Time Markov Control Processes
Published by
Springer New York Sep 2012, 2012
ISBN 10: 1461268842
ISBN 13: 9781461268840
New
Taschenbuch
Seller: BuchWeltWeit Ludwig Meier e.K., Bergisch Gladbach, Germany
Seller rating 5 out of 5 stars
Taschenbuch. Condition: Neu. This item is printed on demand - it takes 3-4 days longer - Neuware -This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with 'partially observable' systems) a standard approach is to transform them into equivalent 'completely observable' sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued. 236 pp. Englisch. Seller Inventory # 9781461268840
Quantity: 2 available
Seller Image
Discrete-Time Markov Control Processes : Basic Optimality Criteria
Published by
Springer New York, Springer New York, 2012
ISBN 10: 1461268842
ISBN 13: 9781461268840
New
Taschenbuch
Seller: AHA-BUCH GmbH, Einbeck, Germany
Seller rating 5 out of 5 stars
Taschenbuch. Condition: Neu. Druck auf Anfrage Neuware - Printed after ordering - This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with 'partially observable' systems) a standard approach is to transform them into equivalent 'completely observable' sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued. Seller Inventory # 9781461268840
Quantity: 1 available
Stock Image
Discrete-Time Markov Control Processes (Paperback)
Published by
Springer-Verlag New York Inc., New York, NY, 2012
ISBN 10: 1461268842
ISBN 13: 9781461268840
New
Paperback
Seller: Grand Eagle Retail, Bensenville, IL, U.S.A.
Seller rating 5 out of 5 stars
Paperback. Condition: new. Paperback. This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re source management, (control of) epidemics, etc. However, most of the lit erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or (c) the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued. This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. Shipping may be from multiple locations in the US or from the UK, depending on stock availability. Seller Inventory # 9781461268840
Quantity: 1 available
Stock Image
Discrete-Time Markov Control Processes
Seller: Books Puddle, New York, NY, U.S.A.
Seller rating 4 out of 5 stars
Condition: New. pp. 236. Seller Inventory # 2697513360
Quantity: 4 available