Discrete-Time Markov Control Processes: Basic Optimality Criteria - Stochastic Modelling and Applied Probability 30 (Paperback)
  • Discrete-Time Markov Control Processes: Basic Optimality Criteria - Stochastic Modelling and Applied Probability 30 (Paperback)
zoom

Discrete-Time Markov Control Processes: Basic Optimality Criteria - Stochastic Modelling and Applied Probability 30 (Paperback)

(author), (author)
£99.99
Paperback 216 Pages / Published: 30/09/2012
  • We can order this

Usually dispatched within 3 weeks

  • This item has been added to your basket
This book presents the first part of a planned two-volume series devoted to a systematic exposition of some recent developments in the theory of discrete-time Markov control processes (MCPs). Interest is mainly confined to MCPs with Borel state and control (or action) spaces, and possibly unbounded costs and noncompact control constraint sets. MCPs are a class of stochastic control problems, also known as Markov decision processes, controlled Markov processes, or stochastic dynamic pro- grams; sometimes, particularly when the state space is a countable set, they are also called Markov decision (or controlled Markov) chains. Regardless of the name used, MCPs appear in many fields, for example, engineering, economics, operations research, statistics, renewable and nonrenewable re- source management, (control of) epidemics, etc. However, most of the lit- erature (say, at least 90%) is concentrated on MCPs for which (a) the state space is a countable set, and/or (b) the costs-per-stage are bounded, and/or © the control constraint sets are compact. But curiously enough, the most widely used control model in engineering and economics--namely the LQ (Linear system/Quadratic cost) model-satisfies none of these conditions. Moreover, when dealing with "partially observable" systems) a standard approach is to transform them into equivalent "completely observable" sys- tems in a larger state space (in fact, a space of probability measures), which is uncountable even if the original state process is finite-valued.

Publisher: Springer-Verlag New York Inc.
ISBN: 9781461268840
Number of pages: 216
Weight: 367 g
Dimensions: 235 x 155 x 13 mm
Edition: Softcover reprint of the original 1st ed. 199

You may also be interested in...

Statistics Done Wrong
Added to basket
How to Use Statistics
Added to basket
Bayesian Statistics
Added to basket
£39.95
Paperback
Data Management Using Stata
Added to basket
Risk
Added to basket
£12.99
Paperback
Medical Statistics from Scratch
Added to basket
Psychology Statistics For Dummies
Added to basket
Probability with Martingales
Added to basket
Business Statistics For Dummies
Added to basket
Naked Statistics
Added to basket
£12.99
Paperback
Discovering Statistics Using R
Added to basket
£60.00
Mixed media product

Reviews

Please sign in to write a review

Your review has been submitted successfully.