Markov Chains and Invariant Probabilities
Book information
Description
This book concerns discrete-time homogeneous Markov chains that admit an invariant probability measure. The main objective is to give a systematic, self-contained presentation on some key issues about the ergodic behavior of that class of Markov chains. These issues include, in particular, the various types of convergence of expected and pathwise occupation measures, and ergodic decompositions of the state space.
Similar books
Markov Chains and Invariant Probabilities (Progress in Mathematics, 211)
2003 · DJVU
An Introduction to Optimal Control Theory. The Dynamic Programming Approach
2023 · PDF
An Introduction to Optimal Control Theory: The Dynamic Programming Approach
2023 · PDF
An Introduction to Optimal Control Theory: The Dynamic Programming Approach
2023 · PDF
Selected Topics On Continuous-Time Controlled Markov Chains And Markov Games
2012 · PDF
Discrete-Time Markov Control Processes: Basic Optimality Criteria
1996 · PDF
Further Topics on Discrete-Time Markov Control Processes
1999 · PDF
Markov Chains and Invariant Probabilities
2003 · PDF