Markov chains and stochastic stability
Book information
Description
Meyn & Tweedie is back! The bible on Markov chains in general state spaces has been brought up to date to reflect developments in the field since 1996 - many of them sparked by publication of the first edition. The pursuit of more efficient simulation algorithms for complex Markovian models, or algorithms for computation of optimal policies for controlled Markov models, has opened new directions for research on Markov chains. As a result, new applications have emerged across a wide range of topics including optimisation, statistics, and economics. New commentary and an epilogue by Sean Meyn summarise recent developments and references have been fully updated. This second edition reflects the same discipline and style that marked out the original and helped it to become a classic: proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background.
Similar books
Stochastic Simulation: Algorithms and Analysis (Stochastic Modelling and Applied Probability, No. 57)
2007 · PDF
Control Systems and Reinforcement Learning
2022 · PDF
Control Systems and Reinforcement Learning
2022 · PDF
Monte Carlo and Quasi-Monte Carlo Methods
2018 · PDF
Energy Markets and Responsive Grids
2018 · PDF
Coral Reefs of the Eastern Tropical Pacific: Persistence and Loss in a Dynamic Environment
2017 · PDF
Lévy Matters V: Functionals of Lévy Processes
2015 · PDF
Control Techniques for Complex Networks
2007 · PDF