Discrete Stochastic Processes: Tools for Machine Learning and Data Science
Book information
Description
This text presents selected applications of discrete-time stochastic processes that involve random interactions and algorithms, and revolve around the Markov property. It covers recurrence properties of (excited) random walks, convergence and mixing of Markov chains, distribution modeling using phase-type distributions, applications to search engines and probabilistic automata, and an introduction to the Ising model used in statistical physics. Applications to data science are also considered via hidden Markov models and Markov decision processes. A total of 32 exercises and 17 longer problems are provided with detailed solutions and cover various topics of interest, including statistical learning.
Similar books
Discrete Stochastic Processes: Tools for Machine Learning and Data Science
2024 · PDF
Discrete Stochastic Processes: Tools for Machine Learning and Data Science
2024 · PDF
Understanding Markov Chains: Examples and Applications
2013 · EPUB
Introduction to Stochastic Finance with Market Examples
2022 · PDF
Understanding Markov Chains. Examples and Applications
2018 · 7Z
Understanding Markov chains: Examples and Applications
EPUB
Understanding Markov Chains
2018 · PDF
Probability on Real Lie Algebras
2016 · PDF