Shahada ya kwanza (juu)Probability & StatisticsImepangwa
Markov chains
Discrete-time Markov chains: transition matrices, classification of states, stationary distributions, convergence to equilibrium, hitting times and random walks.
math.prob.markov-chains
Somo la mada hii bado halijaandikwa. Muhtasari ulio hapa chini ni sehemu ya ramani ya mtaala na haujakaguliwa.
Inajengwa juu ya
Masharti ya awali ya lazima 42 (hadi chini kabisa)
Utajifunza
- Model processes with transition matrices and compute n-step transition probabilities.
- Classify states as recurrent or transient and find stationary distributions.
- Prove convergence to equilibrium for irreducible aperiodic finite chains.
Fasili
- A Markov chain is a sequence of random variables in which the conditional distribution of the next state, given the past, depends only on the current state.
- A probability distribution π (as a row vector) is stationary for transition matrix P if πP = π.
- A chain is irreducible if every state can be reached from every other state.
Nadharia
- An irreducible Markov chain on a finite state space has a unique stationary distribution.
- If it is also aperiodic, the distribution at time n converges to the stationary distribution from any starting distribution.
- Pólya: simple random walk is recurrent on ℤ and ℤ² and transient on ℤ³.
Mawazo potofu ya kawaida
- Reading 'memoryless' as 'forgets everything'; it means the future depends on the past only through the present.
Inaelekea kwa
Ugunduzi wa hiari
- Mathematical biology Stochastic models of populations and of genetic drift, such as the Wright–Fisher model, are Markov chains.
Usomaji zaidi
- J. R. Norris, Markov Chains (1997)