AMAT 19Markov chains
More
Local first

Markov chains

Supplemental study note

Older Chapter 4 supplement + original explanation

Practice this concept

Supplemental status

Markov chains appear in the older Chapter 4 handout but are not explicit in the current course outline.

A transition matrix is row-stochastic: entries are nonnegative and each row sums to 1. A state distribution moves one step by multiplying the row distribution by the transition matrix. Repeating this process gives d P^k.

Search AMAT 19

11 results · use ↑ ↓ and Enter

Developer contact

Connect with the person building and maintaining AMAT 19 Study Lab.

Aedrian PonceFounder & Lead Developer