Stochastic Models¶
Year 3 · Block 2a · 5 ECTS
Finite-state Markov chains: the Markov property, transition probabilities, stationary distributions, and the irreducibility and aperiodicity conditions behind long-run behaviour.
- 4 concept pages
Practise¶
Concept pages¶
All concept pages4 concepts
- Markov Chain: the Markov property and transition probabilities.
- Stationary Distribution: distributions preserved by the transition matrix.
- Irreducibility: communication between states.
- Aperiodicity: return times and convergence conditions.
More about this course¶
Before you startEarlier concepts these pages use most. If a step feels unfamiliar, revisit them first.2 courses
AchievementsCourse challenges and how many learners hold them
SourcesCourse material these pages were checked against
Aliases: SM