Exercises · Grade 12

Markov chains and long-run behavior — Grade 12 math exercises

Open an exercise and the tutor guides you step by step: it asks questions and checks each step, without giving the answer.

  1. Exercise 1 — Read a transition matrix in the correct direction (easy)
  2. Exercise 2 — Sum permitted paths rather than multiplying marginal probabilities (easy)
  3. Exercise 3 — Solve a two-state recurrence and check a finite-time tolerance (easy)
  4. Exercise 4 — Distinguish stationarity from independence and no movement (medium)
  5. Exercise 5 — Check an alternating chain before claiming a limiting distribution (medium)
  6. Exercise 6 — Keep initial-state dependence when several states are absorbing (medium)
  7. Exercise 7 — Separate expected completion time from a guaranteed deadline (medium)
  8. Exercise 8 — Accumulate state costs until absorption (hard)
  9. Exercise 9 — Reverse transitions using stationary joint probabilities (hard)
  10. Exercise 10 — Predict a changing hidden state before updating from a new signal (hard)