Exercises · Grade 12

Forecast scoring and calibration — Grade 12 math exercises

Open an exercise and the tutor guides you step by step: it asks questions and checks each step, without giving the answer.

  1. Exercise 1 — Score probabilities rather than only classifications (easy)
  2. Exercise 2 — Prove truthful reporting under squared loss (easy)
  3. Exercise 3 — Handle logarithmic loss and its boundaries (easy)
  4. Exercise 4 — Compare empirically calibrated forecast groups (medium)
  5. Exercise 5 — Check calibration at more than one aggregation level (medium)
  6. Exercise 6 — Reconcile a Brier-loss decomposition (medium)
  7. Exercise 7 — Prove logarithmic loss is strictly proper (medium)
  8. Exercise 8 — Pool probabilities instead of randomizing reports (hard)
  9. Exercise 9 — Evaluate forecasts for the target mixture (hard)
  10. Exercise 10 — Choose a forecast pool robust to two regimes (hard)