Capstone — Probability & Statistics in Practice

Probability & Statistics Fundamentals

Chapter 10 · Capstone — Probability & Statistics in Practice

One continuous worked project, touching every chapter of this course in the order a real engineer would actually reach for each idea: monitoring the canary rollout of a new checkout feature, from the first hour's error logs through the final response-time analysis.

A Full Worked Rollout — Monitoring a New Checkout Feature

1 — Reading the first hour's problem logs (Ch.2)

Two problem types are logged per session: A = "UI error" (P(A) = 0.03) and B = "timeout" (P(B) = 0.02), with P(A ∩ B) = 0.005 — some sessions hit both. The union rule gives the overall "any problem" rate: P(A ∪ B) = 0.03 + 0.02 − 0.005 = 0.045. The complement rule then gives the genuinely useful number: P(clean session) = 1 − 0.045 = 0.955 — 95.5% of sessions have no problem at all.

2 — Checking whether the two problem types are related (Ch.3)

Testing independence: P(A) × P(B) = 0.03 × 0.02 = 0.0006, but the actual P(A ∩ B) = 0.005 — over eight times larger. They are clearly not independent. Computing P(timeout | UI error) = 0.005 / 0.03 ≈ 16.7% — far above the 2% baseline timeout rate — confirms the two problems cluster together, consistent with a shared root cause like server overload rather than two unrelated glitches.

3 — Is the monitoring alert trustworthy? (Ch.4)

A monitoring alert fires when the problem rate spikes. Genuine load issues happen on 5% of days (P(load) = 0.05); the alert catches 90% of real load issues (P(alert|load) = 0.9) but also false-fires on 3% of normal days (P(alert|no load) = 0.03). By the law of total probability, P(alert) = (0.9)(0.05) + (0.03)(0.95) = 0.0735. Bayes' Theorem then gives P(load | alert) = 0.045 / 0.0735 ≈ 61.2% — a meaningfully informative alert, though still short of certainty, exactly the base-rate reasoning Chapter 4 built.

4 — Budgeting for a possible rollback (Ch.5)

The rollout's cost, as a random variable: P(no rollback) = 0.85 (cost $0), P(partial rollback) = 0.12 (cost $3,000), P(full rollback) = 0.03 (cost $40,000). Expected value: E[X] = 0(0.85) + 3,000(0.12) + 40,000(0.03) = 360 + 1,200 = $1,560 — the number the team should actually budget for, not the (much lower) most-likely single outcome.

5 — How unusual would a great canary result be? (Ch.6)

Reusing Chapter 6's own conversion rate, p = 0.2, for n = 10 canary users: what's the probability at least half convert (X ≥ 5)? Summing the binomial PMF from k = 5 to 10 gives P(X ≥ 5) ≈ 0.033 (3.3%). If the canary group actually shows 5 or more conversions, that's a genuinely rare result under the existing 20% rate — real evidence the new feature may be improving conversion, not just random noise.

6 — How worried should an "incident-heavy" week be? (Ch.7)

Reusing Chapter 7's own incident rate, λ = 3 per week: what's the probability of at least 2 incidents during the rollout's first monitored week? P(X ≥ 2) = 1 − P(X=0) − P(X=1) = 1 − 0.0498 − 0.1494 ≈ 0.801 (80.1%) — a week with two or more incidents is actually the normal case at this rate, not a red flag on its own.

7 — Reading the response-time dashboard correctly (Ch.8)

Reusing Chapter 8's own response-time model, μ = 200ms, σ = 30ms: the probability a request falls between 170ms and 230ms (within 1σ either side) is P(170 < X < 230) ≈ 0.6827 — matching the empirical rule's 68% directly. For a monitoring dashboard averaging 100 requests at a time, the Central Limit Theorem gives that average's own standard error: SE = 30/√100 = 3ms — the averaged metric is far more stable than any single request's own time, exactly why dashboards average in the first place.

8 — The final response-time sample, and the outlier trap (Ch.9)

Reusing Chapter 9's own seven sampled response times — 120, 115, 130, 125, 118, 122, 890 — one request during the rollout was genuinely slow. Mean: 231.43ms. Median: 122ms. Reporting "average response time: 231ms" to stakeholders would badly misrepresent what most users actually experienced — the median, far less shaken by the single outlier, is the honest number to lead with.

This is, in essence, exactly what a real feature-rollout review looks like — every step traceable to a specific chapter of this course, none of it abstract math floating free of the actual monitoring dashboard.

What This Course Doesn't Cover

In the interest of an honest accounting: sampling and confidence intervals, hypothesis testing and A/B testing, and correlation, regression, and Bayesian updating were all named in Chapter 1 as deliberately out of scope, reserved for this subject's own next course, Statistical Inference & Applied Statistics. This course built the probability vocabulary and distributions every one of those techniques is built on top of, not a substitute for them.

This Course's Throughline, Restated

Reasoning forward from a known model
Every chapter in this course answered a version of the same question: given a clearly stated model of how something behaves, what can be said precisely about the outcomes it produces? The capstone above used exactly eight ideas — probability rules, conditional probability, Bayes' Theorem, expected value, and three named distributions plus descriptive statistics — across a single continuous scenario, without needing anything beyond them. That's the real payoff: a small, reusable toolkit for reasoning honestly about uncertainty before the data even exists.

Where This Course Connects

This course is the direct foundation under Technical Support's own diagnostic material — perfdiag1's and incident1's handling of incident rates and monitoring dashboards is exactly Chapters 7–9's territory, applied without the underlying math ever being named explicitly there. Within this subject's own next course, Statistical Inference & Applied Statistics builds directly on this course's Chapter 8 (the Central Limit Theorem feeds its own sampling-distribution chapter) and Chapter 4 (Bayes' Theorem feeds its own Bayesian-updating chapter) — nothing here was built in isolation from where this subject is actually headed next.

Hands-On Exercises

Exercise 1

A different rollout logs two problem types with P(A) = 0.04, P(B) = 0.025, and P(A ∩ B) = 0.001. Using this chapter's own Step 1–2 techniques, compute P(clean session), then determine whether A and B are independent.

📄 View solution
Exercise 2

Reusing Step 4's rollback-cost distribution, suppose the "full rollback" probability is revised upward to 0.05 (with "partial rollback" correspondingly reduced to 0.10, and "no rollback" still 0.85). Recompute E[X], and state whether the team's budget should increase or decrease compared to Step 4's original $1,560 figure.

📄 View solution
Exercise 3

For each of the eight steps in this chapter's own worked rollout, name the specific probability/statistics topic it relied on, without looking back at the step labels — just from the description of what each step actually does.

📄 View solution

Chapter 10 Quick Reference

  • Full worked project: union/complement rules (Ch.2) → conditional probability & independence (Ch.3) → Bayes' Theorem (Ch.4) → expected value (Ch.5) → binomial (Ch.6) → Poisson (Ch.7) → normal distribution & CLT (Ch.8) → descriptive statistics (Ch.9)
  • Out of scope: sampling/confidence intervals, hypothesis testing/A-B testing, and correlation/regression/Bayesian updating — all reserved for Statistical Inference & Applied Statistics
  • This course's throughline: a small, reusable toolkit for reasoning forward from a known model to precise statements about likely outcomes
  • This course is the direct foundation under Technical Support's own perfdiag1/incident1 material, and under this subject's own next course
  • Course complete — Probability & Statistics Fundamentals, 10 chapters, from sample spaces to descriptive statistics