Quantifying Uncertainty · Lesson 2 of 6
Confidence vs. Credible Intervals
~15 min
The Concept
You mention 'confidence interval' in a meeting and a colleague trained in Bayesian statistics corrects you: 'You mean credible interval, they're not interchangeable, and mixing them up changes what you're allowed to claim.'
A confidence interval (frequentist) says: if we repeated this sampling process many times, 95% of the intervals we'd construct would contain the true value. It is a statement about the procedure, not about this specific interval containing the truth with 95% probability.
A credible interval (Bayesian) says something more directly useful, and more intuitive: given the data and our prior beliefs, there's a 95% probability the true value falls in this exact range. The difference is subtle in wording but matters in interpretation, Bayesian credible intervals let you make direct probability statements about the unknown quantity itself.
The Analogy
A confidence interval is like a fishing net you know catches the right fish 95% of the time, but you can't tell just by looking whether this particular cast succeeded. A credible interval is more like a friend telling you directly, 'I'm 95% sure the fish is right here in this spot.' Both are useful, but they are answering slightly different questions.
The Math (optional)
The formal definitions side by side, using θ for an unknown true parameter:
Confidence interval (frequentist)
A statement about how often the interval-construction procedure would capture the true value across many hypothetical repeats, not a probability about this one interval.
Credible interval (Bayesian)
A direct probability statement: given the data we actually observed, there's a 95% chance the true value lies in this range.
Why Real Researchers Care
Misinterpreting a confidence interval as a direct probability statement is one of the most common statistical errors in published research and science journalism. Being precise about which kind of interval you're reporting, and what it actually licenses you to claim, is a mark of statistical maturity.
Quick Check
Q1. What does a 95% confidence interval technically claim?
Your Goal
Rewrite a confidence-interval claim you've heard before (in the news, a paper, or a class) using precise language that doesn't overstate what it means.
Hint: Avoid saying 'there's a 95% chance the true value is in this range' unless you're explicitly using a Bayesian credible interval.
Teach It Back
Explain the difference between a confidence interval and a credible interval to someone who's never studied statistics, without using the word 'frequentist' or 'Bayesian'.