JentooACT®

ACT® · Math: Statistics and Probability — Inference, Probability, and Counting

Using Simulation to Reject or Fail to Reject a Claim

A simulation repeats a chance process thousands of times to show what results are typical if nothing unusual is going on. If the real result lands way outside that range, chance alone is a poor explanation.

Start with a claim worth testing, like a coin is fair. You can't rerun history to check it, so you build a model of pure chance instead: flip a virtual fair coin 100 times, record the number of heads, and repeat that thousands of times. That gives a distribution of outcomes chance alone would produce. Most results cluster in the middle, with fewer and fewer as you move toward the extremes.

Once you have that distribution, mark off the middle chunk that covers most of the simulated outcomes, often the middle 95 percent. That middle chunk is the range of results that wouldn't raise eyebrows if the claim were true. Then you locate your one real result on that same scale. If it falls inside the range, the data looks like ordinary chance variation. If it falls outside, far from where chance usually lands, you reject the claim: chance alone is an unconvincing explanation for what happened.

This connects directly to margin of error and conditional probability questions nearby in the unit: the simulated range is doing the same job a margin of error does, marking off plausible chance variation around an expected value. The catch is what happens when the real result lands inside the range. That does not prove the claim true. It only means the data failed to catch the claim in a lie. A biased coin could still produce a result that looks ordinary by luck.

Key terms

Simulation
A repeated chance process, like many virtual coin flips, used to show what outcomes pure chance typically produces.
Simulated distribution
The full spread of results a simulation generates, showing which outcomes are common and which are rare under chance alone.
Reject a claim
To decide a claim is unlikely to be true because the real result falls far outside the range chance alone would produce.
Fail to reject
To find the real result consistent with chance, meaning the data gives no evidence against the claim without proving it true.

Watch it explained

  1. How it worksHow does a simulation build a picture of everything chance alone could have produced?
  2. How it worksWalk me through rejecting a claim by finding where a real result lands in a simulated distribution.
  3. Worked exampleFind whether 63 heads in 100 flips is surprising when a fair-coin simulation puts 95 percent of results between 40 and 60.
  4. Common mistakeWhy doesn't failing to reject a claim mean that claim has been proven true?

Check yourself

Your turneasy1 of 3
A fair-coin simulation puts 95 percent of results between 42 and 60 heads in 100 flips. A real trial gives 79 heads. How many heads above the top of that range is the trial result?

End of topic.