SAT® · Math: Problem-Solving and Data Analysis
Observational Studies versus Experiments
An observational study records what people already do and can only show an association; an experiment assigns treatments by design, which is what lets a result support a cause.
In an observational study, nobody hands out the treatment. Researchers just watch people who already chose their habits and record what happens. That means any group who drinks more coffee, say, might also differ in other ways: they could exercise more, smoke less, earn more, sleep better. Those other differences, called lurking variables, can drive the outcome while coffee just rides along. The study can report that heavier coffee drinkers lived longer, an association, but it cannot say coffee caused it, because the groups were never comparable to begin with.
An experiment fixes this by using random assignment: the researcher, not the participant, decides who gets the treatment and who doesn't. With enough people, randomization spreads lurking variables evenly across groups, so the groups start out alike in every way except the treatment. Whatever difference shows up at the end has nowhere else to come from. That is the entire logic behind a causal claim, and no amount of sample size fixes its absence. A study of ten thousand self-selected coffee drinkers is still just a bigger observational study; size shrinks random error, not bias from lurking variables.
This splits into two separate questions worth keeping apart: how was the sample chosen, and how was the treatment assigned. Random selection from a population lets a result generalize to that population. Random assignment within the study lets a result support a cause. A study can have one, both, or neither, and knowing which one is missing tells you exactly what the data can and cannot claim.
Key terms
- Observational study
- A study that records existing behavior or traits without assigning any treatment.
- Experiment
- A study in which the researcher randomly assigns participants to treatment groups.
- Lurking variable
- An unmeasured factor that influences both the supposed cause and the outcome, creating a fake relationship.
- Random assignment
- Using chance to decide which treatment each participant receives, which balances lurking variables across groups.
- Association
- A pattern where two variables tend to occur together, without implying one causes the other.
Watch it explained
- How it worksHow does a lurking variable sneak into an observational study and fake a relationship?
- Worked exampleFind what a study linking coffee to longer life concludes when nobody was assigned to drink it.
- Common mistakeWhy doesn't a study with thousands of participants become an experiment just by being big?
- Ties togetherHow does the split between sampling and assignment decide generalization versus causation?
Check yourself
End of topic.