AP® Psychology · Science Practices: Research Methods and Data
2.C Case Studies, Observation, and Meta-Analysis
Case studies, naturalistic observation, and meta-analysis are methods for studying behavior without manipulating variables, each trading some control for depth, realism, or breadth, and each with a limit on what it can prove.
A case study is an intense, detailed look at one person or small group, usually someone unusual: a rare brain injury, an extraordinary talent, a severe disorder. One patient can be worth a whole research program because rare cases expose mechanisms that normal variation hides. Phineas Gage's tamping-iron injury to his frontal lobe taught early scientists that personality lives partly in that brain region, a finding no group study could have produced since almost nobody else had that exact injury.
Naturalistic observation watches behavior unfold in its normal setting without the observer interfering: researchers in a classroom, a playground, a primate habitat. It buys realism and ecological validity, behavior nobody staged for a lab, but it pays for that with control. No variable is manipulated, so you cannot isolate cause from effect, and the observer's presence or expectations can still subtly distort what gets recorded. A vivid case study has the same weak spot from a different angle: one dramatic story is memorable and persuasive, but one person's unique biology, history, or circumstances may not generalize to people broadly. Vividness is not evidence of typicality.
Meta-analysis solves the small-sample problem from the opposite direction, combining many existing studies into one pooled effect size, typically weighting each study by its sample size so bigger, more precise studies count more. This pooled estimate is often more trustworthy than any single study. But it inherits a flaw called publication bias: studies finding null or unimpressive results are less likely to get published, so if those missing studies are left out of the pool, the meta-analysis's combined effect size ends up systematically inflated.
Key terms
- case study
- An in-depth investigation of one individual or small group, often chosen because it is rare or extreme.
- naturalistic observation
- Watching and recording behavior in its natural setting without manipulating any variable.
- ecological validity
- The degree to which findings reflect behavior as it actually occurs outside the research setting.
- meta-analysis
- A statistical method that combines results from many separate studies into one pooled effect size.
- publication bias
- The tendency for studies with significant or exciting results to be published more often than studies with null results.
Watch it explained
- How it worksHow does naturalistic observation trade control away to buy real-world behavior?
- Common mistakeWhy isn't a vivid case study evidence about people in general?
- How it worksWalk me through a meta-analysis stacking many studies into one pooled estimate.
- Going furtherWhat happens to a meta-analysis when studies with null results were never published?
Check yourself
End of topic.