ACT® · Math: Statistics and Probability — Describing Data
Residuals: Actual Values Minus Model Values
A residual is actual minus predicted: how far off a line's prediction was for one real data point. Residuals near zero and scattered randomly mean the line fits well; patterns in them mean it doesn't.
Every line or curve fit to data is a guess machine: plug in x, get a predicted y. The actual data point almost never lands exactly on the line, so there's a leftover gap. That gap is the residual, and it's measured straight up or down, actual y minus predicted y. A positive residual means the real point sits above the line, the model underestimated it. A negative residual means the point sits below, the model overestimated it. One residual alone doesn't tell you much. The real payoff comes from looking at all of them together.
To build a residual plot, calculate the residual at every x-value, then plot those residuals against x on their own graph, with a horizontal line at zero marking where a perfect prediction would sit. If the residuals scatter randomly above and below zero with no pattern, a straight line was a reasonable model for the data. If the residuals curve, say going negative, then positive, then negative again, that curve is the shape the straight line missed, and a different model fits better.
This sits right next to scatterplots: a scatterplot shows the raw relationship, a line of best fit summarizes it, and the residual plot is the diagnostic check on whether that summary was honest. Center and spread describe a single list of numbers; residuals describe how well a model describes a relationship between two lists. Together they cover how data gets summarized and how that summary gets judged.
Key terms
- Residual
- The actual y-value minus the y-value a model predicts for the same x.
- Residual plot
- A graph of residuals against x, used to check whether a model's errors are random or patterned.
- Line of best fit
- The line chosen to model a data set, usually by minimizing the overall size of the residuals.
- Overestimate/underestimate
- A model overestimates when predicted y is too high (negative residual) and underestimates when too low (positive residual).
Watch it explained
- How it worksHow does a residual measure the vertical distance from an actual value to the value a model predicts?
- Worked exampleFind the residual for the point (6, 31) when the model predicts y = 4x + 5.
- How it worksWalk me through building a residual plot and reading off whether a straight line was the right model.
- Common mistakeWhy isn't a residual of zero proof that the model behind it is the right one?
Check yourself
End of topic.