Schedules of Reinforcement

Operant conditioning rarely rewards every single response. Instead, reinforcement follows a schedule built from two questions: does reward depend on how many responses occurred, or on how much time passed (ratio vs. interval)? And is that requirement always the same, or does it change unpredictably (fixed vs. variable)? Crossing these gives four partial schedules. Fixed-ratio pays after an exact number of responses, like a punch card rewarding every 10th coffee. Variable-ratio pays after an unpredictable number of responses averaging some value, like a slot machine. Fixed-interval pays for the first response after a set amount of time, like checking a mailbox that's refilled every 24 hours. Variable-interval pays for the first response after an unpredictable amount of time, like checking a phone for a reply.

Each schedule leaves a signature on a cumulative response graph, where the line's steepness shows response rate. Ratio schedules, tied to effort, produce steep lines and high rates, since responding faster earns reward faster. Interval schedules, tied to time, cap out lower, since responding faster can't speed up the clock. Fixed schedules create pauses: fixed-ratio shows a brief post-reinforcement rest then a burst, while fixed-interval shows a scalloped curve, a flat pause right after reward followed by accelerating responses as the deadline nears, because the organism learns to anticipate timing. Variable schedules erase the pauses entirely, producing smooth, steady responding since the organism never knows when reward is coming.

This connects directly to extinction: when reinforcement stops, fixed schedules extinguish fastest because the broken pattern is obvious, while variable schedules, especially variable-ratio, resist extinction longest because unpredictability already trained the organism to keep responding through long reward-free stretches, which is exactly why gambling behavior is so hard to shake.