JentooACT®

ACT® · Science: Evaluating Scientific Arguments and Models with Evidence (8-13 items)

Engineering and Design Thinking: Evaluating a Prototype (EMI.ED)

A prototype succeeds when you measure it against the specific goal it was built to meet, not against how good it feels or how it compares to older designs. Falling short of the goal can still count as useful engineering if it reveals what to fix next.

Every prototype passage gives you three things: a goal, a measured result, and sometimes a cost or size limit called a constraint. Judging success means lining the result up against the goal stated at the start, not against some vague sense of quality. If the goal was removing at least 95 percent of particles and the prototype hits 88 percent, it fell short by 7 percentage points. That is a fact about the gap, not a verdict on the whole project.

Here is the twist the ladder keeps testing: missing the goal does not mean the engineering failed. A test log that shows exactly which layer a particle slipped through is gold, because it tells the next designer precisely what to change. Engineering moves in iterations, and a prototype's job is often to locate the problem, not solve it outright. So a passage can call a prototype a success even while admitting it missed its target number, as long as it generated usable information for the next round.

This connects to the rest of the unit because evaluating a model works the same way: check claims against the evidence actually collected, not against outside expectations. One trap is comparing a new prototype only to an older, worse one. Beating Prototype 1 does not mean Prototype 2 solves the stated problem if it still misses the brief's actual numbers. Another wrinkle: constraints that appear after testing is finished never change what already happened. A unit tested and approved under an old size limit still counts as a pass for that round; a new housing requirement just becomes the target for the next prototype.

Key terms

Goal
The specific numeric target a prototype was built to reach, stated before testing begins.
Constraint
A limit the design must satisfy, such as a maximum cost or size, separate from the main performance goal.
Brief
The full set of goals and constraints a prototype is tested against.
Iteration
One version of a design, tested and then revised based on what the test reveals.
Shortfall
The gap between the result a prototype achieved and the goal it was supposed to meet.

Watch it explained

  1. How it worksHow do you judge a claim that a prototype succeeded by measuring it against the goal it was built for?
  2. Worked exampleFind whether a filter reaching 88 percent removal meets a stated 95 percent goal, and say what that means.
  3. Common mistakeWhy isn't a prototype that beats the old design automatically a solution to the stated problem?
  4. Going furtherWhat changes about evaluating a prototype when a new constraint appears after the testing is finished?

Check yourself

Your turneasy1 of 3
A filter prototype is built to a stated goal of removing at least 96 percent of particles. Testing shows it removes 84 percent. By how many percentage points does the prototype fall short of its goal?

End of topic.