Trade-off Analysis Methods
Structured ways to compare architectural options — valuable for making reasoning explicit, dangerous when they produce false precision.
Definition
Methods for comparing options against criteria so the reasoning is inspectable rather than intuitive. Their value is the argument they force, not the number they produce.
The methods worth knowing
Scenario-based evaluation. Define the quality attribute scenarios that matter, then assess each option against them. Its strength is that it surfaces sensitivity points — decisions that significantly affect one attribute — and trade-off points, where a decision affects several attributes in opposite directions. Those points are the actual output; the score is not.
Weighted scoring. Criteria with weights, options scored, totals compared. Useful for structuring a discussion and dangerous as an output: the weights are subjective, small changes flip the result, and the number acquires an authority the inputs do not deserve. Use it to discover disagreement about weights, which is usually the real disagreement.
Cost of delay and reversibility. Classify the decision: is it a one-way door or a two-way door? A reversible decision deserves a quick choice and an experiment. An irreversible one deserves deliberation proportionate to its cost. Spending three weeks on a decision you could undo in a day is a common and expensive error, and so is the reverse.
Spike or prototype. For decisions where the uncertainty is empirical, a two-day experiment beats two weeks of argument. Most performance and integration questions are of this kind.
Architecture decision records. Not an analysis method but the mechanism that preserves the analysis. Context, options considered, choice, consequences — and the section most often missing: what would make this the wrong choice.
The failure to avoid
False precision. A weighted matrix producing 7.4 against 7.1 conveys certainty that does not exist. When two options score within noise, that is the finding: they are equivalent on the stated criteria, so choose on something else — reversibility, team familiarity, or operational simplicity.
What good analysis actually produces
Not "option B wins" but: "These three criteria are decisive; the others do not differentiate. Option B is better on two and worse on one. The one it is worse on matters if X becomes true, so we should monitor X."
That is inspectable, and it tells the next person when to revisit.
Interview question
"How do you decide how much analysis a decision deserves?"