beginner 2 min answer

An internal tool's users are required to use it. Which product signals still mean something, and which are worthless?

internal productsmeasurementadoptioncaptive usersfeedback
Show the full answer Hide the answer

Why the usual signals stop working

Usage measures compliance, not value, when the user has no alternative. The standard product loop — build something better, people choose it, usage rises — is broken at the choice step. A mandated tool with 100% adoption and 100% dissatisfaction produces exactly the same usage chart as a beloved one.

Satisfaction surveys degrade the same way. People rate a mandatory tool against the frustration it causes, not against an alternative they could pick, and the score tends to say more about last week's incident than about the product.

The signals that survive captivity

  • Time to first success. How long from a new user arriving to completing the task they came for. It is measurable, comparable over time, and it cannot be produced by a mandate.
  • Workaround count. How many people have built a spreadsheet, a script or a shadow process to avoid part of your tool. This is the strongest available signal, because a workaround is someone paying real effort to escape, which is what choice looks like when choice is forbidden.
  • Support and question volume per active user, especially repeated questions, which measure where the tool fails to explain itself.
  • Unsolicited feature requests. People only ask for improvements to tools they expect to keep using. Silence is not satisfaction; it is usually resignation.
  • Task abandonment, where a user starts a flow and does not finish it, which in an internal tool means a person went to find a human instead.

The one experiment worth running

Make a part of it optional and see what happens. If a report, an export or an entry path can be made voluntary for one team for a month, the take-up is the only genuine choice signal available, and it is worth more than a year of survey data.

Common weak answers

  • "Adoption is 100%, so it is working." Adoption is the mandate, not the product. The interesting number is what people do when the mandate is not watching.
  • "Users say it is fine." Internal users are colleagues, and colleagues are polite in surveys and honest in workarounds. Count the spreadsheets.