"Is anyone using the new tool?" is the most-asked and least-answered question in internal software. This is the practical guide: the four metrics that matter, how to collect them across a whole portfolio without an engineering quarter, and how to read the numbers once you have them.
| Metric | What it answers | Watch out for |
|---|---|---|
| Active usage — pageviews and distinct visitors per period | Is the tool alive at all? Is the trend up or down? | Absolute numbers mean little; trend and share of the eligible audience mean everything. |
| Function adoption — usage of specific features/actions | Which parts of the tool earn their maintenance cost? | Without this, "the app is used" hides that 80% of its features aren't. Your dead-feature list writes itself. |
| Sentiment — in-context ratings on real pages | Do the people using it want to? | Annual surveys measure memory, not experience. Rate the page they're on, at the moment they're on it. |
| Reach into workflows — funnels across key paths | Do users complete the journeys the tool exists for? | A used tool with a broken core path is worse than an unused one — it wastes time and trust. |
Two metrics to ignore: logins (SSO auto-login makes them meaningless) and ticket volume (silence usually means abandonment, not satisfaction — see the captive user fallacy).
The classic failure mode is treating instrumentation as a per-app project — taxonomy workshop, tracking plan, sprint. That works for one app and dies at ten. The portfolio-friendly rules:
data-feedback-action="export-csv" — is a one-line PR any team merges in passing. A JS event pipeline is a project they'll defer. (Details: feature analytics with one HTML attribute.)Benchmarks for internal tools are scarce, so use these as starting heuristics, not gospel:
Measurement that ends in a dashboard changes nothing. The numbers need two standing rituals: a monthly portfolio review (movers, bottom-rated, retirement candidates — see the portfolio audit playbook) and a feedback-to-backlog pipeline so user comments become triaged, evidence-backed work items instead of a read-only sadness feed (see from stars to sprint).