Journal

Research Papers · 4 September 2025 · 9 min read

Measuring What Matters: Outcome Metrics in Experience Research

Vanity metrics and activity counts tell teams they are busy. Outcome metrics tell them whether people’s lives improved. Here is how we define and track the difference.

Experience research generates rich qualitative insight and poor default accountability. Teams leave synthesis workshops with empathy maps and journey walls, then struggle to connect that work to decisions executives will fund again.

The fix is not more data. It is clearer metrics — chosen before research begins, tied to behaviour change the organisation actually cares about, and honest about what design can influence directly versus what requires policy, operations, or engineering partnership.

Three layers of measurement

We structure outcome metrics in three layers. Signal metrics capture whether the experience is understandable and trustworthy — task completion, error recovery, time-to-first-value. Commitment metrics capture whether people return voluntarily — repeat use without incentive, referral, upgrade without pressure. Durability metrics capture whether the product earns a place in habit — retention beyond novelty, reduced support load, lower churn tied to specific friction we removed.

Each layer answers a different strategic question. Skipping straight to commitment metrics when signal metrics are broken produces dashboards that look fine until the next onboarding cohort arrives.

Research methods mapped to metrics

Contextual inquiry and moderated testing anchor signal metrics. Longitudinal diaries and cohort interviews anchor commitment. Operational data — support tickets, refund reasons, field technician notes — anchor durability when teams have access.

The research paper worth writing is the one that links a observed behaviour in session three to a metric movement in quarter two. Without that chain, research remains theatre.

If a metric improves but people’s stated intent does not, you are probably measuring extraction — not value.

Ethical measurement as design constraint

We will not optimize for engagement at the expense of wellbeing. That commitment changes which metrics we refuse to treat as north stars — raw time-on-platform, notification-driven return rates, anxiety-shaped funnel velocity.

Outcome metrics should reflect products people choose to keep. That is the standard our mission sets, and it is the standard we hold client work to when measurement plans are drafted.

Published 4 September 2025

All journal