Choosing your metrics, KPIs, etc...
how to measure what matters + philosophical musings on whether the important things can be measured
sari and
Choosing your metrics, KPIs, etc...
People who insist that every product decision should be metrics-driven would also have to logically admit that theirs will be the first job to get automated by AI.
Shreyas Doshix.comOne of the most bizarre contradictions in modern software is that the people building these engagement systems don’t like them either!
Ask anyone who works on onboarding popups, feature tours, lifecycle messaging, or in-app announcements how they feel when an app interrupts them mid-flow to announce something they didn’t ask for. The answer is... See more
Ask anyone who works on onboarding popups, feature tours, lifecycle messaging, or in-app announcements how they feel when an app interrupts them mid-flow to announce something they didn’t ask for. The answer is... See more
Article
tensions of product decisions/metrics
How did people respond? Did I strike an emotional nerve? This goes beyond easy, legible metrics like pageviews or social media likes, or even comments, which are at best hazy approximations of external resonance. It’s about looking for signals that something genuinely MATTERED to one or more humans, and elicited a response that’s out of proportion with the average digital interaction. Lots of likes is an okay-ish signal. Lots of comments is a clearer signal. A small handful of comments or private replies from people saying they’ve never felt so seen or understood by a piece of writing – that’s the kind of thing I’m trying to discern and quantify here.
The concept of efficiency — how much one can accomplish per unit of time (or per dollar, etc.) — requires a quantitative numerator as well as a denominator. It requires a metric. Therefore, it tells us nothing about results we cannot quantify or measure. When we gear our society around efficiency, we produce more and more of the measurable, while... See more
Finding the right metric
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single... See more
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single... See more
“One of the reasons the tech industry is so creatively bankrupt is that people just focus on attributes you can measure,” said Jony Ive, when told of the insecurity Kushner had confided to Rick Rubin. “I was very lucky at Apple, because Steve [Jobs] showed me there was a way to articulate things like sensibility, intuition, taste, which all start... See more