Choosing your metrics, KPIs, etc...
how to measure what matters + philosophical musings on whether the important things can be measured
sari and
Choosing your metrics, KPIs, etc...
In my six years at Google, I got to observe this force up close, relentlessly killing features users loved and eroding the last vestiges of creativity and agency from our products. I know this force well, and I hate it, but I do not yet know how to fight it. I call this force the Tyranny of the Marginal User .
Simply put, companies building apps... See more
Simply put, companies building apps... See more
Ivan Vendrov • The Tyranny of the Marginal User
Human pain is too abstract to be represented in spreadsheets.
Craig Mod • Offscreen Magazine Interview
Finding the right metric
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single... See more
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single... See more
There is a common issue of over-optimizing the metrics in business, which can damage the whole system.
Doing the wrong thing efficiently is actually worse than doing the right thing badly.
– Rory Sutherland
Which leads on to my next point. See, not only do numbers not capture what matters (love, happiness, awe, spirituality, creativity are by definition unquantifiable beyond mere surface appearances) they are also extremely open to manipulation.
thomasjbevan.substack.com • The Tyranny of Numbers - By Thomas J Bevan - The Commonplace
People who insist that every product decision should be metrics-driven would also have to logically admit that theirs will be the first job to get automated by AI.
Shreyas Doshix.comquality has no discernable metric
-miter
But ambiguity, taste, meaning, value, these remain hard to attain within the hierarchy of verifiability. “Intelligence” races ahead wherever the rewards are liquid and the outcome is easy to check, but it lags at the edges: in murky context, slow feedback, or spaces where the answer is more felt than measured.
While it’s tempting to believe a model... See more
While it’s tempting to believe a model... See more
Market of words
listen for truths that language cannot name