Choosing your metrics, KPIs, etc...
how to measure what matters + philosophical musings on whether the important things can be measured
sari and
Choosing your metrics, KPIs, etc...
Too Much Efficiency Makes Everything Worse: Overfitting and the Strong Version of Goodhart's Law
Jascha Sohl-Dicksteinsohl-dickstein.github.io
How did people respond? Did I strike an emotional nerve? This goes beyond easy, legible metrics like pageviews or social media likes, or even comments, which are at best hazy approximations of external resonance. It’s about looking for signals that something genuinely MATTERED to one or more humans, and elicited a response that’s out of proportion with the average digital interaction. Lots of likes is an okay-ish signal. Lots of comments is a clearer signal. A small handful of comments or private replies from people saying they’ve never felt so seen or understood by a piece of writing – that’s the kind of thing I’m trying to discern and quantify here.
Finding the right metric
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single... See more
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single... See more
quality has no discernable metric
-miter
But ambiguity, taste, meaning, value, these remain hard to attain within the hierarchy of verifiability. “Intelligence” races ahead wherever the rewards are liquid and the outcome is easy to check, but it lags at the edges: in murky context, slow feedback, or spaces where the answer is more felt than measured.
While it’s tempting to believe a model... See more
While it’s tempting to believe a model... See more
Market of words
listen for truths that language cannot name
Overpowered Metrics Eat Underspecified Goals
ribbonfarm.com
Measure What Matters: How Google, Bono, and the Gates Foundation Rock the World with OKRs
John Doerr • 8 highlights
amazon.com