Choosing your metrics, KPIs, etc...
how to measure what matters + philosophical musings on whether the important things can be measured
sari and
Choosing your metrics, KPIs, etc...
We don’t track time on site on Sublime. We also don’t track passive consumption. We only track people actively building and curating their library (which itself is not a perfect metric - because we don’t want to incentivize collecting. we want to incentivize creating with your knowledge) but is better than time on platform.
If a platform enables yo
... See moreToo Much Efficiency Makes Everything Worse: Overfitting and the Strong Version of Goodhart's Law
Jascha Sohl-Dicksteinsohl-dickstein.github.ioFinding the right metric
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single numbe... See more
Ted Merz, who used to be the Global Head of News Product at Bloomberg, has an insightful article about how the company's founder (Mike Bloomberg) uses metrics as a management tool. One metric that is prominently displayed around the office on TV screens is the number of Bloomberg terminals sold year-to-date.
This single numbe... See more
Kiwi SaaS Metrics That Matter 2023^LLJ r2.2.pdf
slideshare.net
How did people respond? Did I strike an emotional nerve? This goes beyond easy, legible metrics like pageviews or social media likes, or even comments, which are at best hazy approximations of external resonance. It’s about looking for signals that something genuinely MATTERED to one or more humans, and elicited a response that’s out of proportion with the average digital interaction. Lots of likes is an okay-ish signal. Lots of comments is a clearer signal. A small handful of comments or private replies from people saying they’ve never felt so seen or understood by a piece of writing – that’s the kind of thing I’m trying to discern and quantify here.
Value capture occurs when an agent’s values are rich and subtle; they enter a social environment that presents simplified — typically quantified — versions of those val-ues; and those simplified articulations come to dominate their practical reasoning. Examples include becoming motivated by FitBit’s step counts, Twitter Likes and Re-tweets, citatio... See more
PhilPapers
excellent work by C. Thi Nguyen
People who insist that every product decision should be metrics-driven would also have to logically admit that theirs will be the first job to get automated by AI.