Beyond Vibe Checks: A PM’s Complete Guide to Evals
Finally, and perhaps most importantly, we need to rethink how we measure and value AI contributions. The traditional metrics of time saved or costs reduced may miss the more transformative impacts of these systems - their ability to generate novel insights, synthesize complex information, and enable new forms of problem-solving. Moving too quickly ... See more
Ethan Mollick • A new generation of AIs: Claude 3.7 and Grok 3
This approach to optimization is enabled by two important factors. First, you need the technical infrastructure in place to run these tests, gather the results, and route the results quickly to the right people. More important is the second factor: management attitude.
Josh Seiden • Sense and Respond: How Successful Organizations Listen to Customers and Create New Products Continuously
You are about to launch a major change to the user interface of your company’s website. What sort of metrics would you want to monitor to notify you if there’s a problem?
Gayle Laakmann McDowell, Jackie Bavaro • Cracking the PM Interview: How to Land a Product Manager Job in Technology (Cracking the Interview & Career)
YOU CAN FREQUENTLY ASSESS the quality of a team by the quality of their metrics. Metrics are the lifeblood of a team lead because everything in your job is a negotiation, and metrics provide a rational foundation for discussion. If you don’t back up your statements with metrics, you’ll sound like Animal the Muppet. You also need metrics because you
... See more