Saved by Aman and
Goodhart's law
Too Much Efficiency Makes Everything Worse: Overfitting and the Strong Version of Goodhart's Law
Jascha Sohl-Dicksteinsohl-dickstein.github.ioRemember Goodhart's Law when setting targets and goals:
When a measure becomes a target, it ceases to be a good measure.
the McNamara fallacy, as it came to be known, refers to our tendency to focus on the most quantifiable measures, even if doing so leads us from our actual goals. Put simply, we try to measure what we value, but end up valuing what we measure.