Too Much Efficiency Makes Everything Worse: Overfitting and the Strong Version of Goodhart's Law
Jascha Sohl-Dicksteinsohl-dickstein.github.ioSaved by sari and
Too Much Efficiency Makes Everything Worse: Overfitting and the Strong Version of Goodhart's Law
Saved by sari and
“If you optimize each component of the system individually, you won’t have an optimal system.”
Of course, the problem is not optimization itself but the type of optimization. To have an optimal system, optimize the components for their effect on the system, not just their direct output.
So, optimize your short-term goals and how you achieve them for
... See more