Many will point out that AI systems are not yet writing award-winning books, let alone patenting inventions. But most of us also don’t do these things.
Agency, as I see it, is an amalgamation of two skills, or mental dispositions: autonomy and efficacy.
Agency requires the capacity to formulate autonomous goals in life—the capacity to dig inside and figure out what wants to happen through you, no matter how strange or wrong it seems to others. In other words, it requires autonomy (which was what I
“Creativity is about connections, and connections are not made by siloing everything off into its own space. New ideas are formed by interesting juxtapositions, and interesting juxtapositions happen when things are out of place.”
The economically and politically relevant comparison on most tasks is not whether the language model is better than the best human, it is whether they are better than the human who would otherwise do that task.
Speed of the outside world . Intelligent agents need to operate interactively in the world in order to accomplish things and also to learn8. But the world only moves so fast.
It’s an interesting question to think about. Profit is the ultimate arbiter of a business’ financial success. It’s not just about saving money – spending too little can be as damaging as spending too much – but about investing money intelligently in the things that produce outcomes.
A renowned AI researcher once told me that he is practicing for post-AGI by taking up activities that he is not particularly good at: jiu-jitsu, surfing, and so on, and savoring the doing even without excellence. This is how we can prepare for our future where we will have to do things from joy rather than need, where we will no longer be the best ... See more