First, if we don't have sufficient in-brain skill and knowledge, we won't know what to ask the AI to do or how to interpret the products it creates. Second, if we turn over our thinking to AI, we are doing ourselves harm. I don't mean that in the metaphorical sense. Our brains are like muscles, and the harder they are used, the st... See more
The better AI gets at doing our work for us, the more we outsource our thinking to it. Thus, as we make machines more humanlike, they make us more machinelike. Perhaps we should be less worried about AI becoming conscious, than about humanity becoming unconscious.
Since the generative AIs have been trained on the entirety of human work — most of it mediocre — it produces “wisdom of the crowd”-like results. They may hit the mark but only because they are average.