The problem in this domain is sycophancy.
When you're first learning something, you don't actually know what to look for . You have too many unknown-unknowns, you don't have any wisdom, you have no abstractive connections to make.
The reason LLMs are hazardous during this period, is that they're always going to let you take the lead on everything. Th... See more
When you're first learning something, you don't actually know what to look for . You have too many unknown-unknowns, you don't have any wisdom, you have no abstractive connections to make.
The reason LLMs are hazardous during this period, is that they're always going to let you take the lead on everything. Th... See more
Link
One of the common themes you see is that LLMs are great when you are operating in the gray zone at the "edge" of your knowledge or confidence. For example, translating a program to C to speed it up. I can code C but I'm really rusty. I can't remember precise function names, what to #include, arguments etc. But LLMs are awesome at that. So it accele... See more