r/LLMDevs - Reddit

the science problem. We’ve all spent the last year talking about ‘error rates’ or ‘hallucinations’ (indeed, I also wrote about them here). The breakthrough of LLMs is to create a statistical model that can be built by machine at huge scale, instead of a deterministic model that (today) must be built by hand and doesn’t scale. This is why they work,... See more

t on LLMs and SQL highlighting why they don’t consistently work :

• “LLMs can write SQL, but they are often prone to making up tables, making up field”


• “LLMs have some context window which limits the amount of text they can operate over”


• “The SQL it writes may be incorrect for whatever reason, or it could be correct but just return an unexpected result.

... See more