r/MachineLearning - Reddit
updated 6mo ago
updated 6mo ago
Nicolay Gerold added 6mo ago
We're doing NER on hundreds of millions of documents in a specialised niche. LLMs are terrible for this. Slow, expensive and horrifyingly inaccurate. Even with agents, pydantic parsing and the like. Supervised methods are the way to go. Hell, I'd take an old school rule based approach over LLMs for this.
Nicolay Gerold added 6mo ago