r/LocalLLaMA - Reddit
reddit.com
r/LocalLLaMA - Reddit
In general, I see LLMs to be used in two broad categories: data processing, which is more of a worker use-cases, where the latency isn't the biggest issue but rather quality, and in user-interactions, where latency is a big factor. I think for the faster case a faster fallback is necessary. Or you escalate upwards, you first rely on a smaller more ... See more
Discord - A New Way to Chat with Friends & Communities
Anything that comes out of an LLM is a proposition, not a solution. A proposition needs to be checked.
Thus, LLMs are mostly interesting for shallow problems (repeatable and can be evaluated by humans quickly).
Using them for generating solutions for complicated situations is misusing them.
Talking about large language models
arxiv.orgThe limited context window is one of the biggest limitations of LLMs today. The reasoning capabilities are great but the relevant knowledge it can reason with is very limited.
Question: nobody understands tokens. Let's talk about a regular page. How many pages of context can it uses?
LLMCheckerChain verifies statements to reduce inaccurate responses using a technique called self-reflection. The LLMCheckerChain can prevent hallucinations and reduce inaccurate responses by verifying the assumptions