r/LocalLLaMA - Reddit

Our extensive test over 25 LLMs (including APIs and open-sourced models) shows that, while top commercial LLMs present a strong ability of acting as agents in complex environments, there is a significant disparity in performance between them and open-sourced competitors.

Along comes Ollama.

I installed it using this one line script on my Ubuntu server

curl https://ollama.ai/install.sh | sh

And then installed Mistral 7b with this simple CLI command

ollama run mistral

And I am now able to access Mistral 7b from my Node RED flow by making an http request

I was able to do everything in less than 15 minutes.

Mistral 7b is runn... See more

LLMs use a statistical model of language, they do not pull from a database. So the more common a piece of work is in the training data, the more likely the AI is to “recall” that data accurately when prompted. You can see this at work when I give it a sentence from the most fiction common book in its training data - Alice in Wonderland . It gets th

... See more