GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally

• If you are looking to develop an AI application, and you have a Mac or Linux machine, Ollama is great because it’s very easy to set up, easy to work with, and fast.


• If you are looking to chat locally with documents, GPT4All is the best out of the box solution that is also easy to set up


• If you are looking for advanced control and insight into neural

... See more

Along comes Ollama.

I installed it using this one line script on my Ubuntu server

curl https://ollama.ai/install.sh | sh

And then installed Mistral 7b with this simple CLI command

ollama run mistral

And I am now able to access Mistral 7b from my Node RED flow by making an http request

I was able to do everything in less than 15 minutes.

Mistral 7b is runn... See more