r/LocalLLaMA - Reddit

r/LocalLLaMA - Reddit

RelatedHighlights

Chatbot Arena formerly LMSYS: Free AI Chat to Compare & Test ...

Thumbnail of Chatbot Arena formerly LMSYS: Free AI Chat to Compare & Test ...

Llama 2 - Resource Overview - Meta AI

Thumbnail of Llama 2 - Resource Overview - Meta AI

Discover, Download, and Run Local LLMs

lmstudio.ai lmstudio.ai

Thumbnail of Discover, Download, and Run Local LLMs

eneral-purpose models

1.1B: TinyDolphin 2.8 1.1B. Takes about ~700MB RAM and tested on my Pi 4 with 2 gigs of RAM. Hallucinates a lot, but works for basic conversation.

2.7B: Dolphin 2.6 Phi-2. Takes over ~2GB RAM and tested on my 3GB 32-bit phone via llama.cpp on Termux.

7B: Nous Hermes Mistral 7B DPO. Takes about ~4-5GB RAM depending on contex

... See more

r/LocalLLaMA - Reddit

Ollama

Thumbnail of Ollama

Deep Dive into LLMs like ChatGPT