GPT4All: An ecosystem of open-source on-edge large language models.

Important

GPT4All v2.5.0 and newer only supports models in GGUF format (.gguf). Models used with a previous version of GPT4All (.bin extension) will no longer work.

GPT4All is an ecosystem to run powerful and customized large language models that work locally on consumer grade CPUs and any GPU. Note that your CPU needs to support AVX or AVX2 instructions.

Learn more in the documentation.

A GPT4All model is a 3GB - 8GB file that you can download and plug into the GPT4All open-source ecosystem software. Nomic AI supports and maintains this software ecosystem to enforce quality and security alongside spearheading the effort to allow any person or enterprise to easily train and deploy their own on-edge large language models.

What's New (

Issue Tracker

)

October 19th, 2023

: GGUF Support Launches with Support for:
- Mistral 7b base model, an updated model gallery on gpt4all.io, several new local code models including Rift Coder v1.5
- Nomic Vulkan support for Q4_0, Q6 quantizations in GGUF.
- Offline build support for running old versions of the GPT4All Local LLM Chat Client.

September 18th, 2023 : Nomic Vulkan launches supporting local LLM inference on AMD, Intel, Samsung, Qualcomm and NVIDIA GPUs.

August 15th, 2023 : GPT4All API launches allowing inference of local LLMs from docker containers.

July 2023 : Stable support for LocalDocs, a GPT4All Plugin that allows you to privately and locally chat with your data.