GitHub - okuvshynov/slowllama: Finetune llama2-70b and codellama on MacBook Air without quantization

GitHub - okuvshynov/slowllama: Finetune llama2-70b and codellama on MacBook Air without quantization

okuvshynov github.com

RelatedHighlights

Ollama

Thumbnail of Ollama

Llama 2 - Resource Overview - Meta AI

Thumbnail of Llama 2 - Resource Overview - Meta AI

Discover, Download, and Run Local LLMs

lmstudio.ai lmstudio.ai

Thumbnail of Discover, Download, and Run Local LLMs

ExLlamaV2

ExLlamaV2 is an inference library for running local LLMs on modern consumer GPUs.

Overview of differences compared to V1

Faster, better kernels

Cleaner and more versatile codebase

Support for a new quant format (see below)

turboderp • GitHub - turboderp/exllamav2: A fast inference library for running LLMs locally on modern consumer-class GPUs

GitHub - mit-han-lab/streaming-llm: Efficient Streaming Language Models with Attention Sinks

mit-han-lab github.com

Thumbnail of GitHub - mit-han-lab/streaming-llm: Efficient Streaming Language Models with Attention Sinks

GitHub - transformerlab/transformerlab-app: Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

Thumbnail of GitHub - transformerlab/transformerlab-app: Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.