GitHub - mistralai/mistral-finetune
updated 4mo ago
GitHub - mistralai/mistral-finetune
- Fine-Tuning for LLM Research by AI Hero
This repo contains the code that will be run inside the container. Alternatively, this code can also be run natively. The container is built and pushed to the repo using Github actions (see below). You can launch the fine tuning job using the examples in the https://github.com/ai-hero/llm-research-examples pr... See morefrom GitHub - ai-hero/llm-research-fine-tuning
Nicolay Gerold added
- slowllama
Fine-tune Llama2 and CodeLLama models, including 70B/35B on Apple M1/M2 devices (for example, Macbook Air or Mac Mini) or consumer nVidia GPUs.
slowllama is not using any quantization. Instead, it offloads parts of model to SSD or main memory on both forward/backward passes. In contrast with training large models from scratch (unattainable... See morefrom GitHub - okuvshynov/slowllama: Finetune llama2-70b and codellama on MacBook Air without quantization by okuvshynov
Nicolay Gerold added
- Mistral AI shows a promising alternative to the GPT 3.5 model using prompt engineering .
- Mistral AI can be used where it requires high volume and faster processing time with very little cost .
- Mistral AI can be used as pre-filtering to GPT 4 to reduce cost i.e. can be used to filter down search results .
from Mistral 7B is 187x cheaper compared to GPT-4
Nicolay Gerold added