Mistral 7B is 187x cheaper compared to GPT-4

updated 1y ago

In some applications, such as inline code suggestions, the best AI models are too expensive, so tools like Github Copilot use carefully tuned smaller models and various search heuristics to provide results. In other applications, even the largest models, like GPT-4, are too cheap!

from The Shift From Models to Compound AI Systems by Matei Zaharia, Omar Khattab, Lingjiao Chen, et al.

Higher performance and lower cost than any single LLM

We invented the first LLM router. By dynamically routing between multiple models, Martian can beat GPT-4 on performance, reduce costs by 20%-97%, and simplify the process of using AI

from Martian's Model Router: Optimize AI Performance and Reduce Costs

Nicolay Gerold added

LLM Pro/Serious Use Comparison/Test: From 7B to 70B vs. ChatGPT! Winner: Synthia-70B-v1.2b

LLM Chat/RP Comparison/Test: Dolphin-Mistral, Mistral-OpenOrca, Synthia 7B Winner: Mistral-7B-OpenOrca

LLM Chat/RP Comparison/Test: Mistral 7B Base + Instruct

LLM Chat/RP Comparison/Test (Euryale, FashionGPT, MXLewd, Synthia, Xwin) Winner: Xwin-LM-70B-V0.1

New Mo

from r/LocalLLaMA - Reddit

Nicolay Gerold added