arXiv:2405.02048v1 [cs.IR] 3 May 2024

updated 5mo ago

Amplify Partners was running a survey among 800+ AI engineers to bring transparency to the AI Engineering space. The report is concise, yet it provides a wealth of insights into the technologies and methods employed by companies for the implementation of AI products.

Highlights

👉 Top AI use cases are code intelligence, data extraction and workflow a... See more
from feed updates
added
Mistral AI shows a promising alternative to the GPT 3.5 model using prompt engineering .

Mistral AI can be used where it requires high volume and faster processing time with very little cost .

Mistral AI can be used as pre-filtering to GPT 4 to reduce cost i.e. can be used to filter down search results .
from Mistral 7B is 187x cheaper compared to GPT-4
Nicolay Gerold added
In some applications, such as inline code suggestions, the best AI models are too expensive, so tools like Github Copilot use carefully tuned smaller models and various search heuristics to provide results. In other applications, even the largest models, like GPT-4, are too cheap!

from The Shift From Models to Compound AI Systems by Matei Zaharia, Omar Khattab, Lingjiao Chen, et al.