For me, effective DevRel in the ML space requires a strong technical foundation: building daily, using the latest OS tools, reading papers, and collaborating with ML developers and AI Engineers as a peer. (of course, depends on your audience and goals!)

Using @LMStudioAI for local inference with @LangChainAI has been a time and money saver. On a M2 Max with 96GB I am getting over 40 tok/s with Mistral, CodeLlama, and Zephyr. Easy to use and implement in existing code base as an OpenAI API drop in replacement - good stuff! https://t.co/Fa4XlNQQKe

If you’re an AI engineer or builder that relies on GPT4 and are worried about the API collapsing, here’s a contingency plan for you to follow: First things first, make sure you apply to the Azure OpenAI service (link in replies). You can use it as a drop-in replacement for GPT4, as well as benefit from decreased latency... See more