Sublime
An inspiration engine for ideas

(1/7) Do you want to test code generation models on the domains you care about?
Struggling to find existing benchmarks that suit your needs?
Our new work *CodeBenchGen* helps you build execution-based benchmarks based on your selected code fragments! (https://t.co/cWL6xXSkOg) https://t.co/B5l0O5qyd3
Dozens of teams have asked my advice on running LLMs. How fast is @deepseek_ai V3 with vLLM on 8 GPUs? What's the max throughput of @Alibaba_Qwen 2.5 Coder with SGLang on one H100?
Running & sharing benchmarks ad hoc was too slow
So we built a tiny app, the LLM Engine Advisor... See more
Charles 🎉 Fryex.com