GitHub - sqrkl/lm-evaluation-harness: A framework for few-sh...

GitHub - sqrkl/lm-evaluation-harness: A framework for few-shot evaluation of language models.

RelatedInsightsHighlights

Introducing OpenBench 0.1: Open, Reproducible Evals 🧵 https://t.co/S5LlHEzDxv

Andrew Ng said "Our eval tools aren’t ready for LLMs." @LangWatchAI Evaluations Wizard solves this by simulating real-world interactions and running 30+ evaluators on your LLM app. Works even if you have no eval dataset! 100% open-source. https://t.co/osImmD7bmw

Avi Chawla

x.com

GitHub - arthur-ai/bench: A tool for evaluating LLMs