GitHub - arthur-ai/bench: A tool for evaluating LLMs

github.com

RelatedHighlights

GitHub - charlax/professional-programming: A collection of learning resources for curious software engineers

github.com

GitHub - MadcowD/ell: A language model programming library.

github.com

Welcome to prompttools created by Hegel AI! This repo offers a set of open-source, self-hostable tools for experimenting with, testing, and evaluating LLMs, vector databases, and prompts. The core idea is to enable developers to evaluate using familiar interfaces like code, notebooks, and a local playground.

In just a few lines of codes, you can t

Testing framework for LLM Part

GitHub - katanaml/sparrow: Data processing with ML, LLM and Vision LLM

Andrej Baranovskij github.com

AgentBench: Evaluating LLMs as Agents

Xiao Liu • AgentBench: Evaluating LLMs as Agents

Zed AI - Code together with LLMs

zed.dev