Monitoring
updated 10mo ago
updated 10mo ago
promptfoo is a tool for testing and evaluating LLM output quality.... See more
With promptfoo, you can:
Systematically test prompts & models against predefined test cases
Evaluate quality and catch regressions by comparing LLM outputs side-by-side
Speed up evaluations with caching and concurrency
Score outputs automatically by defining test cases
Use as a
Nicolay Gerold added
Nicolay Gerold added
The potential of LLMs goes far beyond a natural language interface... The least it could do is intelligently give me a starting point for typing in a prompt. The tyranny of the blank textbox is real.
sari added