Creating test suites - bench documentation
updated 5mo ago
Creating test suites - bench documentation
- Take a look at our official page for user documentation and examples: langtest.org
Key Features- Generate and execute more than 50 distinct types of tests only with 1 line of code
- Test all aspects of model quality: robustness, bias, representation, fairness and accuracy.
- Automatically augment training data based on test results (for select models)
- Sup
from GitHub - BrunoScaglione/langtest: Deliver safe & effective language models
Nicolay Gerold added
The goal of a benchmark usability test is to describe how usable an application is relative to a set of benchmark goals.
from Quantifying the User Experience: Practical Statistics for User Research by Jeff Sauro
- tests include:
- Unit tests for individual components and isolated functions.
- Integration tests for interactions between multiple components.
- End-to-end tests that assess the entire system’s functionality from a user’s perspective
Tests should be simple. It should be easy to identify what went wrong when reading a failing test.from 7 simple habits of the top 1% of engineers by Leonardo Creed
Nicolay Gerold added