Creating test suites - bench documentation

• Generate and execute more than 50 distinct types of tests only with 1 line of code


• Test all aspects of model quality: robustness, bias, representation, fairness and accuracy.​


• Automatically augment training data based on test results (for select models)​


• Sup

You can take the same approach to benchmarking a customer factory. You start by grouping your users into daily, weekly, and monthly batches based on their join date (or sign-up date). Then, you measure their significant user actions as they progress through your customer factory.

For each round of testing, you need to come up with tasks: the things the participants will try to do. The tasks you test in a given round will depend partly on what you have available to test.