Supported Models

Take a look at our official page for user documentation and examples: langtest.org

Key Features

• Generate and execute more than 50 distinct types of tests only with 1 line of code


• Test all aspects of model quality: robustness, bias, representation, fairness and accuracy.​


• Automatically augment training data based on test results (for select models)​


• Sup

... See more

Advances in data processing techniques. You can increase context length in two ways. First, you can train the model with longer context lengths. That’s difficult because it’s much more computationally expensive, and it’s hard to find datasets with long context lengths (most documents in CommonCrawl have fewer than 2,000 tokens).

The second, more com... See more

koboldcpp

🤗 Transformers

Huggingface is an open source platform and community for deep learning models for language, vision, audio and multimodal. They develop and maintain the transformers library, which simplifies the process of downloading and training state of the art deep learning models.

This is the best library if you have a background in m... See more

First time here? Go to our setup guide

Features

• 🤖 Multiple model integrations: OpenAI, transformers, llama.cpp, exllama2, mamba


• 🖍️ Simple and powerful prompting primitives based on the Jinja templating engine


• 🚄 Multiple choices, type constraints and dynamic stopping


• ⚡ Fast regex-structured generation


• 🔥 Fast JSON generation following a JSON sche

... See more