Model Card for Zephyr 7B β

Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr-7B-β is the second model in the series, and is a fine-tuned version of mistralai/Mistral-7B-v0.1 that was trained on on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO). We found that... See more

Quasar Alpha is here, and it's the AI industry's best-kept secret. A mysterious 1M token context model that beats Claude 3.7 Sonnet on benchmarks while running 4X faster. But nobody knows which lab created it. Here's what we know so far: 🧵 https://t.co/iL6UkQ6Xno