Supported Models

Suggest Edits

Where possible, we try to match the Hugging Face implementation. We are open to adjusting the API, so please reach out with feedback regarding these details.

Model

Context Length

Model Type

codellama-34b-instruct

16384

Chat Completion

llama-2-70b-chat

4096

Chat Completion

mistral-7b-instruct

4096 [1]

Chat Completion

pplx-7b-c... See more