HuggingFaceH4/zephyr-7b-beta · Hugging Face
huggingface.co
HuggingFaceH4/zephyr-7b-beta · Hugging Face
One of the focus areas at Together Research is new architectures for long context, improved training, and inference performance over the Transformer architecture. Spinning out of a research program from our team and academic collaborators, with roots in signal processing-inspired sequence models, we are excited to introduce the StripedHyena models.... See more
Paving the way to efficient architectures: StripedHyena-7B, open source models offering a glimpse into a world beyond Transformers
R1’s leap in capability and efficiency wouldn’t be possible without its foundation model, DeepSeek-V3, which was released in December 2024. V3 itself is big—671 billion parameters (by comparison, GPT4-o is rumored to be 1.8 trillion, or three times as big)—yet it’s surprisingly cost-effective to run. That’s because V3 uses a mixture of experts (MoE
... See moreEvan Armstrong • What Actually Matters (And What Doesn’t) for DeepSeek
Fuyu-8B Model Card
Note: Running Fuyu requires https://github.com/huggingface/transformers/pull/26911, which may require running transformers on main!
Model
Fuyu-8B is a multi-modal text and image transformer trained by Adept AI.
Architecturally, Fuyu is a vanilla decoder-only transformer - there is no image encoder.
Image patches are instead linearly ... See more
Note: Running Fuyu requires https://github.com/huggingface/transformers/pull/26911, which may require running transformers on main!
Model
Fuyu-8B is a multi-modal text and image transformer trained by Adept AI.
Architecturally, Fuyu is a vanilla decoder-only transformer - there is no image encoder.
Image patches are instead linearly ... See more
adept/fuyu-8b · Hugging Face
Glaive-coder-7b
Glaive-coder-7b is a 7B parameter code model trained on a dataset of ~140k programming related problems and solutions generated from Glaive’s synthetic data generation platform.
The model is fine-tuned on the CodeLlama-7b model.
Usage:
The model is trained to act as a code assistant, and can do both single instruction following and mult... See more
Glaive-coder-7b is a 7B parameter code model trained on a dataset of ~140k programming related problems and solutions generated from Glaive’s synthetic data generation platform.
The model is fine-tuned on the CodeLlama-7b model.
Usage:
The model is trained to act as a code assistant, and can do both single instruction following and mult... See more
glaiveai/glaive-coder-7b · Hugging Face
Supported Models
Suggest Edits
Where possible, we try to match the Hugging Face implementation. We are open to adjusting the API, so please reach out with feedback regarding these details.
Model
Context Length
Model Type
codellama-34b-instruct
16384
Chat Completion
llama-2-70b-chat
4096
Chat Completion
mistral-7b-instruct
4096 [1]
Chat Completion
pplx-7b-c... See more
Suggest Edits
Where possible, we try to match the Hugging Face implementation. We are open to adjusting the API, so please reach out with feedback regarding these details.
Model
Context Length
Model Type
codellama-34b-instruct
16384
Chat Completion
llama-2-70b-chat
4096
Chat Completion
mistral-7b-instruct
4096 [1]
Chat Completion
pplx-7b-c... See more