updated 5mo ago
GitHub - google/maxtext: A simple, performant and scalable Jax LLM!
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax. EasyLM can scale up LLM training to hundreds of TPU/GPU accelerators by leveraging JAX's pjit functionality.
Building on top of Hugginface's transformers and datasets, this repo provides an easy to use and easy... See morefrom GitHub - young-geng/EasyLM: Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax. by young-geng
Nicolay Gerold added
- StreamingLLM can enable Llama-2, MPT, Falcon, and Pythia to perform stable and efficient language modeling with up to 4 million tokens and more.
from GitHub - mit-han-lab/streaming-llm: Efficient Streaming Language Models with Attention Sinks by mit-han-lab
Darren LI added
People need to be more thoughtful building products on top of LLMs. The fact that they generate text is not the point.
by Linus Lee
2 highlights