GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
updated 8mo ago
updated 8mo ago
Nicolay Gerold added
They have a fast jsond ecoding feature with a finite state machine.
Nicolay Gerold added
Nicolay Gerold added