GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
updated 8mo ago
updated 8mo ago
Nicolay Gerold added 8mo ago
They have a fast jsond ecoding feature with a finite state machine.