GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable by co-designing the frontend language and the runtime system.
The core features of SGLang include:
The core features of SGLang include:
- A Flexible Front-End Language : This allows for easy programming of LLM applications with multiple ch
sgl-project • GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
Nicolay Gerold added
They have a fast jsond ecoding feature with a finite state machine.
GitHub - mit-han-lab/streaming-llm: Efficient Streaming Language Models with Attention Sinks
mit-han-labgithub.comDarren LI and added
GitHub - MadcowD/ell: A language model programming library.
github.com
LMQL is a programming language for LLMs.Robust and modular LLM prompting using types, templates, constraints and an optimizing runtime.
LMQL is a programming language for LLM interaction. | LMQL
Nicolay Gerold added
Unites Research and Production — AdalFlow: The Library to Build and Auto-Optimize LLM Task Pipelines
adalflow.sylph.ai
Amazon SageMaker Feature Store is a fully managed repository designed specifically for storing, sharing, and managing ML model features. Another essential component is an orchestration tool suitable for prompt engineering and managing different type of subtasks. Generative AI developers can use frameworks like LangChain, which offers modules for in... See more
Personalize your generative AI applications with Amazon SageMaker Feature Store | Amazon Web Services
Nicolay Gerold added
LangChain excels at chaining LLMs together using agents to delegate actions to models. Its use cases emphasize prompt optimization and context-aware information retrieval/generation; however, with its Pythonic highly modular interface and its huge collection of tools, it is the number-one tool to implement complex business logic.
Ben Auffarth • Generative AI with LangChain: Build large language model (LLM) apps with Python, ChatGPT, and other LLMs
LangChain simplifies the development of sophisticated LLM applications by providing reusable components and pre-assembled chains.