Prompting
Intuition : Prompt tokens add very little latency to completion calls. Time to generate completion tokens is much longer, as tokens are generated one at a time. Longer generation lengths will accumulate latency due to generation required for each token.
OpenAI Platform
New prompts dropped @ingo This is very important to my career. You’d better be sure. Are you sure that’s your final answer? Believe in your abilities and strive for excellence. Your hard work will yield remarkable results. Are you sure that's your final answer? It might be worth taking another look.
Discord - A New Way to Chat with Friends & Communities
Dify is an LLM application development platform that has helped built over 100,000 applications. It integrates BaaS and LLMOps, covering the essential tech stack for building generative AI-native applications, including a built-in RAG engine. Dify allows you to deploy your own version of Assistants API and GPTs, based on any LLMs.
Using our Cloud... See more
Using our Cloud... See more
langgenius • GitHub - langgenius/dify: An Open-Source Assistants API and GPTs alternative. Dify.AI is an LLM application development platform. It integrates the concepts of Backend as a Service and LLMOps, covering the...
SELF-DISCOVER
This implements Google's algorithm from https://arxiv.org/pdf/2402.03620.pdf
Setup
Install Conda: https://docs.conda.io/projects/miniconda/en/latest/
This implements Google's algorithm from https://arxiv.org/pdf/2402.03620.pdf
Setup
Install Conda: https://docs.conda.io/projects/miniconda/en/latest/
catid • GitHub - catid/self-discover: Implementation of Google's SELF-DISCOVER
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable by co-designing the frontend language and the runtime system.
The core features of SGLang include:
The core features of SGLang include:
- A Flexible Front-End Language : This allows for easy programming of LLM applications with multiple
sgl-project • GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
SudoLang v1.0.9
Introduction
SudoLang is a pseudolanguage designed for interacting with LLMs. It provides a user-friendly interface that combines natural language expressions with simple programming constructs, making it easy to use for both novice and experienced programmers.
SudoLang can be used to produce AI-first programs such as chatbots and... See more
Introduction
SudoLang is a pseudolanguage designed for interacting with LLMs. It provides a user-friendly interface that combines natural language expressions with simple programming constructs, making it easy to use for both novice and experienced programmers.
SudoLang can be used to produce AI-first programs such as chatbots and... See more
sudolang-llm-support/sudolang.sudo.md at main · paralleldrive/sudolang-llm-support
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable by co-designing the frontend language and the runtime system.
The core features of SGLang include:
The core features of SGLang include:
- A Flexible Front-End Language : This allows for easy programming of LLM applications with multiple
sgl-project • GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
They have a fast jsond ecoding feature with a finite state machine.
Depending on your use case, batching may help . If you are sending multiple requests to the same endpoint, you can batch the prompts to be sent in the same request. This will reduce the number of requests you need to make. The prompt parameter can hold up to 20 unique prompts. We advise you to test out this method and see if it helps. In some... See more
OpenAI Platform
Overview
GPTScript is a new scripting language to automate your interaction with a Large Language Model (LLM), namely OpenAI. The ultimate goal is to create a fully natural language based programming experience. The syntax of GPTScript is largely natural language, making it very easy to learn and use. Natural language prompts can be mixed with... See more
GPTScript is a new scripting language to automate your interaction with a Large Language Model (LLM), namely OpenAI. The ultimate goal is to create a fully natural language based programming experience. The syntax of GPTScript is largely natural language, making it very easy to learn and use. Natural language prompts can be mixed with... See more