Prompting
AI Template & SPR Library
Featuring advanced prompts and SPRs
🟢 Website
🔵 LinkedIn
🔴 Patreon
⚪ Discord
Prompt Engineering
Advanced GPTs
Template Library
Featuring advanced prompts and SPRs
🟢 Website
🔵 LinkedIn
🔴 Patreon
⚪ Discord
Prompt Engineering
Advanced GPTs
Template Library
nerority • GitHub - nerority/AI-Library: Template Library
Intuition : Prompt tokens add very little latency to completion calls. Time to generate completion tokens is much longer, as tokens are generated one at a time. Longer generation lengths will accumulate latency due to generation required for each token.
OpenAI Platform
Dify is an LLM application development platform that has helped built over 100,000 applications. It integrates BaaS and LLMOps, covering the essential tech stack for building generative AI-native applications, including a built-in RAG engine. Dify allows you to deploy your own version of Assistants API and GPTs, based on any LLMs.
Using our Cloud... See more
Using our Cloud... See more
langgenius • GitHub - langgenius/dify: An Open-Source Assistants API and GPTs alternative. Dify.AI is an LLM application development platform. It integrates the concepts of Backend as a Service and LLMOps, covering the...
SELF-DISCOVER
This implements Google's algorithm from https://arxiv.org/pdf/2402.03620.pdf
Setup
Install Conda: https://docs.conda.io/projects/miniconda/en/latest/
This implements Google's algorithm from https://arxiv.org/pdf/2402.03620.pdf
Setup
Install Conda: https://docs.conda.io/projects/miniconda/en/latest/
catid • GitHub - catid/self-discover: Implementation of Google's SELF-DISCOVER
New prompts dropped @ingo This is very important to my career. You’d better be sure. Are you sure that’s your final answer? Believe in your abilities and strive for excellence. Your hard work will yield remarkable results. Are you sure that's your final answer? It might be worth taking another look.
Discord - A New Way to Chat with Friends & Communities
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with LLMs faster and more controllable by co-designing the frontend language and the runtime system.
The core features of SGLang include:
The core features of SGLang include:
- A Flexible Front-End Language : This allows for easy programming of LLM applications with multiple
sgl-project • GitHub - sgl-project/sglang: SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
They have a fast jsond ecoding feature with a finite state machine.
Depending on your use case, batching may help . If you are sending multiple requests to the same endpoint, you can batch the prompts to be sent in the same request. This will reduce the number of requests you need to make. The prompt parameter can hold up to 20 unique prompts. We advise you to test out this method and see if it helps. In some... See more
OpenAI Platform
Requesting a large amount of generated tokens completions can lead to increased latencies:
- Lower max tokens : for requests with a similar token generation count, those that have a lower max_tokens parameter incur less latency.
- Include stop sequences : to prevent generating unneeded tokens, add a stop sequence. For example, you can use stop
OpenAI Platform
Overview
GPTScript is a new scripting language to automate your interaction with a Large Language Model (LLM), namely OpenAI. The ultimate goal is to create a fully natural language based programming experience. The syntax of GPTScript is largely natural language, making it very easy to learn and use. Natural language prompts can be mixed with... See more
GPTScript is a new scripting language to automate your interaction with a Large Language Model (LLM), namely OpenAI. The ultimate goal is to create a fully natural language based programming experience. The syntax of GPTScript is largely natural language, making it very easy to learn and use. Natural language prompts can be mixed with... See more