Nicolay Gerold
@nicolaygerold
Nicolay Gerold
TL;DR
LLMLingua utilizes a compact, well-trained language model (e.g., GPT2-small, LLaMA-7B) to identify and remove non-essential tokens in prompts. This approach enables efficient inference with large language models (LLMs), achieving up to 20x compression with minimal performance loss.
... See more
LLMLingua utilizes a compact, well-trained language model (e.g., GPT2-small, LLaMA-7B) to identify and remove non-essential tokens in prompts. This approach enables efficient inference with large language models (LLMs), achieving up to 20x compression with minimal performance loss.
... See more
microsoft • GitHub - microsoft/LLMLingua: To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Why
Storing data in localStorage is useful, but it's not a good solution when you store data that needs to be shared across multiple devices or browsers.
For instance, let's say you want to show a welcome modal to all new users that sign up for your product. If you use localStorage to track if a user has already seen this modal, your users will... See more
Storing data in localStorage is useful, but it's not a good solution when you store data that needs to be shared across multiple devices or browsers.
For instance, let's say you want to show a welcome modal to all new users that sign up for your product. If you use localStorage to track if a user has already seen this modal, your users will... See more
FrigadeHQ • GitHub - FrigadeHQ/remote-storage: remoteStorage is a simple library that combines the localStorage API with a remote server to persist data across browsers and devices.
The OpenAI Assistants API offers more than a simple prompt-sharing interface; it provides a sophisticated framework for AI interactions. It allows for persistent conversation sessions with automatic context management (Threads), structured interactions (Messages and Runs), integration with various tools for enhanced capabilities, customization... See more
Discord - A New Way to Chat with Friends & Communities
The Mac Studio is an absolute monster for inferencing; but there are a couple of caveats.
- Its slower, pound for pound, than a 4090 when dealing with models the 4090 can fit in its VRAM. So a 13b model on the 4090 is almost twice as fast as it running on the M2.
- The M1 Ultra Mac Studio with 128GB costs far less ($3700 or so) and the inference speed is
r/LocalLLaMA - Reddit
Production Cloud: We've built a cloud offering for browser extensions called Itero. Check it out if you want instant beta testing and more awesome features.
Plasmo Framework
The Plasmo Framework is a battery-packed browser extension SDK made by hackers for hackers. Build your product and stop worrying about config files and the odd peculiarities of... See more
Plasmo Framework
The Plasmo Framework is a battery-packed browser extension SDK made by hackers for hackers. Build your product and stop worrying about config files and the odd peculiarities of... See more
PlasmoHQ • GitHub - PlasmoHQ/plasmo: 🧩 The Browser Extension Framework
Prioritize work to minimize opportunity cost. This prevents you from only pursuing incremental futures. In each quarter how much time to allocate incremental ~ 60%, to big new initiatives ~30%, to guidance & infrastructure ~10%.
lennysnewsletter.com • Shreyas Doshi on Pre-Mortems, the LNO Framework, the Three Levels of Product Work, Why Most Execution Problems Are Strategy Problems, and ROI vs. Opportunity Cost Thinking
How Your Brain Works & Changes
hubermanlab.comSeratonin makes us feel comfortable and in bliss with things. A lot of seratonin is in our gut, but not the kind leading to the comfortable feeling (they are in the brain). Starchy-carbs contain the amino acids that are the building blocks for and there increase the levels of seratonin. It blunts the appetite. It makes us feel relaxed and calm.
Andrew Huberman • How Foods and Nutrients Control Our Moods
### Strength2-4 min Rest, 3-5 reps, 3-5 working sets, work yourself up to it. You can work different muscle groups to cut down rest time. The main driver is intensity. You can do strength training every single day. Best is 2 times per week per muscle group.