Nicolay Gerold

no reason to build any kind of software product these days that doesn't have a significant UX/domain knowledge component

http://examine.com for Dosages of supplements.

Depending on your use case, batching may help . If you are sending multiple requests to the same endpoint, you can batch the prompts to be sent in the same request. This will reduce the number of requests you need to make. The prompt parameter can hold up to 20 unique prompts. We advise you to test out this method and see if it helps. In some... See more

Welcome to the Wing Language! 👋

Take a Tour ▪︎ Getting Started ▪︎ Join Slack ▪︎ FAQ ▪︎ Roadmap ▪︎ Issues ▪︎ Discussions ▪︎ Contribute

Winglang is a new open-source programming language designed for the cloud (aka " cloud-oriented "). Wing enables developers to build distributed systems that leverage cloud services as first-class citizens by... See more

ExLlamaV2

ExLlamaV2 is an inference library for running local LLMs on modern consumer GPUs.

Overview of differences compared to V1

• Faster, better kernels


• Cleaner and more versatile codebase


• Support for a new quant format (see below)

My top issues with the foundations of the "modern data stack":

• Snowflake - you may only pay for what you use, but you pay through the nose for it. The cost is so high that in many cases it can exceed the cost of binders full of dbas.


• Fivetran - convenient, but they tried to triple my licensing cost last year, they have almost constant 15 minute

... See more

In the simplest form, we can use the model’s detection confidence to determine a score. But even here there are quite a few options to choose from:

• Lowest confidence - the score is the lowest confidence of all detected objects


• Average confidence - average of all confidences of detected objects


• Minimizing confidence delta - difference between

... See more

pair-preference-model-LLaMA3-8B by RLHFlow: Really strong reward model, trained to take in two inputs at once, which is the top open reward model on RewardBench (beating one of Cohere’s).

DeepSeek-V2 by deepseek-ai (21B active, 236B total param.): Another strong MoE base model from the DeepSeek team. Some people are questioning the very high MMLU... See more

Tempo training feels different than we expect.

Not a lot of huffing of the breath.

No burning in the legs.

Heart rate responds slowly.

Aim for a 3 out of 5 subjective feeling - Zone 3 / Moderately-Hard

When we are learning, aim for 20-30 minutes total dose of work. Aim for a rest duration that is shorter than the work duration.

Sample sets would be:

4-6... See more