Nicolay Gerold

One communication smell I see looks like this:

❌ We can improve the load time by caching images on a CDN.

“Improve” is vague. Would it improve by .0001 seconds, 1 second, 3 seconds?

Sure, it will improve the load time. That’s great! But what about the 20 other things that improve the load time? Why should we do this over those?

Here’s an improved... See more

A thread pool is a collection of pre-initialized threads that can be used to execute tasks. Instead of starting a new thread for each task (which can be resource-intensive), a thread from this pool is reused to perform the task. This approach is beneficial for handling multiple operations in parallel, especially when these operations are blocking... See more

Setting up the necessary machine learning infrastructure to run these big models is another challenge. We need a dedicated model server for running model inference (using frameworks like Triton oder vLLM), powerful GPUs to run everything robustly, and configurability in our servers to make sure they're high throughput and low latency. Tuning the... See more

Surprises also provide a great opportunity for plasticity through the release of dopamine. Learn to attach dopamine to making errors and focused bouts of making errors during learning. Afterwards you are in a state of heightened learning for at least 60 minutes.

Super JSON Mode is a Python framework that enables the efficient creation of structured output from an LLM by breaking up a target schema into atomic components and then performing generations in parallel.

It supports both state of the art LLMs via OpenAI 's legacy completions API and open source LLMs such as via Hugging Face Transformers and vLLM .... See more

The complete Protobuf platform

Accelerate gRPC adoption with the Buf Schema Registry — built by the world's Protobuf experts.

t on LLMs and SQL highlighting why they don’t consistently work :

• “LLMs can write SQL, but they are often prone to making up tables, making up field”


• “LLMs have some context window which limits the amount of text they can operate over”


• “The SQL it writes may be incorrect for whatever reason, or it could be correct but just return an unexpected

... See more

An up-and-coming library that appears to have equally good features is Tanstack Router . The Tanstack Router was made to be fully type-safe and offer great defaults for data fetching just like React Router version 6 provides.

Iodine can decrease the inflammatory IL6.