Nicolay Gerold

Due to the nature of the most modern ANN vector search algorithms, incrementally updating a vector index is a massive challenge. This is a well known “hard problem”. The issue here is that these indexes are carefully organized for fast lookups and any attempt to incrementally update them with new vectors will rapidly deteriorate the fast lookup... See more

As we know, this has been pushed into many different areas where we’re already seeing productive viable businesses. I like to call them the 3Cs. There’s creativity, like any component of a video game, that you can automatically generate. There’s companionship, which is more of an emotional connection so you have characters to talk to, so it fills a... See more

If there isn’t enough light (type and quality - sunlight) in the morning with a low solar angle, the wakefulness system doesn’t get triggered properly. Artificial light doesn’t activate it properly, get sunlight in the light as soon to waking as possible. Get outside with no sunglasses, through glass decreases the efficiency by 50%, once the sun is... See more

• Terraform Providers: Terraform is primarily used for defining the infrastructure resources. Its strength lies in its vast collection of providers that offer standardized ways to interact with various cloud services (AWS, Azure, GCP, etc.) and on-premises infrastructure. These providers are essentially plugins that understand the specific APIs and

... See more

Important Aspects of Instruction Data

Longpre et al. (2023) and Iyer et al. (2022) ablate several important aspects of instruction data, which we highlight in the following.

Mixing few-shot settings. Training with mixed zero-shot and few-shot prompts significantly improves performance in both settings.

Task diversity. Large models benefit from... See more

The problem I've found with all of them is it is difficult to get consistent solid results that you would want to build around. Even listening to podcasts this seems to be a theme with the people at the forefront of MAS LLMs.

large prompts will prove to be an anti-pattern. They go against the common wisdom in software engineering.

Write small, testable, functions.

Imagine a world where LLMs are used for small, incremental steps.

That’s how engineering works. It’s taking a large problem and breaking it down into smaller problems.

This is how you test, validate and evaluate... See more

On the one hand, quality data still matters. A lot of focus on LLM improvement is on model and dataset size. There’s some early evidence that LLMs can be greatly influenced by the data quality they are trained with. WizardLM, TinyStories, and phi-1 are some examples. Likewise, RLHF datasets also matter.

On the other hand, ~100 data points is enough... See more

• If you are looking to develop an AI application, and you have a Mac or Linux machine, Ollama is great because it’s very easy to set up, easy to work with, and fast.


• If you are looking to chat locally with documents, GPT4All is the best out of the box solution that is also easy to set up


• If you are looking for advanced control and insight into neural

... See more