Nicolay Gerold

In general, I see LLMs to be used in two broad categories: data processing, which is more of a worker use-cases, where the latency isn't the biggest issue but rather quality, and in user-interactions, where latency is a big factor. I think for the faster case a faster fallback is necessary. Or you escalate upwards, you first rely on a smaller more... See more

PGlite - Postgres in WASM

PGlite is a WASM Postgres build packaged into a TypeScript client library that enables you to run Postgres in the browser, Node.js and Bun, with no need to install any other dependencies. It is only 3.7mb gzipped.

import { PGlite } from "@electric-sql/pglite"

const db = new PGlite()

await db.query("select 'Hello world' as... See more

Fast, Simple, In-Memory Nearest Neighbor Search

Voyager provides approximate nearest-neighbor search in Python and Java. It's up to 10 times faster than Annoy, while using 4 times less memory and providing more features.

To train LLMs, you need data that is:

Large — Sufficiently large LMs require trillions of tokens.

Clean — Noisy data reduces performance.

Diverse — Data should come from different sources and different knowledge bases.

What does clean data look like?

You can de-duplicate data with simple heuristics. The most basic would be removing any exact duplicates... See more

The Mac Studio is an absolute monster for inferencing; but there are a couple of caveats.

• Its slower, pound for pound, than a 4090 when dealing with models the 4090 can fit in its VRAM. So a 13b model on the 4090 is almost twice as fast as it running on the M2.


• The M1 Ultra Mac Studio with 128GB costs far less ($3700 or so) and the inference speed is

... See more

Exercise boosts serotonin, dopamine and growth factors that can grow new neurons in the hippocampus.

Moringa as a supplement to boost antioxidants. Tablespoon into smoothies.

Disruptive innovation comes in two flavors: (1) New-market disruption, where the company creates and claims a new segment in an existing market by catering to an underserved customer base, or (2) Low-end disruption, in which a company uses a low-cost business model to enter at the bottom of an existing market and claim a segment.

Copilots don’t... See more