Nicolay Gerold

Text embeddings are a critical piece of many pipelines, from search, to RAG, to vector databases and more. Most embedding models are BERT/Transformer-based and typically have short context lengths (e.g., 512). That’s only about two pages of text, but documents can be very long – books, legal cases, TV screenplays, code repositories, etc can be tens... See more

80-100 degree C for 5-20 minutes. Adjust duration and intensity to each other. Beige fat and brown fat exist around our spinal cord and clavicals and are not just storage sites like white fat. They are generating heat in our body. Young children have a lot of them because they cannot shiver, so they need them to generate heat. Fewer and bigger... See more

Content Credentials will become a flex of a creator’s humanity, a media outlet’s credibility, an artist’s attribution, and a story’s transparency. Right now, the focus of Content Credentials is around authenticity and determining whether you can trust what you’re looking at. Of course, the existence of credentials will never guarantee that the... See more

Moravec’s Paradox is the observation that high-level reasoning (e.g., chess, math) is relatively easy for computers to perform, while simple sensory tasks (e.g., perception, reflexes, mobility) are much harder.

Moravec believed that most people thought this result was the opposite of what most people expected,

It is comparatively easy to make

... See more

Detach from the code itself

Amazing engineers stay unattached to the code itself.

They were unafraid to delete and start over on code, even if they were 90% of the way in, if it meant that the end result would be better overall.

Code isn’t personal, so feedback was taken with stride.

Code isn’t perfect. Nobody cares about perfect code. They care... See more

For example, if you ask a model to “return all active users in the last 7 days” it might hallucinate a `is_active` column, join to an `activity` table that doesn’t exist, or potentially get the wrong date (especially in leap years!).

We previously talked to Shreya Rajpal at Guardrails AI, which also supports Text2SQL enforcement. Their approach was... See more

A serverless vector database

built from first principles on object storage: 10-100x cheaper, usage-based pricing, massive scalability