Nicolay Gerold

In 2021, researchers made a striking discovery while training a series of tiny models on toy tasks [1]. They found a set of models that suddenly flipped from memorizing their training data to correctly generalizing on unseen inputs after training for much longer. This phenomenon – where generalization seems to happen abruptly and long after fitting... See more

Meet Quill

Your AI-Powered Financial Research Assistant

Some Data on the Opportunity & Desire for Trust: As we’ve discussed before in Implications, the new “trust, but verify” is becoming “verify, then trust” as we enter an era in which we can no longer believe our eyes. Here are a few key findings worth sharing from a research study our team recently did at Adobe:

In the US, 70% of people said it’s... See more

Google gives you Ten Blue Links, which communicates “it might be one of these - see what you think” (and turns us all into Mechanical Turks, giving Google feedback by picking the best answer). But a chat bot gives you three paragraphs of text with apparent certainty as The Answer, and footnotes, a click-through disclaimer and a ‘be careful!’... See more

Tempo training feels different than we expect.

Not a lot of huffing of the breath.

No burning in the legs.

Heart rate responds slowly.

Aim for a 3 out of 5 subjective feeling - Zone 3 / Moderately-Hard

When we are learning, aim for 20-30 minutes total dose of work. Aim for a rest duration that is shorter than the work duration.

Sample sets would be:

4-6... See more

Pipeline RobustQA Avg. score Avg. response time (secs) Azure Cognitive Search Retriever + GPT4 + Ada 72.36 >1.0s Canopy (Pinecone) 59.61 >1.0s Langchain + Pinecone + OpenAI 61.42 <0.8s Langchain + Pinecone + Cohere 69.02 <0.6s LlamaIndex + Weaviate Vector Store - Hybrid Search 75.89 <1.0s RAG Google Cloud VertexAI-Search + Bison... See more

React Components for the Google Maps JavaScript API

This is a TypeScript / JavaScript library to integrate the Maps JavaScript API into your React application. It comes with a collection of React components to create maps, markers and infowindows, and a set of hooks to use some of the Maps JavaScript API Services and Libraries.

Installation

This... See more

Jazz.ToolsPowerSyncFireproofAutomergeDXOSElectricSQLand of course, Berlin's own: Yjs .

• How valuable is what I’m doing?


• What makes this hard for others to do?


• Could this get dramatically easier because of what others launch or how the industry evolves?


• If this does get easier, do I have a “Plan B” to create differentiated value?
  
  Note: An early version of this post appeared in my personal blog (still a work in progress). Decided to

... See more