Nicolay Gerold

The AI engineering framework

Marvin is a lightweight AI engineering framework for building natural language interfaces that are reliable, scalable, and easy to trust.

Sometimes the most challenging part of working with generative AI is remembering that it's not magic; it's software. It's new, it's nondeterministic, and it's incredibly powerful - but... See more

Language Models Represent Space and Time , Wes Gurnee and Max Tegmark argue that “modern LLMs acquire structured knowledge about fundamental dimensions such as space and time, supporting the view that they learn not merely superficial statistics, but literal world models”, based on some analyses of the alleged capacity of LLMs to understand geograp... See more

Wire Your Ideas with React Flow

A customizable React component for building node-based editors and interactive diagrams

NeMo Curator

NeMo Curator is a Python library specifically designed for scalable and efficient dataset preparation. It greatly accelerates data curation by leveraging GPUs with Dask and RAPIDS, resulting in significant time savings. The library provides a customizable and modular interface, simplifying pipeline expansion and accelerating model conv... See more

Whenever you write a log, it’s important you choose the correct log level.

I personally mostly use ERROR, WARNING, INFO, or DEBUG (yes there are a few more).

Log levels TLDR

• ERROR: Parts of the flow failed, we want to send alerts to our on-call for this failures.


• WARNING: Doesn’t necessarily point to a failure, but an unexpected behavior that should b

... See more

Our Goals

We made it lightweight and kept the efficiency in mind:

• Self-contained
  
  We ship a single dependency-free binary that runs on all Linux distributions


• Fast to deploy, safe to operate
  
  We are sysadmins, we know the value of operator-friendly software


• Deploy everywhere on every machine
  
  We do not have a dedicated backbone, and neither do you,
  
  so

... See more

Cortisol is derived from colestoral and is a steroid hormone like the sex hormones, but is their competitive partner. Sex hormones and cortisol compete for colestoral depending on your state. CRH is made in the Brain and causes the pituitary to release ACTH, which triggers the a drenals to release cortisol. Cortisol motivates movement and satiety.

a couple of the top of my head:

• LLM in the loop with preference optimization


• synthetic data generation


• cross modality "distillation" / dictionary remapping


• constrained decoding