Nicolay Gerold

Sometimes they just need the model that actually fits for their specific use case and it’s far more economical. We want people to build on top of our models and we want to give them tools to make that easy. We want to give them more and more access and control, so you can bring your data and customize these models. And you can really focus on the... See more

More than reading popular books on Design Patterns, two things that helped me write and structure a large codebase better were

reading a lot of good open source codebases (with similar stack)coding and collaborating a lot on the same codebase

I understand the importance of reading general-purpose design patterns, but they might not suit your... See more

Pheromone: substance secreted from one member of a species acting on other members or other species. Oxytocin: released after sex, pair bonding, social bonding, touching. It increases syncing internal states and raises awareness for the emotional states of others. Vitamin D might increase levels of oxytocin.

The way that most RLHF is done to date has the entire response from a language model get an associated score. To anyone with an RL background, this is disappointing, because it limits the ability for RL methods to make connections about the value of each sub-component of text. Futures have been pointed to where this multi-step optimization comes at... See more

This dataset is an attempt to replicate the results of Microsoft's Orca

Our dataset consists of:

~1 million of FLANv2 augmented with GPT-4 completions (flan1m-alpaca-uncensored.jsonl)

~3.5 million of FLANv2 augmented with GPT-3.5 completions (flan5m-alpaca-uncensored.jsonl)

We followed the submix and system prompt distribution outlined in the Orca... See more

How do models represent style, and how can we more precisely extract and steer it?

A commonly requested feature in almost any LLM-based writing application is “I want the AI to respond in my style of writing,” or “I want the AI to adhere to this style guide.” Aside from costly and complicated multi-stage finetuning processes like Anthropic’s RL with... See more

Neuromodulators bias which circuits are active and which are not.