Nicolay Gerold

The Knowledge Graph enables you to search for things, people or places that Google knows about—landmarks, celebrities, cities, sports teams, buildings, geographical features, movies, celestial objects, works of art and more—and instantly get information that’s relevant to your query. This is a critical first step towards building the next... See more

Glaive-coder-7b

Glaive-coder-7b is a 7B parameter code model trained on a dataset of ~140k programming related problems and solutions generated from Glaive’s synthetic data generation platform.

The model is fine-tuned on the CodeLlama-7b model.

Usage:

The model is trained to act as a code assistant, and can do both single instruction following and... See more

There probably are circuits that bias is towards alertness or interoception vs. exteroception.

Creatine Monohydrate: best supplement.

Quality of sugar: most energy for the least amount of extraction. You want to habituate yourself to food that takes more work to minimize craving.

Phi-1.5

Phi-1.5 is a "small" 1.3 billion parameter LLM with an impressive performance for its size.

Annotated figures from the Textbooks Is All You Need II paper

How does this small model accomplish such a good performance? The secret ingredient seems to be the high-quality data.

The pretraining is based on the Textbooks Is All You Need approach that... See more

Some tasks are easier to improve via system design. While LLMs appear to follow remarkable scaling laws that predictably yield better results with more compute, in many applications, scaling offers lower returns-vs-cost than building a compound system. For example, suppose that the current best LLM can solve coding contest problems 30% of the

... See more

CCK is released from the GI tract when we digest fatty acids (Omega 3, 6), amino acids (especially glutamine) and sugar. We mostly eat until we consumed enough fatty acids and amino acids to trigger CCK. CCK then puts the break on a-GRP neurons.