Nicolay Gerold

4. Introducing Stable LM 3B: Bringing Sustainable, High-Performance Language Models to Smart Devices

Stability AI introduced Stable LM 3B, a high-performing language model designed for smart devices. With 3 billion parameters, it outperforms state-of-the-art 3B models and reduces operating costs and power consumption. The model enables a broader... See more

What is feder

Feder is a JavaScript tool designed to aid in the comprehension of embedding vectors. It visualizes index files from Faiss, HNSWlib, and other ANN libraries to provide insight into how these libraries function and the concept of high-dimensional vector embeddings. Currently, Feder is primarily focused on the IVF_FLAT index file type... See more

Problem:

People aren't ordering drinks with their meals: While 95% of Americans have access to alcohol delivery, only 10% place orders.

Opportunity:

• Put a tasty beverage in the hands of the 100+ million Americans ordering delivery food, right when they need one.


• Food delivery apps can nearly double cart size and revenue.

Solution:

... See more

Prioritize work to minimize opportunity cost. This prevents you from only pursuing incremental futures. In each quarter how much time to allocate incremental ~ 60%, to big new initiatives ~30%, to guidance & infrastructure ~10%.

Twitter: network effects and code product differentiation creates lasting defensibility.

1. Meta Quietly Unveils Llama 2 Long AI That Beats GPT-3.5 Turbo and Claude 2 on Some Tasks

Meta is releasing Llama 2 Long, an enhanced version of Llama 2 that underwent continual pretraining with longer training sequences and upsampled long texts. By adding 400 billion tokens and making minor changes to the Rotary Positional Embedding (RoPE), Llama... See more

Several engineers also maintained fallback models for reverting to: either older or simpler versions (Lg2, Lg3, Md6, Lg5, Lg6). Lg5 mentioned that it was important to always keep some model up and running, even if they “switched to a less economic model and had to just cut the losses.” Similarly, when doing data science work, both Passi and Jackson... See more

Some techniques I have seen in the wild

Create a semi-strict programming language like promptlang - https://github.com/ruvnet/promptlang

this style was popular back in the early days of gpt-3.5 when it landed, for some reason, it fell out of fashion

Write a super long persona mapping prompt with a well defined action space

Best example of this is the... See more

Ventral medial hypothalamus: control station for hunger, eating and satiety through multiple populations of neurons, which respectively control hunger and satiety.