Nicolay Gerold
@nicolaygerold
Nicolay Gerold
Gemma Scope Tutorial
This is a barebones tutorial on how to use Gemma Scope, Google DeepMind's suite of Sparse Autoencoders (SAEs) on every layer and sublayer of Gemma 2 2B and 9B. Sparse Autoencoders are an interpretability tool that act like a "microscope" on language model activations. They let us zoom in on dense, compressed activations, and... See more
This is a barebones tutorial on how to use Gemma Scope, Google DeepMind's suite of Sparse Autoencoders (SAEs) on every layer and sublayer of Gemma 2 2B and 9B. Sparse Autoencoders are an interpretability tool that act like a "microscope" on language model activations. They let us zoom in on dense, compressed activations, and... See more
Google Colab
HelixNet is a Deep Learning architecture consisting of 3 x Mistral-7B LLMs. It has an actor, a critic, and a regenerator. The actor LLM produces an initial response to a given system-context and a question. The critic then takes in as input, a tuple of (system-context, question, response) and provides a critique based on the provided answer to the... See more
migtissera/HelixNet · Hugging Face
Sandbox for AI Apps & Agents
Secure sandboxed cloud environments made for AI agents and AI apps
Secure sandboxed cloud environments made for AI agents and AI apps
Sandbox for AI Apps & Agents
Building social bonds: gaze, vocalization, affect, touch.
Andrew Huberman • The Science of Emotions & Relationships
The solution: The ingestion service
To meet these unique demands, the Search Infrastructure team implemented the Ingestion Service to gracefully handle Twitter’s traffic trends. The Ingestion Service queues requests from the client service into a single Kafka topic per Elasticsearch cluster. Worker clients then read from this topic and send the... See more
To meet these unique demands, the Search Infrastructure team implemented the Ingestion Service to gracefully handle Twitter’s traffic trends. The Ingestion Service queues requests from the client service into a single Kafka topic per Elasticsearch cluster. Worker clients then read from this topic and send the... See more
Stability and scalability for search
Sodium Bicarbonate can help you better regulate your pH levels, which is the main signal for fatigue. Energy production increases acidity as a side effect. You could do that with baking soda (roughly half a spoon dissolved in water). It increase the alkaline levels → during exercise.
Andrew Huberman • Dr. Andy Galpin: How to Build Strength, Muscle Size & Endurance
How much do you think we’re going to get tons of specialization versus no, once the brain gets big enough and we do these fine tunings, that’s going to be it. It will be like AWS, GCP, and Azure.
Ali: I think the answer is closer to the latter. It’s going to have lots of specialization. Having said that, it’s not a dichotomy in the sense that maybe... See more
Ali: I think the answer is closer to the latter. It’s going to have lots of specialization. Having said that, it’s not a dichotomy in the sense that maybe... See more
Ali Ghodsi • AI Food Fights in the Enterprise
1. Introduction of DeepSeek Coder
DeepSeek Coder is composed of a series of code language models, each trained from scratch on 2T tokens, with a composition of 87% code and 13% natural language in both English and Chinese. We provide various sizes of the code model, ranging from 1B to 33B versions. Each model is pre-trained on project-level code... See more
DeepSeek Coder is composed of a series of code language models, each trained from scratch on 2T tokens, with a composition of 87% code and 13% natural language in both English and Chinese. We provide various sizes of the code model, ranging from 1B to 33B versions. Each model is pre-trained on project-level code... See more
deepseek-ai • GitHub - deepseek-ai/DeepSeek-Coder: DeepSeek Coder: Let the Code Write Itself
orch
orch is a library for building language model powered applications and agents for the Rust programming language. It was primarily built for usage in magic-cli, but can be used in other contexts as well.
Note
If the project gains traction, this can be compiled as an addon to other languages such as Python or a standalone WebAssembly module.
Instal... See more
orch is a library for building language model powered applications and agents for the Rust programming language. It was primarily built for usage in magic-cli, but can be used in other contexts as well.
Note
If the project gains traction, this can be compiled as an addon to other languages such as Python or a standalone WebAssembly module.
Instal... See more