Nicolay Gerold
@nicolaygerold
Nicolay Gerold
M3 max is objectively worse than the M2 for inference.
The M2 ultra has a higher max RAM size of 192 GB
The M1 ultra has 128 GB max ram.
When it comes to these ram numbers something like 2/3 of it is available for inference.
So I see no reason why not to make a general recommendation for the M1 ultra unless you have some reason you want to run q5_K_M... See more
The M2 ultra has a higher max RAM size of 192 GB
The M1 ultra has 128 GB max ram.
When it comes to these ram numbers something like 2/3 of it is available for inference.
So I see no reason why not to make a general recommendation for the M1 ultra unless you have some reason you want to run q5_K_M... See more
r/LocalLLaMA - Reddit
Workers AI? It’s another building block that we’re adding to our developer platform - one that helps developers run well-known AI models on serverless GPUs, all on Cloudflare’s trusted global network. As one of the latest additions to our developer platform, it works seamlessly with Workers + Pages, but to make it truly accessible, we’ve made it... See more
Phil Wittig • Workers AI: serverless GPU-powered inference on Cloudflare’s global network
Plasticity can be as large as in youth if there is a serious incentive for the plasticity to occur. How bad we want it or need it determines the rate and magnitude of plasticity. You cannot practice passively.
Andrew Huberman • Using Failures, Movement & Balance to Learn Faster
Synapses are the gaps between the neurons. Memories are stored in patterns of energy in neurons, similarly to a piano, where the different keys combined together form a song. The keys (electrical activity) dictates our memories and experiences.
Andrew Huberman • How Your Brain Works & Changes
The Science of How to Optimize Testosterone & Estrogen
hubermanlab.comWhenever we are fasting we are putting ourself on the edge of stress and alertness due to increased epinephrine and cortisol. If you are already highly stressed this can have averse effects.
Andrew Huberman • Using Cortisol & Adrenaline to Boost Our Energy & Immune System
Welcome to Papertube! 🎥➡️📖
Turn any YouTube podcast, TED Talk, or chat into easy-to-read text with real speaker names. Read it here or send it to your Kindle!
Turn any YouTube podcast, TED Talk, or chat into easy-to-read text with real speaker names. Read it here or send it to your Kindle!
PaperTube
Don't just randomly draw boxes and arrows. There are some important, well-defined diagrams that are extremely useful for software dev:
→ Sequence diagrams
→ Architecture diagrams
→ Entity-relationship diagrams
→ State machine diagrams
→ Component diagrams (dependencies)
→ Sequence diagrams
→ Architecture diagrams
→ Entity-relationship diagrams
→ State machine diagrams
→ Component diagrams (dependencies)
David K @DavidKPiano
Observing these patterns of influence gives clues about how our models generalize from their training data. For instance, if the models responded to user prompts by splicing together sequences from the training set, then we’d expect the influential sequences for a given model response to include expressions of near-identical thoughts. Conversely,... See more
Anthropic \ Tracing Model Outputs to the Training Data
Memorization vs learning concepts and forming models of the world.