Nicolay Gerold
@nicolaygerold
Nicolay Gerold
Google: what does it take to make it bigger? Set a lower threshold for what opportunities to pursue.
lennysnewsletter.com • Shreyas Doshi on Pre-Mortems, the LNO Framework, the Three Levels of Product Work, Why Most Execution Problems Are Strategy Problems, and ROI vs. Opportunity Cost Thinking
How much do you think we’re going to get tons of specialization versus no, once the brain gets big enough and we do these fine tunings, that’s going to be it. It will be like AWS, GCP, and Azure.
Ali: I think the answer is closer to the latter. It’s going to have lots of specialization. Having said that, it’s not a dichotomy in the sense that maybe... See more
Ali: I think the answer is closer to the latter. It’s going to have lots of specialization. Having said that, it’s not a dichotomy in the sense that maybe... See more
Ali Ghodsi • AI Food Fights in the Enterprise
Haven Landing Page
usehaven.ai
It evolved to keep our vital needs satiated and not for any pleasurable experience or indulgence. Dopamine is about the desire to do more to reduce pain. Your desire for something consists of the pleasure of the experience and the pain you have when you don’t Experience it.
Andrew Huberman • How to Increase Motivation & Drive | Huberman Lab Podcast #12
- The generative AI revolution is swiftly giving rise to a myriad of startups, with an increasing need to categorize them by their function in the AI landscape, including foundational model providers, infrastructure enablers, and application developers.
- Generative AI is transforming industries across the globe, not just in Silicon Valley, with... See more
- Generative AI is transforming industries across the globe, not just in Silicon Valley, with... See more
Shortwave — The smartest email app on planet Earth
MLEs are happy to delegate experiment tracking and execution work to ML experiment execution frameworks, such as Weights & Biases 3 , but prefer to choose subsequent experiments themselves. To be able to make informed choices of subsequent experiments to run, MLEs must maintain awareness of what they have tried and what they haven’t (Lg2 calls it... See more
Shreya Shankar • "We Have No Idea How Models will Behave in Production until Production": How Engineers Operationalize Machine Learning.
learnings from one experiment into the next, like a guided search to find the best idea (Lg2, Sm4,
Lg5). Lg5 described their ideological shift from random search to guided search:
Previously, I tried to do a lot of parallelization. If I focus on one idea, a week at a time,
then it boosts my productivity a lot more.
By following a guided search, engineers are, essentially, significantly pruning a large subset of
experiment ideas without executing them. While it may seem like there are unlimited computational
resources, the search space is much larger, and developer time and energy is limited. At the end of
the day, experiments are human-validated and deployed. Mature ML engineers know their personal
tradeoff between parallelizing disjoint experiment ideas and pipelining ideas that build on top of
each other, ultimately yielding successful deployments
Disruptive innovation comes in two flavors: (1) New-market disruption, where the company creates and claims a new segment in an existing market by catering to an underserved customer base, or (2) Low-end disruption, in which a company uses a low-cost business model to enter at the bottom of an existing market and claim a segment.
Copilots don’t... See more
Copilots don’t... See more
Shortwave — rajhesh.panchanadhan@gmail.com [Gmail alternative]
Completely unstyled, fully accessible UI components, designed to integrate beautifully with Tailwind CSS.
Headless UI
DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference
Table of Contents
1. Introduction
Large... See more
Table of Contents
- Introduction
- Key LLM Serving Techniques
- Dynamic SplitFuse: A Novel Prompt and Generation Composition Strategy
- Performance Evaluation
- DeepSpeed-FastGen: Implementation and Usage
- Try out DeepSpeed-FastGen
- Acknowledgements
1. Introduction
Large... See more