Google Colab
colab.research.google.com
Google Colab
Building Open Models Responsibly in the Gemini Era
opensource.googleblog.com
R1’s leap in capability and efficiency wouldn’t be possible without its foundation model, DeepSeek-V3, which was released in December 2024. V3 itself is big—671 billion parameters (by comparison, GPT4-o is rumored to be 1.8 trillion, or three times as big)—yet it’s surprisingly cost-effective to run. That’s because V3 uses a mixture of experts (MoE
... See moreEvan Armstrong • What Actually Matters (And What Doesn’t) for DeepSeek
a couple of the top of my head:
- LLM in the loop with preference optimization
- synthetic data generation
- cross modality "distillation" / dictionary remapping
- constrained decoding
r/MachineLearning - Reddit
Prof. Emily M. Bender(she/her) (@emilymbender@dair-community.social)
dair-community.social
This is called a sparse autoencoder,
Pedro Domingos • The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World
@awilkinson use @GeminiApp and Google's NotebookLM.
Gemini Advanced has a Gem Manager that works like Custom GPTs now. https://t.co/lQSpWMZ2Cj