Sublime
An inspiration engine for ideas
转：关于 DeepSeek 的研究和思考 (Archerman Capital)
关于这几天很火的 DeepSeek, 我们 (Archerman Capital) 做了一些研究和思考, 和大家分享, enjoy! 灰色部分是技术细节, 不感兴趣的可略过。
几个事实
1) DeepSeek 不是套壳不是蒸馏美国的大模型。 虽然中国有些大模型是套壳和蒸馏的, 但 DeepSeek 不是。
2) 核心架构还是基于 Transformer, deepseek 在架构、工程设计上进行了创新和工艺提升, 实现效率优化。架构上, 采用了混合专家模型 (MoE)、多头潜注意力 (MLA)、多令牌预测 (MTP)、长链式推理 (CoT)、DualPipe 算法等设计, 并进行了依赖强化学习 (RL)... See more
-What if we had a “US Department of Experiments” with the power to grant temporary waivers from Federal, State, and City laws — when safe and ethical to do so — for the purposes of learning what policy interventions actually work?
Charles Cushing • How can we fix the Market for Solutions?
Frameworks v0.2
FRAMEWORKS v0.2 Many of the thoughts in this document draw on and synthesize concepts from economics, math, physics, chemistry, biology, and psychology. Here are a handful of core concepts that are often relied on as inputs: Activation energy Behavioral economics Cognitive biases Darwinism En...
docs.google.com
What if we had a “US Department of Experiments” with the power to grant temporary waivers from Federal, State, and City laws — when safe and ethical to do so — for the purposes of learning what policy interventions actually work?
Charles Cushing • How can we fix the Market for Solutions?
There should be Retroactive Public Goods Funding for those founders crazy enough to try something truly new that failed as a business but succeeded in creating useful mutations, maybe even ticker tape parades, and certainly not derision.
Venture capital actually does a pretty great job here (the beauty of the model is a subject for a future piece, ... See more
Venture capital actually does a pretty great job here (the beauty of the model is a subject for a future piece, ... See more
Packy McCormick • The Experimentation Layer
Too good to be true
Western companies had long been so enthralled by China’s huge markets and cheap labor that they missed some red flags. China invited and allowed foreign companies to build factories typically under a setup of joint ventures, which required investors to partner with Chinese companies. It may sound like a fair request – after all
... See moreThe Econolog • China’s Chip Scheme
Earlier this year, I quietly started a grants program to experiment with alternative capital products (think grants, fellowships, advances, etc)
https://t.co/dbzM9PwRKA... See more