2024 Tech Trends
2024 Tech Trends discusses the latest advancements and challenges in AI, enterprise software development, cybersecurity, global employment, quantum computing, and other key areas shaping the tech industry.
cbinsights.com2024 Tech Trends
a laptop, the compute used for Google DeepMind’s Gemini Ultra, released in 2023, would be the size of New York City.46 In this period, the compute used to train each frontier model doubled every six months—four times faster than Moore’s law predicts.47
Dwarkesh Patel • The Scaling Era: An Oral History of AI, 2019–2025
On top of that, V3 embraced multi-token prediction (MTP). Rather than predicting text one word at a time and inspired by Meta’s FAIR (Fundamental AI Research) team’s ideas toward building "Better & Faster Large Language Models via Multi-token Prediction," it predicts multiple words simultaneously. Finally, a trick called FP8 training
... See moreEvan Armstrong • What Actually Matters (And What Doesn’t) for DeepSeek
An O’Reilly survey found that those with mature AI practices (as measured by how long they’ve had models in production) cited a “lack of data or data quality issues” as the main bottleneck holding back further ML adoption.
Astasia Myers • 4 Data Trends to Watch in 2020
- The generative AI revolution is swiftly giving rise to a myriad of startups, with an increasing need to categorize them by their function in the AI landscape, including foundational model providers, infrastructure enablers, and application developers.
- Generative AI is transforming industries across the globe, not just in Silicon Valley, with imp... See more
- Generative AI is transforming industries across the globe, not just in Silicon Valley, with imp... See more