Sublime

🧵 (1/n) 👉 Introducing QuIP#, a new SOTA LLM quantization method that uses incoherence processing from QuIP & lattices to achieve 2 bit LLMs with near-fp16 performance! Now you can run LLaMA 2 70B on a 24G GPU w/out offloading! 💻 https://t.co/eM8Br2CqL3 https://t.co/BviPUOedKW

I work for the government. As a technologist, I cannot keep this under wraps anymore. There is a government-funded organization that is already experimenting with a quantum computer they call Miya, and it is orders of magnitude more powerful than Google's Willow. https://t.co/84dtVW5N1G

The next big innovation in hardware may be DNA-based storage. It gets >1 exabyte/gram of storage. Catalog, a Boston co, wrote 16GB of Wikipedia to DNA and achieved 1mbps write speeds. Durability / energy are still issues, but we could store the internet in our palms. https://t.co/CiAUjtcMbA