Sublime
An inspiration engine for ideas
Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task
Analyzes cognitive impacts of using large language models versus search engines or no tools during essay writing, measuring brain activity, engagement, memory effects, essay quality, ownership, and learning outcomes through EEG and NLP methods.
Link- Manual autograd engine - hand derived backprop steps.
- 2x to 5x faster than QLoRA. 50% less memory usage.
- All kernels written in OpenAI's Triton language.
- 0% loss in accuracy - no approximation methods - all exact.
- No change of hardware necessary. Supports NVIDIA GPUs since 2018+. Minimum CUDA Compute Cap
unslothai • GitHub - unslothai/unsloth: 5X faster 50% less memory LLM finetuning
Sam Altman on Which AI Startups Will Win
youtube.comI'm more interested in algorithmic agency – ELAN ULLENDORFF
advanced chatbots that incorporated elements of machine learning were being developed. One of the most notorious was Tay, a creation of Microsoft in 2016. Tay was designed to mimic
Ethan Mollick • Co-Intelligence: Living and Working with AI
But the networks themselves were still severely limited in what they could do. Accurate results to complex problems required many layers of artificial neurons, but researchers hadn’t found a way to efficiently train those layers as they were added. Deep learning’s big technical break finally arrived in the mid-2000s, when leading researcher Geoffre
... See moreKai-Fu Lee • AI Superpowers: China, Silicon Valley, and the New World Order
maintain the Transformers Python library, which is used for NLP tasks, includes implementations of state-of-the-art and popular models like Mistral 7B, BERT, and GPT-2, and is compatible with PyTorch, TensorFlow, and JAX.
Ben Auffarth • Generative AI with LangChain: Build large language model (LLM) apps with Python, ChatGPT, and other LLMs
Generative adversarial networks In a “generative adversarial network,” or GAN, you create two neural networks and make them face off. The “generator” network tries to make something fake, and the “discriminator” guesses whether or not the generator’s creation is real or not.[1402] The networks get into a sort of arms race, with the generator trying
... See more