The Illustrated Transformer

The Illustrated Transformer

Jay Alammar jalammar.github.io

Saved by Andrés and

RelatedHighlightsCollectionsNotes

A Visual and Interactive Guide to the Basics of Neural Networks

Jay Alammar jalammar.github.io

Thumbnail of A Visual and Interactive Guide to the Basics of Neural Networks

Luc Cheung and added

Thumbnail of www-x-com-virattt-status-1797364685576003820

I finally understand how GPT generates text. Really helps to code it from scratch in Python. There are 5 components: • token embeddings • positional embeddings • transformer blocks • layer normalization • output head It sounds complex, but grokking GPT is simple. Token embeddings turn input text into meaningful vectors that capture semantic mea... See more

BA Builder added

AI + Blockchain research. How gpt works from scratch

What Is ChatGPT Doing … and Why Does It Work?

writings.stephenwolfram.com writings.stephenwolfram.com

Thumbnail of What Is ChatGPT Doing … and Why Does It Work?

and added

在这项工作中,我们提出了 Transformer 模型架构,它摒弃了递归,而是完全依赖注意力机制来绘制输入和输出之间的全局依赖关系。Transformer 可以大大提高并行化程度,在 8 个 P100 GPU 上只需 12 个小时的训练,就能达到翻译质量的新高度。

Attention Is All You Need

Marvin Chang added

8 Google Employees Invented Modern AI. Here’s the Inside Story

By Steven Levy wired.com

Thumbnail of 8 Google Employees Invented Modern AI. Here’s the Inside Story

RP and added

AI Revolution - Transformers and Large Language Models (LLMs)

Elad Gil blog.eladgil.com

Thumbnail of AI Revolution - Transformers and Large Language Models (LLMs)

sari and added

What Is ChatGPT Doing ... And Why Does It Work?

Stephen Wolfram • 6 highlights

Cover of What Is ChatGPT Doing ... And Why Does It Work?

Transformer Explainer: LLM Transformer Model Visually Explained

Polo Chau poloclub.github.io

Thumbnail of Transformer Explainer: LLM Transformer Model Visually Explained

Shawn Kilburn and added