Introduction to Generative AI

Key Innovations in Model Architecture

Two innovations have driven a lot of the recent improvements in Generative AI:

1. Encoder-decoder system: two neural networks that compress and then expand the data


2. Attention mechanism: ensures that important information isn't lost in the compression and expansion process, by "paying attention" to the important pi

... See more