Рет қаралды 78,919
How do language models like GPT and Palm work?
Part 1: • Large Language Mo...
See next: text-to-image (Parti, Imagen, Dall-E): • Text to Image in ...
0:00 - intro
0:14 - next word prediction
0:20 - word embeddings
1:01 - transformers
3:11 - generating text
4:13 - stacking attention layers
4:47 - training data
5:21 - GPT-3 examples