How LLMs Generate Text

Watch step by step how a language model produces text token by token

Tokenization

LLMs see the world in sub-words — tokens, not whole words. Type text and see the tokens.

Based on all previous tokens, the statistically best next token is selected.

Prompt

Write one short sentence about coffee.

Temperature

Max tokens

This demo runs on prepared examples. In the course you work with your own input.

Color by probability

Click "Generate" to see the output.