Dhi
Brain
AI
Unknowns
Learn
V
Visitor
add the new piece · run again
Learned weights · ~8 billion numbers, set by training
<system>
Be helpful…
<user>
<assistant>
Why is the sky
blue?
Your message
wrapped in a chat envelope
Tokenizer
text → pieces
Token IDs
pieces → numbers
Embedding table
number → 4,096 numbers
Position
RoPE rotation
TRANSFORMER BLOCK
× 32
── residual stream: a shared notebook every part writes into
Norm
Why
is
the
sky
blue
?
Self-attention
Norm
MLP
KV cache
128 KiB per piece
Score every word
~128,000 scores
Sampler
spin the spinner
Reply
streamed piece by piece
Brain
AI
Unknowns
Learn
Brain
AI
Unknowns
Learn