predict the next token
Every number here is real, pulled straight from
running on this sentence. Watch it become tokens, then vectors, then ride one residual stream through every layer to a guess for the next word. That's the whole job of a language model. Chatbots are fine-tuned on top of exactly this.
about this page
Every number came out of the real
gemma-2-2b
running on this sentence (this page was rebuilt 2026-07-02 @ 03cded1 with
precompute_playground.py).
This is the raw model — it just continues text; the chatbots you've used are trained further on top of one like it.