predict the next token

Every number here is real, pulled straight from running on this sentence. Watch it become tokens, then vectors, then ride one residual stream through every layer to a guess for the next word. That's the whole job of a language model. Chatbots are fine-tuned on top of exactly this.
about this page
Every number came out of the real gemma-2-2b running on this sentence (this page was rebuilt 2026-07-02 @ 03cded1 with precompute_playground.py). This is the raw model — it just continues text; the chatbots you've used are trained further on top of one like it.