🤖 How does ChatGPT actually work?
The honest answer: it predicts the next word. Here's what that really means.
3 min read
Strip away the hype and ChatGPT does one thing: it predicts what word comes next. Type 'The cat sat on the...' and it guesses 'mat' — because it has read so much text that 'mat' is the most likely next word. That's the whole trick, repeated billions of times.
It learned this by reading a huge slice of the internet. During training it saw trillions of sentences and learned the patterns: how words follow each other, how arguments are structured, how a recipe sounds different from an email. It never 'understands' anything the way you do — it's learned the *shape* of language so well that its next-word guesses form coherent, useful answers.
When you chat with it, two more pieces kick in. First, it's been fine-tuned to be helpful — to answer the question you asked rather than just continue your sentence. Second, it reads your whole conversation back each time, so it can 'remember' context within a chat. That's why it can follow a thread.
The key thing to remember: it's not looking anything up, and it's not thinking. It's assembling the most probable answer. Usually that's exactly right. Sometimes it's confidently wrong — we call that a 'hallucination'. It's the same mechanism producing both.
How text becomes tokens
Type a word and see how a model would split it into "tokens" — the chunks it actually reads. Usually smaller than a word, and spaces count.
3 tokens
Roughly ¾ of an English word per token. This is a simplified demonstration — real models use a much larger vocabulary.
Watch how your words get broken into 'tokens' — the building blocks the model actually predicts.
🕒 Try it in 60 seconds
- 1Open any AI chat and type: 'Explain something to me like I'm five.'
- 2Then ask a follow-up question and notice how it remembers the earlier context.
- 3Finally ask it to 'make up a story about a purple elephant' — then ask what year the elephant was born, and watch it invent an answer. That's the prediction engine, unfiltered.
Keep going
Want the full picture?
Get the free 5-day "AI in your job" email course — jargon-free, five minutes a day.