Learn · Models and how they work
What is Language model?
The slightly longer version
A language model is a computer program trained on a huge amount of text. Its main job is simple: look at some words and predict the next small piece of text, called a token (a word or part of a word). It does this again and again, very fast, and sentences appear. It learns patterns, not facts in a book, so it can sound right and still be wrong.
A chatbot like ChatGPT or Claude is a product built around a language model. The chat window, the memory and the safety rules are extra layers. The same engine can also run quietly inside other software: a coding tool, a phone agent, or even malware. Some models are big and live in a company's cloud. Others are "open-weight", meaning you can download them and run them on your own computer.
How a language model writes
- Read lots of textThe model is trained on a huge pile of written text.
- Learn patternsIt learns which words usually follow other words.
- Get a promptSomeone, or some software, gives it a starting text.
- Predict next tokenIt guesses the most likely next piece of text, again and again.
- Used in productsChatbots, coding tools, phone agents, and even malware wrap around it.
This week, Cisco Talos described Volta, an infostealer that uses a language model to rank its victims by how much they are worth. No chat window, no human typing questions: the engine works quietly inside criminal software. And the Memdoor project shows five small open models working as a team on your own machine. Once you see the model as an engine, not a chatbot, you understand why it can show up anywhere, for good or for bad.
What to watch out for
A language model predicts text; it does not understand or check truth like a person does, so it can say false things with confidence. Claims that small models "beat" big ones often come from one project's own tests, not independent reviews. And because the engine can be downloaded and plugged into anything, the safety rules of the big labs do not follow it everywhere.
Where it showed up
This notion came up in November starts with holes in the labs' own walls. More lessons: Learn.
Sources
Written on 2026-11-01. This explanation was accurate on that day. AI changes fast, so check the sources and the date before you rely on it.
Get The AI Daily Grind by email, every morning, in simple words.