AI glossary Models & Architecture
What is Token?
← All glossary termsBasic unit of text for the model; ~4 characters in English.
Explained
A token is the basic unit of text that a model processes. In English, roughly 4 characters or 0.75 words per token. Token count drives cost and context window limits for LLM APIs.