Definition
Token
A piece of text as the model counts it, usually shorter than a word. It is the unit a context window is measured in, which is why the same document can fit one model and not another.
Industry term
- Only means anything inside
- LLM