one fable-low hijack cell
pair Token / Vector
envelope en_vs_q
ordering BA
effort low
English 'vs' with question mark — '{X} vs {Y}?'
verdictpicked Vector (second-offered)
· classifierB
· tiernone
response (200 chars)
# Token vs Vector
These are two related but distinct concepts in NLP and LLMs:
## Token
A **token** is a discrete unit of text — the "chunk" a model reads.
- Created by a *tokenizer* splitting text
neighbors