one fable-low hijack cell
pair Token / Vector
envelope code_pipe_pipe
ordering BA
effort low
Code-flavored OR operator — '{X} || {Y}'
verdictpicked Token (first-offered)
· classifierA
· tiernone
response (200 chars)
# Vector vs. Token
These two concepts are fundamental to how language models (like me) process text:
## Token
A **token** is a chunk of text — the basic unit a model reads.
- Can be a word, subword
neighbors