↶ lobby  ·  fable  ·  hijack  ·  code_pipe_pipe  ·  Token / Vector · AB

one fable-low hijack cell

pair Token / Vector envelope code_pipe_pipe ordering AB effort low
Code-flavored OR operator — '{X} || {Y}'
verdictpicked Token (first-offered)  ·  classifierA · tiernone

response (200 chars)

# Token vs. Vector

These are two fundamental concepts in how language models process text:

## Token
A **token** is a chunk of text — the basic unit a model reads.

- Words, subwords, or characters: 

neighbors

ordering BAenvelope chinese_casual (AB)envelope code_caret (AB)envelope code_haskell_alt (AB)envelope de_oder (AB)envelope en_arrow (AB)envelope en_bare_or (AB)envelope en_bare_or_q (AB)envelope en_pipe (AB)anchor view all 60 cells across efforts × anchors