↶ lobby  ·  fable  ·  hijack  ·  en_vs_q  ·  embedding / token · BA

one fable-low hijack cell

pair embedding / token envelope en_vs_q ordering BA effort low
English 'vs' with question mark — '{X} vs {Y}?'
verdictpicked token (second-offered)  ·  classifierB · tiernone

response (200 chars)

# Embedding vs Token

These are two related but distinct concepts in NLP and language models:

## Token
A **token** is a discrete unit of text — the result of splitting text into pieces.

- Could be a

neighbors

ordering ABenvelope code_caret (AB)envelope code_haskell_alt (AB)envelope code_pipe_pipe (AB)envelope en_arrow (AB)envelope en_bare_or (AB)envelope en_bare_or_q (AB)envelope en_pipe (AB)envelope fr_ou (AB)anchor view all 60 cells across efforts × anchors