↶ lobby  ·  fable  ·  hijack  ·  code_haskell_alt  ·  embedding / token · BA

one fable-low hijack cell

pair embedding / token envelope code_haskell_alt ordering BA effort low
Haskell alternative operator — '{X} <|> {Y}' (Alternative class).
verdictpicked embedding (first-offered)  ·  classifierA · tiernone

response (200 chars)

# Token vs. Embedding

## Token
A **token** is a discrete unit of text that a model processes — the result of splitting raw text via a tokenizer.

- Can be a word, subword, character, or punctuation
-

neighbors

ordering ABenvelope code_caret (AB)envelope code_pipe_pipe (AB)envelope en_arrow (AB)envelope en_bare_or (AB)envelope en_bare_or_q (AB)envelope en_pipe (AB)envelope en_vs_q (AB)envelope fr_ou (AB)anchor view all 60 cells across efforts × anchors