↶ lobby · fable · hijack · code_caret · attention / weights · BA

one fable-low hijack cell

pair attention / weights envelope code_caret ordering BA effort low

Code-flavored caret operator — '{X} ^ {Y}'

response (200 chars)

# Attention Weights

Attention weights are the core mechanism in transformer models that determine **how much each token should "focus on" every other token**.

## How They're Computed

Given queries

neighbors

ordering AB envelope code_haskell_alt (AB)envelope code_pipe_pipe (AB)envelope en_arrow (AB)envelope en_bare_or (AB)envelope en_bare_or_q (AB)envelope en_pipe (AB)envelope en_vs_q (AB)envelope fr_ou (AB)anchor view all 60 cells across efforts × anchors