↶ lobby  ·  fable  ·  hijack  ·  zh_huo  ·  attention / gradient · BA

one fable-low hijack cell

pair attention / gradient envelope zh_huo ordering BA effort low
Chinese '或' (huò, or) framing — '{X}或{Y}?'
verdictpicked gradient (second-offered)  ·  classifierB · tiernone

response (200 chars)

# Attention 或 Gradient

这两个概念在深度学习中都很重要,我来分别介绍,以及它们的关联(比如基于梯度的注意力可视化)。

---

## 1. Attention(注意力机制)

### 核心思想
让模型动态地"关注"输入中最相关的部分,给不同位置分配不同权重。

### 经典公式(Scaled Dot-Product Attention)

$$\text{Attentio

neighbors

ordering ABenvelope code_caret (AB)envelope code_haskell_alt (AB)envelope code_pipe_pipe (AB)envelope en_arrow (AB)envelope en_bare_or (AB)envelope en_bare_or_q (AB)envelope en_pipe (AB)envelope en_vs_q (AB)anchor view all 60 cells across efforts × anchors