↶ lobby  ·  fable  ·  hijack  ·  chinese_casual  ·  fast / tradition · BA

one fable-low hijack cell

pair fast / tradition envelope chinese_casual ordering BA effort low
verdictpicked tradition (second-offered)  ·  classifierB · tiernone

response (200 chars)

您的问题有点简略,我不太确定您指的是哪个场景。可以补充一下背景吗?比如:

1. **Hugging Face Tokenizer**:是问 `use_fast=True`(fast tokenizer,Rust 实现)还是传统的 Python tokenizer?
   - 一般推荐 **fast**:速度快很多,还支持 offset mapping 等功能
   - 仅在某些模型不支持 fas

neighbors

ordering ABenvelope code_caret (AB)envelope code_haskell_alt (AB)envelope code_pipe_pipe (AB)envelope de_oder (AB)envelope en_arrow (BA)envelope en_bare_or (AB)envelope en_pipe (AB)envelope en_slash (AB)anchor view all 60 cells across efforts × anchors