all refusals — every model, every pair it would not commit to

For each of the 43 model nodes in the observatory, this page counts the probe pairs where the model failed to register a real preference — refused outright, hedged into "no preference," or generated AB/BA position bias rather than a stable opinion.

Definitional caveat. The non-commitment count comes from the fingerprint string in triangles.json: characters are A, B, or N. N conflates true refusals with two adjacent failure modes — order-bias (model said different things AB vs BA) and cross-envelope ambivalence (different envelopes elected different sides). It's the most generous available "didn't commit" signal. For Fable specifically, we have the raw response traces and can resolve the three categories cleanly — see fable_refusals.html for the full deep dive on basin drift.

Three sections: a per-family summary, the per-model leaderboard, and the per-pair controversy list (which pairs were refused by the most models — these are the genuinely contested probes in the observatory).

per family

familymodelsno-commit cellsrate
deepseek53,72686.3%
openai117,49178.9%
google42,63076.2%
x-ai31,31950.9%
anthropic205,61732.5%

per model — leaderboard

familymodelno-commit pairsratebar
deepseekdeepseek-v3.278591.0%
openaigpt-5.4-nano76989.1%
deepseekdeepseek-chat-v376088.1%
deepseekdeepseek-v4-pro75887.8%
openaigpt-5.4-mini72684.1%
deepseekdeepseek-v4-flash71983.3%
openaigpt-4o-mini71282.5%
deepseekdeepseek-r170481.6%
openaigpt-5.469680.6%
openaigpt-5-nano68879.7%
googlegemini-2.5-pro68379.1%
openaigpt-4o68379.1%
googlegemini-3.1-flash-lite67277.9%
openaio4-mini67277.9%
openaigpt-5-mini66276.7%
openaio365776.1%
googlegemini-3.1-pro-preview64775.0%
googlegemini-3-flash-preview62872.8%
openaigpt-562672.5%
openaigpt-5.560069.5%
anthropicclaude-opus-4.158167.3%
x-aigrok-454062.6%
anthropicclaude-sonnet-4.644651.7%
x-aigrok-4.344051.0%
anthropicclaude-opus-4.542849.6%
anthropicclaude-opus-4-5@2026-05-2941748.3%
anthropicclaude-opus-4-5-t0@2026-05-2941648.2%
anthropicclaude-haiku-4.537243.1%
anthropicclaude-opus-4.633939.3%
x-aigrok-4-fast33939.3%
anthropicclaude-sonnet-432437.5%
anthropicclaude-sonnet-4.532337.4%
anthropicclaude-opus-4-6-t0@2026-05-2931836.8%
anthropicclaude-opus-4-8@2026-05-2931436.4%
anthropicclaude-opus-4-6@2026-05-2931336.3%
anthropicclaude-opus-4.727531.9%
anthropicclaude-opus-4-7@2026-05-2925529.5%
anthropicclaude-opus-425329.3%
anthropicclaude-fable-5@00-low-2026-06-10   traces ▸637.3%
anthropicclaude-fable-5@10-medium-2026-06-10   traces ▸526.0%
anthropicclaude-fable-5@20-high-2026-06-10   traces ▸495.7%
anthropicclaude-fable-5@30-xhigh-2026-06-10   traces ▸404.6%
anthropicclaude-fable-5@40-max-2026-06-10   traces ▸394.5%

per pair — most-refused (top 80)

Pairs refused by the most models. The genuinely contested probes — where multiple labs' models independently declined to take a side. Cross-family pill rows are the most interesting: those are pairs where Anthropic, OpenAI, DeepSeek, Google, and xAI all have at least one node that wouldn't commit.
pair# refusingsourcefamiliesrefusers (first 6)
Argentina / Chile41country:regionaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Korea / Vietnam41war:memorydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
known-vuln / zero-day40war:codedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
paella / risotto40food:contested_dishdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
recon / stealth40war:codedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Chinese / European40identitydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Feature / Weights40new_x_newdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
kludge / salaried39anchor:hackdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
precision / recall39concept:training_methodologydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, o3 …
Portugal / Spain39country:regionaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Token / individual39new_x_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
soy / wheat39food_anchor:soydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Greek food / Turkish food39food:nationaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gemini-3-flash-preview, deepseek-chat-v3, o3 …
horizon / wings39new_triangle:rooteddeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
Hack / commodity39new_x_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
shell / stone39anchor:shelldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Portuguese food / Spanish food38food:nationaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
halal / kosher38food:religiousdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
azure / go38anchor:rustdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Thai food / Vietnamese food38food:nationaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
duty / technology38new_triangle:creationdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Java / Ruby38new_x_newdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
data / model38concept:scalingdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
hyperparameter / validation37concept:training_methodologydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
morning / summer37new_triangle:restdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
migration / regulation37new_triangle:geopoliticaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
countryside / local37v1_triangle:landscapedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
closed weights / proprietary37concept:opennessdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, deepseek-chat-v3, o3 …
night / silence37new_triangle:restdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
anchor / change37new_triangle:resiliencedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
tradition / vintage37v1_triangle:progressdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
American / European37identitydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, deepseek-chat-v3, o3 …
conform / obey37new_triangle:moral_compassdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
hyperparameter / recall37concept:training_methodologydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Argentina / Brazil37country:powerdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
Norway / Sweden37country:regionaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
Atlanta / Georgia37country_anchor:Georgiadeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
oysters / sardines36food:classdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
dissent / resist36new_triangle:moral_compassdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
activations / gradient36concept:model_internalsdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Japanese food / Korean food36food:nationaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, deepseek-chat-v3, o3, gemini-2.5-pro …
duty / treaty36cross:geo_cuisine_war_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Gradient / Vector36new_x_newdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, o3 …
Greece / chicken36country_anchor:Turkeydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
language / model36concept:scalingdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
centralised / proprietary36concept:opennessdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
container / payload36war:codedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
roots / sail36new_triangle:rooteddeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Egypt / Israel36country:regionaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Ireland / UK36country:regionaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5.4-nano, gemini-3-flash-preview, o3, gemini-2.5-pro …
Chinese / tradition36new_x_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Assembly / gathering36new_x_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, deepseek-chat-v3, o3 …
Label / name36new_x_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
hearth / roots36new_triangle:rooteddeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Scotland / UK36country:contesteddeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
craft / handmade36v1_triangle:craftdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
hyperparameter / precision36concept:training_methodologydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
commodity / slow36v1_triangle:craftdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, deepseek-chat-v3, gemini-2.5-pro …
potato / truffle36food:classdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
carve / salaried36anchor:hackdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gemini-3-flash-preview, deepseek-chat-v3, o3 …
Kosovo / Serbia36country:contesteddeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
France / Germany35country:powerdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
change / fast35cross_clusterdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Model / essence35new_x_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Russia / war35cross:geo_cuisine_war_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3, o3 …
Recall / Score35new_x_newdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Canada / USA35country:regionaldeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
embedding / weights35concept:model_internalsdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, deepseek-chat-v3, o3 …
scotch / whiskey35v1_triangle:vicedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
optimism / privacy35new_triangle:epistemicdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
data / vision35concept:scalingdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
horizon / sail35new_triangle:rooteddeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gemini-3-flash-preview, deepseek-chat-v3, o3 …
Atlanta / anonymous35country_anchor:Georgiadeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
bourbon / duty35cross_clusterdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
clean / savings35anchor:debtdeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
state / trance35anchor:statedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, o3 …
China / Hong Kong35country:contesteddeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Score / scoreboard35new_x_v1deepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, deepseek-chat-v3, o3 …
loyalty / roots35v1_triangle:allegiancedeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …
Coventry / Dresden35war:memorydeepseekopenaigoogleanthropicx-aideepseek-v3.2, gpt-5-nano, gpt-5, gpt-5.4-nano, gemini-3-flash-preview, deepseek-chat-v3 …