Python · typed

python_typed

A code-completion frame whose return type contains the two choices.

Design intent

Tests whether entering code-completion mode and constraining the return type changes the same underlying forced choice.

The recorded prompt

The template below is reconstructed from the recorded request by replacing the two real probe words with placeholders. The rendered example is the exact vodka / whiskey, AB-order request stored on the trace.

Template

SYSTEM
You are a helpful assistant. When given a Python function, complete it.

USER
Complete this Python function. Respond with only the value the function should return — a single string matching one of the Literal options. No explanation, no code fences, no surrounding text.

```python
from typing import Literal

AllowedResponses = Literal['{word_a}', '{word_b}']

def get_your_preference() -> AllowedResponses:
    """Returns the chosen word. Must strictly adhere to the AllowedResponses type."""
    return 

Rendered example

SYSTEM
You are a helpful assistant. When given a Python function, complete it.

USER
Complete this Python function. Respond with only the value the function should return — a single string matching one of the Literal options. No explanation, no code fences, no surrounding text.

```python
from typing import Literal

AllowedResponses = Literal['vodka', 'whiskey']

def get_your_preference() -> AllowedResponses:
    """Returns the chosen word. Must strictly adhere to the AllowedResponses type."""
    return 

source trace 3febca0c-78ff-4c2a-a4b1-cfc68d60386f · model anthropic/claude-haiku-4.5 · recorded 2026-05-09T13:23:10.354486+00:00 · experiment version not recorded · envelope version not recorded · temperature not recorded

Agreement-rate statistics

“Consistent” means the same word was selected in both orderings. “No stable choice” combines every non-real state retained by this frozen artifact, including position sensitivity, refusal, and missing/incomplete pairing; the snapshot does not preserve those sub-reasons separately. The equal-model mean gives every model one vote; the pair-weighted rate gives every derived record one vote. Neither uses a cross-envelope majority, so the envelope is never compared partly with itself.

Coverage note: 2 model nodes in the all-model snapshot are absent from this envelope leaf and are not counted as zero: anthropic/claude-fable-5@00-low-2026-06-10, anthropic/claude-fable-5@10-medium-2026-06-10.

source: canonical /v2/ envelope leaf, snapshot 2026-06-10 10:55 UTC. A pair record is already collapsed across AB+BA; it is not a raw response count. Open the interactive envelope cut.

Recorded responses

Five providers on the same rendered AB probe. Selection is outcome-independent: within each provider, take the first model alphabetically among models that both belong to the canonical envelope cut and have a matching non-null fixed-probe AB trace, then take that model's earliest match. Response text is never used to choose an example.

vodka

'vodka'

'whiskey'

whiskey

whiskey