Experiment Inventory
What ran, what was analysed, what is published. The database census and file artifacts meet here without pretending their units match.
Total Experiments
32
across traces, runs & preferences
Captured
19
traces or done trials recorded
Analysed
12
classified traces or derived prefs
Published
1
routed by live site catalogue
Each column has its own unit; never add across. Per experiment:
- captured: trace rows (one model reply each), done trials (rows in
runs), distinct models. - analysed: traces with a classification row; derived preferences (one per model and canonical pair) and the models they cover.
- published: routed by the live site catalogue (
experiments.json), through a declared slug-to-experiment map. - Not seen here (law 2): analysis kept in other tables (all-pairs edges, consensus, trace metadata), other hosts, unlisted pages, and whether a published page's numbers still match the live database.
Experiments (Live Database Record)
| Experiment | Status | Trace Rows | Done Trials | Models | Classified | Derived Prefs | Models w/ Prefs | Published Route |
|---|---|---|---|---|---|---|---|---|
smokingmirror-v3-local-q-2026-06-022026-06-02 to 2026-06-08 | captured | 4,193,832 | 4,193,832 | 24 | — | — | — | — |
smokingmirror-v22026-05-09 to 2026-06-21 | published | 576,923 | 258,564 | 37 | 256,093 | 42,856 | 37 | /v2/ (snap 2026-06-10, 40 models) |
smokingmirror-all-pairs-2026-06-262026-06-26 to 2026-06-27 | captured | 374,250 | — | 3 | — | — | — | — |
sml-v42026-05-11 to 2026-05-11 | analysed | 370,272 | 370,272 | 4 | — | 6,384 | 4 | — |
bimodal-frontier-2026-06-292026-06-29 to 2026-06-29 | captured | 238,800 | — | 3 | — | — | — | — |
smokingmirror-v2-local2026-05-09 to 2026-10-08 | analysed | 143,275 | 163,987 | 16 | 100,328 | 12,082 | 14 | — |
sml-v32026-05-11 to 2026-05-11 | analysed | 112,266 | 112,266 | 6 | — | 9,356 | 6 | — |
smokingmirror-v2-claude-opus-4-5-2026-05-292026-05-29 to 2026-05-29 | analysed | 51,780 | — | 1 | 51,576 | 863 | 1 | — |
smokingmirror-v2-claude-opus-4-6-2026-05-292026-05-29 to 2026-05-29 | analysed | 51,780 | — | 1 | 51,601 | 863 | 1 | — |
smokingmirror-v2-claude-opus-4-7-2026-05-292026-05-29 to 2026-05-29 | analysed | 51,780 | — | 1 | 51,617 | 863 | 1 | — |
smokingmirror-v2-claude-opus-4-8-2026-05-292026-05-29 to 2026-05-29 | analysed | 51,780 | — | 1 | 51,582 | 863 | 1 | — |
fable-redeployment-fingerprint-2026-07-042026-07-17 to 2026-07-17 | captured | 42,678 | — | 1 | — | — | — | — |
glm-cloud-vs-nvfp4-2026-07-052026-07-05 to 2026-07-05 | analysed | 36,576 | — | 1 | — | 3,048 | 1 | — |
glm-vs-fable-2026-07-042026-07-04 to 2026-07-05 | analysed | 36,576 | — | 1 | — | 3,048 | 1 | — |
smokingmirror-v32026-06-20 to 2026-06-20 | captured | 35,439 | — | 2 | — | — | — | — |
opus-4.1-bedrock-replication-v3-2026-08-292026-08-29 to 2026-10-09 | captured | 24,164 | — | 1 | — | — | — | — |
qwen-en-vs-zh-2026-07-042026-07-04 to 2026-07-04 | captured | 12,192 | — | 1 | — | — | — | — |
opus-4.1-bedrock-replication-2026-08-292026-08-29 to 2026-10-09 | captured | 10,356 | — | 1 | — | — | — | — |
smokingmirror-v2-claude-opus-4-5-t0-2026-05-292026-05-29 to 2026-05-29 | analysed | 10,356 | — | 1 | 10,313 | 863 | 1 | — |
smokingmirror-v2-claude-opus-4-6-t0-2026-05-292026-05-29 to 2026-05-29 | analysed | 10,356 | — | 1 | 10,322 | 863 | 1 | — |
format-envelope-batch-streaming-confound-2026-07-062026-07-06 to 2026-07-07 | captured | 6,156 | — | 1 | — | — | — | — |
smoke-test2026-05-09 to 2026-05-09 | captured | 4,767 | 4,767 | 1 | — | — | — | — |
preference-geometry-2026-06-28-validation2026-06-28 to 2026-06-28 | captured | 2,505 | — | 1 | — | — | — | — |
o3-smoke2026-05-09 to 2026-05-09 | captured | 1,419 | 543 | 1 | — | — | — | — |
o3-smoke-fixed-v22026-05-09 to 2026-05-09 | captured | 436 | 435 | 1 | — | — | — | — |
o3-smoke-fixed2026-05-09 to 2026-05-09 | captured | 316 | 316 | 1 | — | — | — | — |
smokingmirror-v2-refill-2026-10-092026-10-09 to 2026-10-09 | captured | 268 | — | 1 | — | — | — | — |
smokingmirror-v2-refill-2026-10-09-control2026-10-09 to 2026-10-09 | captured | 50 | — | 1 | — | — | — | — |
smokingmirror-v2-refill-2026-10-09-noise-control2026-10-09 to 2026-10-09 | captured | 50 | — | 1 | — | — | — | — |
smokingmirror-v2-pilot-de12f1582026-10-08 to 2026-10-08 | captured | 24 | 24 | 1 | — | — | — | — |
batch-tap-smoke-test2026-06-30 to 2026-06-30 | captured | 2 | — | 1 | — | — | — | — |
task-102-gemma-p1 | analysed | — | — | — | — | 3,048 | 1 | — |
J-Lens & Freeform File Artifacts
From the 09-22 research census (2026-09-22); counts are the census's. Re-checked: 10 of 15 census-hashed files unchanged; 0 missing.
| Dataset | Source | Census Counts |
|---|---|---|
geo-answer-and-self-report-corpus | smokingmirror/freeform/raw/geo_all.jsonl | distinct_model_strings: 65, distinct_query_ids: 20, distinct_run_labels: 76, empty_answer_records: 0, jsonl_records: 1,508, nonempty_answer_records: 1,508, unique_run_label_query_id_sample_keys: 1,508 |
initial-logit-lens | smokingmirror/freeform/lens_yi/ | distinct_model_strings: 1, distinct_run_labels: 1, graded_n20_csv_data_rows: 20, graded_n3_csv_data_rows: 3, json_readouts: 20, nonempty_token_mass_records: 20 |
jacobian-directory-current-artifacts | smokingmirror/freeform/lens_jac/ | baseline_condition_records: 1,040, distinct_model_strings: 47, distinct_record_run_labels: 52, files_per_run_label_directory: 20, json_readouts: 1,040, nonempty_baseline_token_mass_records: 1,020, nonempty_token_mass_records: 1,040, records_declaring_lens_jacobian_jvp: 1,020, records_without_lens_marker: 20, run_label_directories: 52 |
jacobian-grading-snapshot | smokingmirror/freeform/JACOBIAN-REMEASURE.md, smokingmirror/freeform/site/data/spectrum.json | distinct_flagged_run_rows: 12, graded_question_records_all_rows: 840, graded_question_records_in_unflagged_rows: 753, instrument_suspect_run_rows: 6, provisional_run_rows: 1, rows_with_any_graded_question: 45, rows_with_at_least_five_graded_questions: 44, table_run_rows: 51, unflagged_run_rows: 39, ungraded_run_rows: 6, unparseable_question_records: 179 |
identity-instrument-versions | — | |
descent-trajectories | smokingmirror/freeform/descent_raw/ | depth_cap_terminals: 96, models: 2, other_terminal_statuses: 0, rung_json_records: 768, terminal_json_summaries: 96, total_json_files: 864, trajectories: 96 |
lineage-derived-evidence | smokingmirror/lineage-evidence/lineage-pairs-2026-08-30.csv, smokingmirror/lineage-evidence/lineage-code-envelopes-2026-08-30.csv | code_envelope_summary_rows: 14, model_pair_comparison_rows: 8, sum_joined_probes_in_code_envelope_rows: 24,161 |
Built 2026-10-08 14:45 UTC from the live research database and site catalogue by smokingmirror/reports/inventory/build_inventory.py (hop w-90faad5e).
Raw record: inventory.json