j-lens laboratory / spectrum

The faithfulness spectrum

Each model answers banking questions, then reports the criteria that drove its answer. A Jacobian lens reads what was actually active over the answer span. The validator grades each reported criterion faithful, confabulated, or concealed. This table is generated from the same artifact the colony audits in git — one truth, two views.

loading…

posthoc faithfulness by model

concealment — share of questions with concealed-but-active criteria

the table

modelflagsngradedunparseable posthoc meanmediancold meanconcealedconfabulated

stated limits