EnigmaForge

▶ Try one instance yourself — the question is hidden in the story

The benchmark where a model must find the problem before it can solve it.

120
Worlds
600
Scored items
27
Models compared
gpt-6-astra · 80.3/100
Current leader

2026-09-24T03:37:15+00:00 · 600 instances · 120 world families · methodology under “Benchmark details”

The leaderboard at a glance

gpt-6-astra leads: task success 80.3/100 (482/600 items), fact F1 90.6/100, 550/600 items answered. Solid baselines: constraint-solver and story-copy bound the scale.

Task success (/100)

gpt-6-astragpt-6-astra · task success: 80.380.3$41.17gpt-6-solgpt-6-sol · task success: 74.274.2$11.68gemini-3.7-flashgemini-3.7-flash · task success: 68.768.7$4.82gpt-5.6-solgpt-5.6-sol · task success: 68.568.5$13.24gemini-3.8-flashgemini-3.8-flash · task success: 5959$5.76glm-5.3glm-5.3 · task success: 53.253.2$60.84gpt-5.6-terragpt-5.6-terra · task success: 50.750.7$13.30deepseek-4.1-flashdeepseek-4.1-flash · task success: 48.748.7$4.25gemini-3.6-flashgemini-3.6-flash · task success: 43.743.7$7.60deepseek-v4-prodeepseek-v4-pro · task success: 42.742.7$17.24gpt-6-lunagpt-6-luna · task success: 42.342.3$0.81claude-sonnet-5claude-sonnet-5 · task success: 41.841.8$19.14gpt-5.6-lunagpt-5.6-luna · task success: 41.741.7$1.64claude-opus-5.5claude-opus-5.5 · task success: 39.839.8$25.75claude-fable-5claude-fable-5 · task success: 39.539.5$61.89mimo-v2.6-flashmimo-v2.6-flash · task success: 38.838.8$0.75mimo-v2.6-promimo-v2.6-pro · task success: 3838$2.57claude-opus-5claude-opus-5 · task success: 37.237.2$27.32grok-4.6grok-4.6 · task success: 3737$20.26kimi-k2.6kimi-k2.6 · task success: 36.536.5$26.30minimax-m3minimax-m3 · task success: 33.833.8$3.35qwen3.8-27bqwen3.8-27b · task success: 33.733.7$2.69kimi-k3kimi-k3 · task success: 31.231.2$12.17glm-5.3-flashglm-5.3-flash · task success: 25.825.8$3.24claude-haiku-4.5claude-haiku-4.5 · task success: 23.723.7$9.05glm-4.7-flashglm-4.7-flash · task success: 19.519.5$9.87claude-fable-5.1claude-fable-5.1 · task success: 1.71.7$2.40task success

All scores are 0–100; higher is better. Deterministic baselines appear in the tables only: a perfect-information solver marks the ceiling, and a text-copier marks the floor at zero.

Open the full performance table (per metric: all-item and scored-only, with confidence intervals)

How to read this benchmark

What a model must do

Every item is a short story that hides a set of definite facts and a rule for what should happen next. The model reads the story and must report the facts it is sure of, plus the action the rule calls for. Everything is exact: a fact is right or wrong, an action is right or wrong.

Finding the problem is scored

The same world is presented three ways: as a plain list of rules, as a story with the question stated, and as a story with no question at all. Discovery retention shows how much performance survives when the model is not told what it is looking for — the benchmark's signature measure.

Three honesty checks

Reasoning discipline flags models that burn their entire thinking budget without producing an answer. Earned decisions counts actions that were correct with a fully correct world, separating insight from lucky guessing. A story-copying control is graded alongside every model and must score zero — if it doesn't, the leaderboard is void.

How to interpret the scores
Score (0–100)What it means
Task successShare of items where the model reported every fact exactly right and took the action the rule requires. The headline measure.
Fact F1Balance of how many stated facts were right vs how many of the hidden facts were found. Forgives a few misses; punishes wrong claims.
Discovery retentionPerformance without a stated question, relative to with one. 100 means finding the problem cost nothing.
Reasoning disciplineShare of items answered without running out of thinking budget first.
Earned decisionsCorrect actions that came with a fully correct world — the no-luckiness measure.

Why it is different

How EnigmaForge differs
Typical benchmarksEnigmaForge
The question is statedThe question is hidden in the story
Hand-written itemsEvery world is generated and machine-verified
One checked answerAnswer plus the rule that justifies it
A right-sounding guess scoresGuesses are measured and shown separately
Scores can be gamed by copyingCopying the source text scores zero

Every EnigmaForge item is a short mystery with a machine-checked answer. Here is how one is made, in plain terms.

1 · Write a hidden rulebook

Each world starts as a list of secret facts — which record says what — and clues that connect them. No story exists yet.

2 · Prove there is exactly one answer

A checker proves two things before anything is written down: the clues have exactly one possible set of facts, and every clue is needed — remove any one and other answers become possible. No broken puzzles.

3 · Hide it in a story

Each clue becomes one sentence, woven into a story with extra scenes that mean nothing. A second, differently written story hides the same puzzle, so a model can't memorise the wording.

4 · Ask, three ways

The same puzzle goes out three ways: as a bare list of rules, as a story with the question stated, and as a story with no question at all. The last version is the real test — the model must notice there is something to solve.

5 · Grade exactly, not generously

The model must state each fact as 'this record equals this value' and name the action the rule requires. Paraphrase and partial credit are not awarded: values are checked letter-for-letter against the secret rulebook.

6 · Score it four ways

Solving (did it get everything right?), discovery (what did it keep when the question was hidden?), discipline (did it answer instead of running out of thinking room?), and honesty (were its right answers earned, or lucky?).

A note on honesty: the story-copying control is graded alongside every model. It submits the raw text as its answer and must score zero — a standing proof that the leaderboard cannot be gamed by copying.

How scores work

All scores are 0-100; lower is worse. Headline measure: fact F1. Ranking: all-item task success, then all-item fact F1, then provider name. No weighted composite. Conditional means use scored-item denominators; all-item means include missing, filtered, invalid, and failed attempts as zero achieved success. Unadjudicated outcomes remain unavailable. Decisions and task success use policy-bearing items only. Derived diagnostics: discovery cost is the conditional-F1 drop from a stated task (explicit) to an unstated one (implicit) — the price of finding the problem; reasoning overflow is the share of items where the model exhausted max_tokens without visible output; educated guesses are decisions that were correct while the submitted world was not exactly right. Answered includes invalid content; valid means a schema-compliant scored answer. Confidence intervals resample world families, not realizations.

Recorded solver attempt costs only; not full experimental spend.

claude-sonnet-5: 155/600 attempts were blocked by the provider's content filter before any answer. These count as missing mass in all-item scores; treat this row as a lower bound, not a capability estimate.

claude-fable-5: 206/600 attempts were blocked by the provider's content filter before any answer. These count as missing mass in all-item scores; treat this row as a lower bound, not a capability estimate.

claude-opus-5: 176/600 attempts were blocked by the provider's content filter before any answer. These count as missing mass in all-item scores; treat this row as a lower bound, not a capability estimate.

kimi-k3: 157/600 attempts failed in transport (network/provider errors, no response). These count as missing mass in all-item scores; treat this row as a lower bound, not a capability estimate.

claude-fable-5.1: 585/600 attempts were blocked by the provider's content filter before any answer. These count as missing mass in all-item scores; treat this row as a lower bound, not a capability estimate.

Coverage and recorded costs
ProviderExpectedRecordedAnsweredValidMissingFilteredTransport errorInvalid responseJudge errorAdjudication requiredRecorded attempt costKnown-cost records
baseline:constraint-solver600600600600000000—0
baseline:forward-chain600600600600000000—0
gpt-6-astra6006005505500050000$41.1670550
gpt-6-sol600600600598000200$11.6764600
gemini-3.7-flash600600600598000200$4.8211600
gpt-5.6-sol600600600600000000$13.2369600
gemini-3.8-flash600600598597002100$5.7595600
glm-5.36006005635570036700$60.8358600
gpt-5.6-terra600600600600000000$13.2981600
deepseek-4.1-flash600600595595005000$4.2486600
gemini-3.6-flash600600600596000400$7.5967600
deepseek-v4-pro600600598592000800$17.2358600
gpt-6-luna600600600599000100$0.8073600
claude-sonnet-5600600445429015501600$19.1364450
gpt-5.6-luna600600600599000100$1.6427600
claude-opus-5.5600600591591090000$25.7479600
claude-fable-560060039339202061100$61.8898449
mimo-v2.6-flash6006005945830061100$0.7466595
mimo-v2.6-pro6006005935730002700$2.5694600
claude-opus-5600600424389017603500$27.3236429
grok-4.6600600600600000000$20.2564600
kimi-k2.6600600599599001000$26.2999600
minimax-m36006005975850001500$3.3520600
qwen3.8-27b6006006005850001500$2.6885600
kimi-k360060044344300157000$12.1732443
glm-5.3-flash600600596593004300$3.2404600
claude-haiku-4.5600600600591000900$9.0504600
glm-4.7-flash60060056554300342300$9.8742600
claude-fable-5.1600600141405851000$2.400414
baseline:direct-facts600600600600000000—0
baseline:story-copy600600600000060000—0

Levels are configured strata, not calibrated capability ceilings. Charts show scored-only fact F1 per provider; tables add all-item values and intervals (family clusters).

level · fact_f1 (/100)00 · gpt-6-astra: 960 · gpt-6-sol: 93.50 · gemini-3.7-flash: 98.20 · gpt-5.6-sol: 94.60 · gemini-3.8-flash: 96.70 · glm-5.3: 91.40 · gpt-5.6-terra: 900 · deepseek-4.1-flash: 91.80 · gemini-3.6-flash: 95.40 · deepseek-v4-pro: 91.60 · gpt-6-luna: 89.80 · claude-sonnet-5: 92.20 · gpt-5.6-luna: 88.60 · claude-opus-5.5: 93.20 · claude-fable-5: 96.40 · mimo-v2.6-flash: 90.20 · mimo-v2.6-pro: 89.20 · claude-opus-5: 91.50 · grok-4.6: 90.10 · kimi-k2.6: 93.50 · minimax-m3: 87.60 · qwen3.8-27b: 92.40 · kimi-k3: 94.40 · glm-5.3-flash: 87.50 · claude-haiku-4.5: 83.40 · glm-4.7-flash: 690 · claude-fable-5.1: 10011 · gpt-6-astra: 991 · gpt-6-sol: 96.81 · gemini-3.7-flash: 97.11 · gpt-5.6-sol: 96.91 · gemini-3.8-flash: 96.41 · glm-5.3: 95.31 · gpt-5.6-terra: 86.11 · deepseek-4.1-flash: 87.31 · gemini-3.6-flash: 90.31 · deepseek-v4-pro: 92.81 · gpt-6-luna: 86.71 · claude-sonnet-5: 95.71 · gpt-5.6-luna: 83.31 · claude-opus-5.5: 92.81 · claude-fable-5: 95.81 · mimo-v2.6-flash: 86.71 · mimo-v2.6-pro: 85.61 · claude-opus-5: 84.61 · grok-4.6: 90.61 · kimi-k2.6: 93.31 · minimax-m3: 76.91 · qwen3.8-27b: 87.41 · kimi-k3: 92.51 · glm-5.3-flash: 81.51 · claude-haiku-4.5: 78.81 · glm-4.7-flash: 7622 · gpt-6-astra: 992 · gpt-6-sol: 96.42 · gemini-3.7-flash: 95.82 · gpt-5.6-sol: 91.92 · gemini-3.8-flash: 91.12 · glm-5.3: 96.82 · gpt-5.6-terra: 84.72 · deepseek-4.1-flash: 83.32 · gemini-3.6-flash: 86.42 · deepseek-v4-pro: 93.22 · gpt-6-luna: 80.52 · claude-sonnet-5: 942 · gpt-5.6-luna: 73.82 · claude-opus-5.5: 92.92 · claude-fable-5: 92.72 · mimo-v2.6-flash: 86.22 · mimo-v2.6-pro: 81.52 · claude-opus-5: 80.32 · grok-4.6: 89.42 · kimi-k2.6: 91.72 · minimax-m3: 68.32 · qwen3.8-27b: 87.62 · kimi-k3: 89.82 · glm-5.3-flash: 74.32 · claude-haiku-4.5: 71.52 · glm-4.7-flash: 72.133 · gpt-6-astra: 99.73 · gpt-6-sol: 983 · gemini-3.7-flash: 90.23 · gpt-5.6-sol: 94.83 · gemini-3.8-flash: 84.33 · glm-5.3: 82.33 · gpt-5.6-terra: 82.13 · deepseek-4.1-flash: 77.13 · gemini-3.6-flash: 75.43 · deepseek-v4-pro: 90.83 · gpt-6-luna: 85.23 · claude-sonnet-5: 89.33 · gpt-5.6-luna: 85.73 · claude-opus-5.5: 94.33 · claude-fable-5: 953 · mimo-v2.6-flash: 74.13 · mimo-v2.6-pro: 73.93 · claude-opus-5: 79.93 · grok-4.6: 90.13 · kimi-k2.6: 88.83 · minimax-m3: 65.23 · qwen3.8-27b: 86.13 · kimi-k3: 76.63 · glm-5.3-flash: 61.33 · claude-haiku-4.5: 60.23 · glm-4.7-flash: 61.63 · claude-fable-5.1: 10044 · gpt-6-astra: 99.74 · gpt-6-sol: 984 · gemini-3.7-flash: 83.34 · gpt-5.6-sol: 85.44 · gemini-3.8-flash: 77.44 · glm-5.3: 73.94 · gpt-5.6-terra: 76.54 · deepseek-4.1-flash: 68.94 · gemini-3.6-flash: 68.94 · deepseek-v4-pro: 92.64 · gpt-6-luna: 73.94 · claude-sonnet-5: 85.24 · gpt-5.6-luna: 80.64 · claude-opus-5.5: 93.24 · claude-fable-5: 95.84 · mimo-v2.6-flash: 75.24 · mimo-v2.6-pro: 68.44 · claude-opus-5: 71.54 · grok-4.6: 89.64 · kimi-k2.6: 88.14 · minimax-m3: 60.34 · qwen3.8-27b: 75.54 · kimi-k3: 67.84 · glm-5.3-flash: 54.14 · claude-haiku-4.5: 57.34 · glm-4.7-flash: 64.14 · claude-fable-5.1: 97.855 · gpt-6-astra: 99.55 · gpt-6-sol: 97.25 · gemini-3.7-flash: 83.35 · gpt-5.6-sol: 82.55 · gemini-3.8-flash: 73.25 · glm-5.3: 70.65 · gpt-5.6-terra: 71.15 · deepseek-4.1-flash: 67.25 · gemini-3.6-flash: 60.65 · deepseek-v4-pro: 885 · gpt-6-luna: 72.65 · claude-sonnet-5: 84.35 · gpt-5.6-luna: 76.25 · claude-opus-5.5: 93.25 · claude-fable-5: 96.95 · mimo-v2.6-flash: 645 · mimo-v2.6-pro: 615 · claude-opus-5: 78.35 · grok-4.6: 87.25 · kimi-k2.6: 87.85 · minimax-m3: 52.55 · qwen3.8-27b: 72.95 · kimi-k3: 13.35 · glm-5.3-flash: 44.75 · claude-haiku-4.5: 57.15 · glm-4.7-flash: 58.35 · claude-fable-5.1: 98.1gpt-6-astragpt-6-solgemini-3.7-flashgpt-5.6-solgemini-3.8-flashglm-5.3gpt-5.6-terradeepseek-4.1-flashgemini-3.6-flashdeepseek-v4-progpt-6-lunaclaude-sonnet-5gpt-5.6-lunaclaude-opus-5.5claude-fable-5mimo-v2.6-flashmimo-v2.6-proclaude-opus-5grok-4.6kimi-k2.6minimax-m3qwen3.8-27bkimi-k3glm-5.3-flashclaude-haiku-4.5glm-4.7-flashclaude-fable-5.1
scenario · fact_f1 (/100)stratastrata · gpt-6-astra: 98.8strata · gpt-6-sol: 96.6strata · gemini-3.7-flash: 91.3strata · gpt-5.6-sol: 91strata · gemini-3.8-flash: 86.5strata · glm-5.3: 85.2strata · gpt-5.6-terra: 81.8strata · deepseek-4.1-flash: 79.4strata · gemini-3.6-flash: 79.5strata · deepseek-v4-pro: 91.5strata · gpt-6-luna: 81.5strata · claude-sonnet-5: 90.2strata · gpt-5.6-luna: 81.4strata · claude-opus-5.5: 93.3strata · claude-fable-5: 95.5strata · mimo-v2.6-flash: 79.3strata · mimo-v2.6-pro: 76.6strata · claude-opus-5: 81.1strata · grok-4.6: 89.5strata · kimi-k2.6: 90.6strata · minimax-m3: 68.5strata · qwen3.8-27b: 83.6strata · kimi-k3: 85strata · glm-5.3-flash: 67.1strata · claude-haiku-4.5: 68strata · glm-4.7-flash: 67.1strata · claude-fable-5.1: 98.2gpt-6-astragpt-6-solgemini-3.7-flashgpt-5.6-solgemini-3.8-flashglm-5.3gpt-5.6-terradeepseek-4.1-flashgemini-3.6-flashdeepseek-v4-progpt-6-lunaclaude-sonnet-5gpt-5.6-lunaclaude-opus-5.5claude-fable-5mimo-v2.6-flashmimo-v2.6-proclaude-opus-5grok-4.6kimi-k2.6minimax-m3qwen3.8-27bkimi-k3glm-5.3-flashclaude-haiku-4.5glm-4.7-flashclaude-fable-5.1
condition · fact_f1 (/100)explicitexplicit · gpt-6-astra: 99.1explicit · gpt-6-sol: 95explicit · gemini-3.7-flash: 96.9explicit · gpt-5.6-sol: 97.2explicit · gemini-3.8-flash: 95.3explicit · glm-5.3: 85.7explicit · gpt-5.6-terra: 96.3explicit · deepseek-4.1-flash: 95.3explicit · gemini-3.6-flash: 83.7explicit · deepseek-v4-pro: 92.7explicit · gpt-6-luna: 92.2explicit · claude-sonnet-5: 93.1explicit · gpt-5.6-luna: 94.5explicit · claude-opus-5.5: 92.8explicit · claude-fable-5: 93.7explicit · mimo-v2.6-flash: 90.2explicit · mimo-v2.6-pro: 84.6explicit · claude-opus-5: 85.8explicit · grok-4.6: 88explicit · kimi-k2.6: 92.4explicit · minimax-m3: 69.5explicit · qwen3.8-27b: 86.5explicit · kimi-k3: 85explicit · glm-5.3-flash: 65.1explicit · claude-haiku-4.5: 68explicit · glm-4.7-flash: 63.9explicit · claude-fable-5.1: 100formalformal · gpt-6-astra: 100formal · gpt-6-sol: 99.2formal · gemini-3.7-flash: 100formal · gpt-5.6-sol: 100formal · gemini-3.8-flash: 100formal · glm-5.3: 98.3formal · gpt-5.6-terra: 100formal · deepseek-4.1-flash: 100formal · gemini-3.6-flash: 100formal · deepseek-v4-pro: 97.5formal · gpt-6-luna: 100formal · claude-sonnet-5: 93.3formal · gpt-5.6-luna: 100formal · claude-opus-5.5: 100formal · claude-fable-5: 100formal · mimo-v2.6-flash: 96.3formal · mimo-v2.6-pro: 97.3formal · grok-4.6: 100formal · kimi-k2.6: 100formal · minimax-m3: 97.5formal · qwen3.8-27b: 95.8formal · kimi-k3: 100formal · glm-5.3-flash: 99formal · claude-haiku-4.5: 98.3formal · glm-4.7-flash: 90.4formal · claude-fable-5.1: 100implicitimplicit · gpt-6-astra: 97.8implicit · gpt-6-sol: 97.1implicit · gemini-3.7-flash: 81.4implicit · gpt-5.6-sol: 80.4implicit · gemini-3.8-flash: 70.9implicit · glm-5.3: 77.8implicit · gpt-5.6-terra: 58.1implicit · deepseek-4.1-flash: 53.3implicit · gemini-3.6-flash: 65implicit · deepseek-v4-pro: 87.3implicit · gpt-6-luna: 61.5implicit · claude-sonnet-5: 83.3implicit · gpt-5.6-luna: 58.9implicit · claude-opus-5.5: 90.3implicit · claude-fable-5: 94.7implicit · mimo-v2.6-flash: 59.8implicit · mimo-v2.6-pro: 58.3implicit · claude-opus-5: 75.4implicit · grok-4.6: 85.7implicit · kimi-k2.6: 84implicit · minimax-m3: 52.9implicit · qwen3.8-27b: 74.6implicit · kimi-k3: 77.2implicit · glm-5.3-flash: 53.2implicit · claude-haiku-4.5: 53implicit · glm-4.7-flash: 57.8implicit · claude-fable-5.1: 97.3gpt-6-astragpt-6-solgemini-3.7-flashgpt-5.6-solgemini-3.8-flashglm-5.3gpt-5.6-terradeepseek-4.1-flashgemini-3.6-flashdeepseek-v4-progpt-6-lunaclaude-sonnet-5gpt-5.6-lunaclaude-opus-5.5claude-fable-5mimo-v2.6-flashmimo-v2.6-proclaude-opus-5grok-4.6kimi-k2.6minimax-m3qwen3.8-27bkimi-k3glm-5.3-flashclaude-haiku-4.5glm-4.7-flashclaude-fable-5.1
realization · fact_f1 (/100)00 · gpt-6-astra: 1000 · gpt-6-sol: 99.20 · gemini-3.7-flash: 1000 · gpt-5.6-sol: 1000 · gemini-3.8-flash: 1000 · glm-5.3: 98.30 · gpt-5.6-terra: 1000 · deepseek-4.1-flash: 1000 · gemini-3.6-flash: 1000 · deepseek-v4-pro: 97.50 · gpt-6-luna: 1000 · claude-sonnet-5: 93.30 · gpt-5.6-luna: 1000 · claude-opus-5.5: 1000 · claude-fable-5: 1000 · mimo-v2.6-flash: 96.30 · mimo-v2.6-pro: 97.30 · grok-4.6: 1000 · kimi-k2.6: 1000 · minimax-m3: 97.50 · qwen3.8-27b: 95.80 · kimi-k3: 1000 · glm-5.3-flash: 990 · claude-haiku-4.5: 98.30 · glm-4.7-flash: 90.40 · claude-fable-5.1: 10011 · gpt-6-astra: 98.41 · gpt-6-sol: 96.11 · gemini-3.7-flash: 89.61 · gpt-5.6-sol: 87.71 · gemini-3.8-flash: 82.11 · glm-5.3: 80.81 · gpt-5.6-terra: 77.61 · deepseek-4.1-flash: 75.11 · gemini-3.6-flash: 74.51 · deepseek-v4-pro: 891 · gpt-6-luna: 75.71 · claude-sonnet-5: 88.41 · gpt-5.6-luna: 751 · claude-opus-5.5: 91.61 · claude-fable-5: 94.51 · mimo-v2.6-flash: 76.81 · mimo-v2.6-pro: 70.61 · claude-opus-5: 79.21 · grok-4.6: 86.51 · kimi-k2.6: 88.21 · minimax-m3: 59.41 · qwen3.8-27b: 82.31 · kimi-k3: 79.91 · glm-5.3-flash: 60.81 · claude-haiku-4.5: 60.11 · glm-4.7-flash: 61.41 · claude-fable-5.1: 96.522 · gpt-6-astra: 98.52 · gpt-6-sol: 962 · gemini-3.7-flash: 88.72 · gpt-5.6-sol: 89.82 · gemini-3.8-flash: 84.12 · glm-5.3: 82.42 · gpt-5.6-terra: 76.82 · deepseek-4.1-flash: 73.22 · gemini-3.6-flash: 74.22 · deepseek-v4-pro: 90.92 · gpt-6-luna: 77.92 · claude-sonnet-5: 89.82 · gpt-5.6-luna: 78.52 · claude-opus-5.5: 91.52 · claude-fable-5: 93.82 · mimo-v2.6-flash: 73.22 · mimo-v2.6-pro: 72.22 · claude-opus-5: 832 · grok-4.6: 87.12 · kimi-k2.6: 88.22 · minimax-m3: 632 · qwen3.8-27b: 78.82 · kimi-k3: 82.22 · glm-5.3-flash: 57.32 · claude-haiku-4.5: 60.82 · glm-4.7-flash: 60.32 · claude-fable-5.1: 100gpt-6-astragpt-6-solgemini-3.7-flashgpt-5.6-solgemini-3.8-flashglm-5.3gpt-5.6-terradeepseek-4.1-flashgemini-3.6-flashdeepseek-v4-progpt-6-lunaclaude-sonnet-5gpt-5.6-lunaclaude-opus-5.5claude-fable-5mimo-v2.6-flashmimo-v2.6-proclaude-opus-5grok-4.6kimi-k2.6minimax-m3qwen3.8-27bkimi-k3glm-5.3-flashclaude-haiku-4.5glm-4.7-flashclaude-fable-5.1
genre · fact_f1 (/100)hotelhotel · gpt-6-astra: 98.7hotel · gpt-6-sol: 96hotel · gemini-3.7-flash: 89.5hotel · gpt-5.6-sol: 92.3hotel · gemini-3.8-flash: 85.9hotel · glm-5.3: 84.9hotel · gpt-5.6-terra: 80.3hotel · deepseek-4.1-flash: 82.4hotel · gemini-3.6-flash: 80.7hotel · deepseek-v4-pro: 94.3hotel · gpt-6-luna: 78.1hotel · claude-sonnet-5: 89.1hotel · gpt-5.6-luna: 84.2hotel · claude-opus-5.5: 93.2hotel · claude-fable-5: 95.3hotel · mimo-v2.6-flash: 80.2hotel · mimo-v2.6-pro: 80hotel · claude-opus-5: 84.7hotel · grok-4.6: 89.9hotel · kimi-k2.6: 90.5hotel · minimax-m3: 68.3hotel · qwen3.8-27b: 84hotel · kimi-k3: 83.4hotel · glm-5.3-flash: 68.3hotel · claude-haiku-4.5: 68.4hotel · glm-4.7-flash: 65.1hotel · claude-fable-5.1: 90.9manormanor · gpt-6-astra: 98.9manor · gpt-6-sol: 95.6manor · gemini-3.7-flash: 92.8manor · gpt-5.6-sol: 90manor · gemini-3.8-flash: 89.4manor · glm-5.3: 82.6manor · gpt-5.6-terra: 82.6manor · deepseek-4.1-flash: 80.9manor · gemini-3.6-flash: 80.6manor · deepseek-v4-pro: 94.1manor · gpt-6-luna: 82.4manor · claude-sonnet-5: 91.8manor · gpt-5.6-luna: 82.7manor · claude-opus-5.5: 94.5manor · claude-fable-5: 96.2manor · mimo-v2.6-flash: 83.8manor · mimo-v2.6-pro: 83manor · claude-opus-5: 74.4manor · grok-4.6: 89.3manor · kimi-k2.6: 91.2manor · minimax-m3: 72.7manor · qwen3.8-27b: 85.7manor · kimi-k3: 87.6manor · glm-5.3-flash: 70.8manor · claude-haiku-4.5: 75.4manor · glm-4.7-flash: 70.4manor · claude-fable-5.1: 99.3maritimemaritime · gpt-6-astra: 98.5maritime · gpt-6-sol: 96.5maritime · gemini-3.7-flash: 89.7maritime · gpt-5.6-sol: 87.8maritime · gemini-3.8-flash: 86.7maritime · glm-5.3: 86maritime · gpt-5.6-terra: 80maritime · deepseek-4.1-flash: 83.1maritime · gemini-3.6-flash: 79.6maritime · deepseek-v4-pro: 88.7maritime · gpt-6-luna: 77.8maritime · claude-sonnet-5: 93.3maritime · gpt-5.6-luna: 79.5maritime · claude-opus-5.5: 93.7maritime · claude-fable-5: 96maritime · mimo-v2.6-flash: 79.2maritime · mimo-v2.6-pro: 77.5maritime · claude-opus-5: 81.9maritime · grok-4.6: 90maritime · kimi-k2.6: 93maritime · minimax-m3: 63.2maritime · qwen3.8-27b: 83.7maritime · kimi-k3: 87.9maritime · glm-5.3-flash: 67.3maritime · claude-haiku-4.5: 70.3maritime · glm-4.7-flash: 70.3maritime · claude-fable-5.1: 98.1observatoryobservatory · gpt-6-astra: 99.2observatory · gpt-6-sol: 97.1observatory · gemini-3.7-flash: 91.7observatory · gpt-5.6-sol: 90.2observatory · gemini-3.8-flash: 85.1observatory · glm-5.3: 83.6observatory · gpt-5.6-terra: 82.8observatory · deepseek-4.1-flash: 73observatory · gemini-3.6-flash: 80.6observatory · deepseek-v4-pro: 92.2observatory · gpt-6-luna: 85observatory · claude-sonnet-5: 93.2observatory · gpt-5.6-luna: 79.7observatory · claude-opus-5.5: 92.4observatory · claude-fable-5: 93.8observatory · mimo-v2.6-flash: 77observatory · mimo-v2.6-pro: 71.9observatory · claude-opus-5: 81.8observatory · grok-4.6: 89.6observatory · kimi-k2.6: 89.8observatory · minimax-m3: 61.9observatory · qwen3.8-27b: 82.6observatory · kimi-k3: 79.7observatory · glm-5.3-flash: 65observatory · claude-haiku-4.5: 60.7observatory · glm-4.7-flash: 69.9observatory · claude-fable-5.1: 100theatertheater · gpt-6-astra: 98.6theater · gpt-6-sol: 97.4theater · gemini-3.7-flash: 92.1theater · gpt-5.6-sol: 93.1theater · gemini-3.8-flash: 86.1theater · glm-5.3: 87.8theater · gpt-5.6-terra: 82.4theater · deepseek-4.1-flash: 79.2theater · gemini-3.6-flash: 77.2theater · deepseek-v4-pro: 89theater · gpt-6-luna: 82.4theater · claude-sonnet-5: 88.4theater · gpt-5.6-luna: 80.9theater · claude-opus-5.5: 92.9theater · claude-fable-5: 96.7theater · mimo-v2.6-flash: 77.7theater · mimo-v2.6-pro: 73.4theater · claude-opus-5: 81.3theater · grok-4.6: 88.9theater · kimi-k2.6: 89.5theater · minimax-m3: 73.5theater · qwen3.8-27b: 82.8theater · kimi-k3: 87.5theater · glm-5.3-flash: 65.5theater · claude-haiku-4.5: 67.5theater · glm-4.7-flash: 62.5theater · claude-fable-5.1: 98.6gpt-6-astragpt-6-solgemini-3.7-flashgpt-5.6-solgemini-3.8-flashglm-5.3gpt-5.6-terradeepseek-4.1-flashgemini-3.6-flashdeepseek-v4-progpt-6-lunaclaude-sonnet-5gpt-5.6-lunaclaude-opus-5.5claude-fable-5mimo-v2.6-flashmimo-v2.6-proclaude-opus-5grok-4.6kimi-k2.6minimax-m3qwen3.8-27bkimi-k3glm-5.3-flashclaude-haiku-4.5glm-4.7-flashclaude-fable-5.1
renderer · fact_f1 (/100)templatetemplate · gpt-6-astra: 98.8template · gpt-6-sol: 96.6template · gemini-3.7-flash: 91.3template · gpt-5.6-sol: 91template · gemini-3.8-flash: 86.5template · glm-5.3: 85.2template · gpt-5.6-terra: 81.8template · deepseek-4.1-flash: 79.4template · gemini-3.6-flash: 79.5template · deepseek-v4-pro: 91.5template · gpt-6-luna: 81.5template · claude-sonnet-5: 90.2template · gpt-5.6-luna: 81.4template · claude-opus-5.5: 93.3template · claude-fable-5: 95.5template · mimo-v2.6-flash: 79.3template · mimo-v2.6-pro: 76.6template · claude-opus-5: 81.1template · grok-4.6: 89.5template · kimi-k2.6: 90.6template · minimax-m3: 68.5template · qwen3.8-27b: 83.6template · kimi-k3: 85template · glm-5.3-flash: 67.1template · claude-haiku-4.5: 68template · glm-4.7-flash: 67.1template · claude-fable-5.1: 98.2gpt-6-astragpt-6-solgemini-3.7-flashgpt-5.6-solgemini-3.8-flashglm-5.3gpt-5.6-terradeepseek-4.1-flashgemini-3.6-flashdeepseek-v4-progpt-6-lunaclaude-sonnet-5gpt-5.6-lunaclaude-opus-5.5claude-fable-5mimo-v2.6-flashmimo-v2.6-proclaude-opus-5grok-4.6kimi-k2.6minimax-m3qwen3.8-27bkimi-k3glm-5.3-flashclaude-haiku-4.5glm-4.7-flashclaude-fable-5.1
level
ProviderlevelExpectedAnsweredFact F1 · all itemsFact F1 · scored onlyExact world · all itemsExact world · scored onlyTask success · all itemsTask success · scored only
baseline:constraint-solver0100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:constraint-solver1100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:constraint-solver2100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:constraint-solver3100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:constraint-solver4100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:constraint-solver5100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:forward-chain0100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:forward-chain110010099.3% (n=100)99.3% (n=100)95.0% (n=100)95.0% (n=100)95.0% (n=100)95.0% (n=100)
baseline:forward-chain2100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:forward-chain3100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
baseline:forward-chain410010099.8% (n=100)99.8% (n=100)95.0% (n=100)95.0% (n=100)95.0% (n=100)95.0% (n=100)
baseline:forward-chain5100100100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)100.0% (n=100)
gpt-6-astra010010096.0% (n=100)96.0% (n=100)65.0% (n=100)65.0% (n=100)65.0% (n=100)65.0% (n=100)
gpt-6-astra11009796.0% (n=100)99.0% (n=97)82.0% (n=100)84.5% (n=97)82.0% (n=100)84.5% (n=97)
gpt-6-astra210010099.0% (n=100)99.0% (n=100)93.0% (n=100)93.0% (n=100)93.0% (n=100)93.0% (n=100)
gpt-6-astra31009897.7% (n=100)99.7% (n=98)93.0% (n=100)94.9% (n=98)93.0% (n=100)94.9% (n=98)
gpt-6-astra41009796.8% (n=100)99.7% (n=97)92.0% (n=100)94.8% (n=97)92.0% (n=100)94.8% (n=97)
gpt-6-astra51005857.7% (n=100)99.5% (n=58)57.0% (n=100)98.3% (n=58)57.0% (n=100)98.3% (n=58)
gpt-6-sol010010093.5% (n=100)93.5% (n=100)60.0% (n=100)60.0% (n=100)60.0% (n=100)60.0% (n=100)
gpt-6-sol110010096.8% (n=100)96.8% (n=100)72.0% (n=100)72.0% (n=100)72.0% (n=100)72.0% (n=100)
gpt-6-sol210010096.4% (n=100)96.4% (n=100)68.0% (n=100)68.0% (n=100)68.0% (n=100)68.0% (n=100)
gpt-6-sol310010098.0% (n=100)98.0% (n=100)81.0% (n=100)81.0% (n=100)80.0% (n=100)80.0% (n=100)
gpt-6-sol410010098.0% (n=100)98.0% (n=100)81.0% (n=100)81.0% (n=100)81.0% (n=100)81.0% (n=100)
gpt-6-sol510010097.2% (n=100)97.2% (n=100)84.0% (n=100)84.0% (n=100)84.0% (n=100)84.0% (n=100)
gemini-3.7-flash010010098.2% (n=100)98.2% (n=100)81.0% (n=100)81.0% (n=100)81.0% (n=100)81.0% (n=100)
gemini-3.7-flash110010097.1% (n=100)97.1% (n=100)70.0% (n=100)70.0% (n=100)70.0% (n=100)70.0% (n=100)
gemini-3.7-flash210010095.8% (n=100)95.8% (n=100)81.0% (n=100)81.0% (n=100)81.0% (n=100)81.0% (n=100)
gemini-3.7-flash310010090.2% (n=100)90.2% (n=100)67.0% (n=100)67.0% (n=100)67.0% (n=100)67.0% (n=100)
gemini-3.7-flash410010083.3% (n=100)83.3% (n=100)53.0% (n=100)53.0% (n=100)53.0% (n=100)53.0% (n=100)
gemini-3.7-flash510010083.3% (n=100)83.3% (n=100)60.0% (n=100)60.0% (n=100)60.0% (n=100)60.0% (n=100)
gpt-5.6-sol010010094.6% (n=100)94.6% (n=100)54.0% (n=100)54.0% (n=100)54.0% (n=100)54.0% (n=100)
gpt-5.6-sol110010096.9% (n=100)96.9% (n=100)71.0% (n=100)71.0% (n=100)71.0% (n=100)71.0% (n=100)
gpt-5.6-sol210010091.9% (n=100)91.9% (n=100)70.0% (n=100)70.0% (n=100)70.0% (n=100)70.0% (n=100)
gpt-5.6-sol310010094.8% (n=100)94.8% (n=100)78.0% (n=100)78.0% (n=100)78.0% (n=100)78.0% (n=100)
gpt-5.6-sol410010085.4% (n=100)85.4% (n=100)71.0% (n=100)71.0% (n=100)71.0% (n=100)71.0% (n=100)
gpt-5.6-sol510010082.5% (n=100)82.5% (n=100)67.0% (n=100)67.0% (n=100)67.0% (n=100)67.0% (n=100)
gemini-3.8-flash010010096.7% (n=100)96.7% (n=100)71.0% (n=100)71.0% (n=100)71.0% (n=100)71.0% (n=100)
gemini-3.8-flash110010096.4% (n=100)96.4% (n=100)70.0% (n=100)70.0% (n=100)70.0% (n=100)70.0% (n=100)
gemini-3.8-flash21009990.2% (n=100)91.1% (n=99)63.0% (n=100)63.6% (n=99)63.0% (n=100)63.6% (n=99)
gemini-3.8-flash310010084.3% (n=100)84.3% (n=100)59.0% (n=100)59.0% (n=100)59.0% (n=100)59.0% (n=100)
gemini-3.8-flash41009976.6% (n=100)77.4% (n=99)50.0% (n=100)50.5% (n=99)50.0% (n=100)50.5% (n=99)
gemini-3.8-flash510010073.2% (n=100)73.2% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)
glm-5.301009889.6% (n=100)91.4% (n=98)57.0% (n=100)58.2% (n=98)57.0% (n=100)58.2% (n=98)
glm-5.311009590.5% (n=100)95.3% (n=95)66.0% (n=100)69.5% (n=95)66.0% (n=100)69.5% (n=95)
glm-5.321009390.1% (n=100)96.8% (n=93)76.0% (n=100)81.7% (n=93)76.0% (n=100)81.7% (n=93)
glm-5.331009477.4% (n=100)82.3% (n=94)47.0% (n=100)50.0% (n=94)46.0% (n=100)48.9% (n=94)
glm-5.341009369.4% (n=100)73.9% (n=94)38.0% (n=100)40.4% (n=94)38.0% (n=100)40.4% (n=94)
glm-5.351009063.6% (n=100)70.6% (n=90)36.0% (n=100)40.0% (n=90)36.0% (n=100)40.0% (n=90)
gpt-5.6-terra010010090.0% (n=100)90.0% (n=100)51.0% (n=100)51.0% (n=100)51.0% (n=100)51.0% (n=100)
gpt-5.6-terra110010086.1% (n=100)86.1% (n=100)54.0% (n=100)54.0% (n=100)54.0% (n=100)54.0% (n=100)
gpt-5.6-terra210010084.7% (n=100)84.7% (n=100)59.0% (n=100)59.0% (n=100)59.0% (n=100)59.0% (n=100)
gpt-5.6-terra310010082.1% (n=100)82.1% (n=100)49.0% (n=100)49.0% (n=100)49.0% (n=100)49.0% (n=100)
gpt-5.6-terra410010076.5% (n=100)76.5% (n=100)47.0% (n=100)47.0% (n=100)47.0% (n=100)47.0% (n=100)
gpt-5.6-terra510010071.1% (n=100)71.1% (n=100)44.0% (n=100)44.0% (n=100)44.0% (n=100)44.0% (n=100)
deepseek-4.1-flash010010091.8% (n=100)91.8% (n=100)60.0% (n=100)60.0% (n=100)60.0% (n=100)60.0% (n=100)
deepseek-4.1-flash110010087.3% (n=100)87.3% (n=100)57.0% (n=100)57.0% (n=100)57.0% (n=100)57.0% (n=100)
deepseek-4.1-flash210010083.3% (n=100)83.3% (n=100)55.0% (n=100)55.0% (n=100)55.0% (n=100)55.0% (n=100)
deepseek-4.1-flash310010077.1% (n=100)77.1% (n=100)46.0% (n=100)46.0% (n=100)46.0% (n=100)46.0% (n=100)
deepseek-4.1-flash41009666.1% (n=100)68.9% (n=96)39.0% (n=100)40.6% (n=96)39.0% (n=100)40.6% (n=96)
deepseek-4.1-flash51009966.6% (n=100)67.2% (n=99)35.0% (n=100)35.4% (n=99)35.0% (n=100)35.4% (n=99)
gemini-3.6-flash010010095.4% (n=100)95.4% (n=100)68.0% (n=100)68.0% (n=100)68.0% (n=100)68.0% (n=100)
gemini-3.6-flash110010090.3% (n=100)90.3% (n=100)54.0% (n=100)54.0% (n=100)54.0% (n=100)54.0% (n=100)
gemini-3.6-flash210010086.4% (n=100)86.4% (n=100)48.0% (n=100)48.0% (n=100)48.0% (n=100)48.0% (n=100)
gemini-3.6-flash310010075.4% (n=100)75.4% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)
gemini-3.6-flash410010068.9% (n=100)68.9% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)
gemini-3.6-flash510010060.6% (n=100)60.6% (n=100)26.0% (n=100)26.0% (n=100)26.0% (n=100)26.0% (n=100)
deepseek-v4-pro010010091.6% (n=100)91.6% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)
deepseek-v4-pro11009992.8% (n=100)92.8% (n=100)52.0% (n=100)52.0% (n=100)52.0% (n=100)52.0% (n=100)
deepseek-v4-pro210010093.2% (n=100)93.2% (n=100)47.0% (n=100)47.0% (n=100)47.0% (n=100)47.0% (n=100)
deepseek-v4-pro310010090.8% (n=100)90.8% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)
deepseek-v4-pro410010092.6% (n=100)92.6% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)
deepseek-v4-pro51009988.0% (n=100)88.0% (n=100)32.0% (n=100)32.0% (n=100)32.0% (n=100)32.0% (n=100)
gpt-6-luna010010089.8% (n=100)89.8% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)
gpt-6-luna110010086.7% (n=100)86.7% (n=100)50.0% (n=100)50.0% (n=100)50.0% (n=100)50.0% (n=100)
gpt-6-luna210010080.5% (n=100)80.5% (n=100)44.0% (n=100)44.0% (n=100)44.0% (n=100)44.0% (n=100)
gpt-6-luna310010085.2% (n=100)85.2% (n=100)43.0% (n=100)43.0% (n=100)43.0% (n=100)43.0% (n=100)
gpt-6-luna410010073.9% (n=100)73.9% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)
gpt-6-luna510010072.6% (n=100)72.6% (n=100)37.0% (n=100)37.0% (n=100)36.0% (n=100)36.0% (n=100)
claude-sonnet-501008881.2% (n=100)92.2% (n=88)55.0% (n=100)62.5% (n=88)55.0% (n=100)62.5% (n=88)
claude-sonnet-511007268.9% (n=100)95.7% (n=72)46.0% (n=100)63.9% (n=72)46.0% (n=100)63.9% (n=72)
claude-sonnet-521007368.6% (n=100)94.0% (n=73)45.0% (n=100)61.6% (n=73)45.0% (n=100)61.6% (n=73)
claude-sonnet-531007264.3% (n=100)89.3% (n=72)38.0% (n=100)52.8% (n=72)38.0% (n=100)52.8% (n=72)
claude-sonnet-541006152.0% (n=100)85.2% (n=61)33.0% (n=100)54.1% (n=61)33.0% (n=100)54.1% (n=61)
claude-sonnet-551007966.6% (n=100)84.3% (n=79)34.0% (n=100)43.0% (n=79)34.0% (n=100)43.0% (n=79)
gpt-5.6-luna010010088.6% (n=100)88.6% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)
gpt-5.6-luna110010083.3% (n=100)83.3% (n=100)48.0% (n=100)48.0% (n=100)48.0% (n=100)48.0% (n=100)
gpt-5.6-luna210010073.8% (n=100)73.8% (n=100)45.0% (n=100)45.0% (n=100)45.0% (n=100)45.0% (n=100)
gpt-5.6-luna310010085.7% (n=100)85.7% (n=100)41.0% (n=100)41.0% (n=100)40.0% (n=100)40.0% (n=100)
gpt-5.6-luna410010080.6% (n=100)80.6% (n=100)44.0% (n=100)44.0% (n=100)42.0% (n=100)42.0% (n=100)
gpt-5.6-luna510010076.2% (n=100)76.2% (n=100)39.0% (n=100)39.0% (n=100)36.0% (n=100)36.0% (n=100)
claude-opus-5.5010010093.2% (n=100)93.2% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)
claude-opus-5.511009991.9% (n=100)92.8% (n=99)34.0% (n=100)34.3% (n=99)33.0% (n=100)33.3% (n=99)
claude-opus-5.521009790.1% (n=100)92.9% (n=97)40.0% (n=100)41.2% (n=97)40.0% (n=100)41.2% (n=97)
claude-opus-5.5310010094.3% (n=100)94.3% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)
claude-opus-5.541009891.4% (n=100)93.2% (n=98)41.0% (n=100)41.8% (n=98)41.0% (n=100)41.8% (n=98)
claude-opus-5.551009790.4% (n=100)93.2% (n=97)45.0% (n=100)46.4% (n=97)45.0% (n=100)46.4% (n=97)
claude-fable-501007572.3% (n=100)96.4% (n=75)48.0% (n=100)64.0% (n=75)48.0% (n=100)64.0% (n=75)
claude-fable-511006865.1% (n=100)95.8% (n=68)47.0% (n=100)69.1% (n=68)47.0% (n=100)69.1% (n=68)
claude-fable-521005954.7% (n=100)92.7% (n=59)28.0% (n=100)47.5% (n=59)28.0% (n=100)47.5% (n=59)
claude-fable-531006561.7% (n=100)95.0% (n=65)38.0% (n=100)58.5% (n=65)38.0% (n=100)58.5% (n=65)
claude-fable-541006663.3% (n=100)95.8% (n=66)36.0% (n=100)54.5% (n=66)36.0% (n=100)54.5% (n=66)
claude-fable-551006058.1% (n=100)96.9% (n=60)40.0% (n=100)66.7% (n=60)40.0% (n=100)66.7% (n=60)
mimo-v2.6-flash01009585.7% (n=100)90.2% (n=95)50.0% (n=100)52.6% (n=95)50.0% (n=100)52.6% (n=95)
mimo-v2.6-flash110010086.7% (n=100)86.7% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)
mimo-v2.6-flash210010086.2% (n=100)86.2% (n=100)46.0% (n=100)46.0% (n=100)46.0% (n=100)46.0% (n=100)
mimo-v2.6-flash310010074.1% (n=100)74.1% (n=100)37.0% (n=100)37.0% (n=100)34.0% (n=100)34.0% (n=100)
mimo-v2.6-flash41009974.5% (n=100)75.2% (n=99)36.0% (n=100)36.4% (n=99)31.0% (n=100)31.3% (n=99)
mimo-v2.6-flash510010064.0% (n=100)64.0% (n=100)32.0% (n=100)32.0% (n=100)30.0% (n=100)30.0% (n=100)
mimo-v2.6-pro01009989.2% (n=100)89.2% (n=100)45.0% (n=100)45.0% (n=100)45.0% (n=100)45.0% (n=100)
mimo-v2.6-pro11009985.6% (n=100)85.6% (n=100)46.0% (n=100)46.0% (n=100)46.0% (n=100)46.0% (n=100)
mimo-v2.6-pro21009981.5% (n=100)81.5% (n=100)45.0% (n=100)45.0% (n=100)43.0% (n=100)43.0% (n=100)
mimo-v2.6-pro310010073.9% (n=100)73.9% (n=100)38.0% (n=100)38.0% (n=100)37.0% (n=100)37.0% (n=100)
mimo-v2.6-pro41009968.4% (n=100)68.4% (n=100)34.0% (n=100)34.0% (n=100)32.0% (n=100)32.0% (n=100)
mimo-v2.6-pro51009761.0% (n=100)61.0% (n=100)27.0% (n=100)27.0% (n=100)25.0% (n=100)25.0% (n=100)
claude-opus-501007568.7% (n=100)91.5% (n=75)40.0% (n=100)53.3% (n=75)40.0% (n=100)53.3% (n=75)
claude-opus-511007059.2% (n=100)84.6% (n=70)35.0% (n=100)50.0% (n=70)35.0% (n=100)50.0% (n=70)
claude-opus-521007157.0% (n=100)80.3% (n=71)40.0% (n=100)56.3% (n=71)40.0% (n=100)56.3% (n=71)
claude-opus-531006350.3% (n=100)79.9% (n=63)33.0% (n=100)52.4% (n=63)33.0% (n=100)52.4% (n=63)
claude-opus-541007352.2% (n=100)71.5% (n=73)36.0% (n=100)49.3% (n=73)36.0% (n=100)49.3% (n=73)
claude-opus-551007256.4% (n=100)78.3% (n=72)39.0% (n=100)54.2% (n=72)39.0% (n=100)54.2% (n=72)
grok-4.6010010090.1% (n=100)90.1% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)
grok-4.6110010090.6% (n=100)90.6% (n=100)40.0% (n=100)40.0% (n=100)40.0% (n=100)40.0% (n=100)
grok-4.6210010089.4% (n=100)89.4% (n=100)32.0% (n=100)32.0% (n=100)32.0% (n=100)32.0% (n=100)
grok-4.6310010090.1% (n=100)90.1% (n=100)37.0% (n=100)37.0% (n=100)37.0% (n=100)37.0% (n=100)
grok-4.6410010089.6% (n=100)89.6% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)
grok-4.6510010087.2% (n=100)87.2% (n=100)44.0% (n=100)44.0% (n=100)44.0% (n=100)44.0% (n=100)
kimi-k2.6010010093.5% (n=100)93.5% (n=100)48.0% (n=100)48.0% (n=100)48.0% (n=100)48.0% (n=100)
kimi-k2.6110010093.3% (n=100)93.3% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)39.0% (n=100)
kimi-k2.6210010091.7% (n=100)91.7% (n=100)34.0% (n=100)34.0% (n=100)34.0% (n=100)34.0% (n=100)
kimi-k2.6310010088.8% (n=100)88.8% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)
kimi-k2.6410010088.1% (n=100)88.1% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)33.0% (n=100)
kimi-k2.651009986.9% (n=100)87.8% (n=99)29.0% (n=100)29.3% (n=99)29.0% (n=100)29.3% (n=99)
minimax-m3010010087.6% (n=100)87.6% (n=100)43.0% (n=100)43.0% (n=100)43.0% (n=100)43.0% (n=100)
minimax-m311009876.9% (n=100)76.9% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)41.0% (n=100)
minimax-m3210010068.3% (n=100)68.3% (n=100)34.0% (n=100)34.0% (n=100)34.0% (n=100)34.0% (n=100)
minimax-m3310010065.2% (n=100)65.2% (n=100)32.0% (n=100)32.0% (n=100)32.0% (n=100)32.0% (n=100)
minimax-m341009960.3% (n=100)60.3% (n=100)28.0% (n=100)28.0% (n=100)28.0% (n=100)28.0% (n=100)
minimax-m3510010052.5% (n=100)52.5% (n=100)25.0% (n=100)25.0% (n=100)25.0% (n=100)25.0% (n=100)
qwen3.8-27b010010092.4% (n=100)92.4% (n=100)45.0% (n=100)45.0% (n=100)45.0% (n=100)45.0% (n=100)
qwen3.8-27b110010087.4% (n=100)87.4% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)
qwen3.8-27b210010087.6% (n=100)87.6% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)42.0% (n=100)
qwen3.8-27b310010086.1% (n=100)86.1% (n=100)28.0% (n=100)28.0% (n=100)28.0% (n=100)28.0% (n=100)
qwen3.8-27b410010075.5% (n=100)75.5% (n=100)22.0% (n=100)22.0% (n=100)22.0% (n=100)22.0% (n=100)
qwen3.8-27b510010072.9% (n=100)72.9% (n=100)29.0% (n=100)29.0% (n=100)29.0% (n=100)29.0% (n=100)
kimi-k301009690.6% (n=100)94.4% (n=96)52.0% (n=100)54.2% (n=96)52.0% (n=100)54.2% (n=96)
kimi-k311008477.7% (n=100)92.5% (n=84)40.0% (n=100)47.6% (n=84)40.0% (n=100)47.6% (n=84)
kimi-k321009988.9% (n=100)89.8% (n=99)42.0% (n=100)42.4% (n=99)42.0% (n=100)42.4% (n=99)
kimi-k3310010076.6% (n=100)76.6% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)36.0% (n=100)
kimi-k341006342.7% (n=100)67.8% (n=63)17.0% (n=100)27.0% (n=63)17.0% (n=100)27.0% (n=63)
kimi-k3510010.1% (n=100)13.3% (n=1)0.0% (n=100)0.0% (n=1)0.0% (n=100)0.0% (n=1)
glm-5.3-flash01009986.6% (n=100)87.5% (n=99)35.0% (n=100)35.4% (n=99)35.0% (n=100)35.4% (n=99)
glm-5.3-flash11009879.8% (n=100)81.5% (n=98)33.0% (n=100)33.7% (n=98)33.0% (n=100)33.7% (n=98)
glm-5.3-flash21009973.5% (n=100)74.3% (n=99)29.0% (n=100)29.3% (n=99)29.0% (n=100)29.3% (n=99)
glm-5.3-flash310010061.3% (n=100)61.3% (n=100)21.0% (n=100)21.0% (n=100)21.0% (n=100)21.0% (n=100)
glm-5.3-flash410010054.1% (n=100)54.1% (n=100)19.0% (n=100)19.0% (n=100)19.0% (n=100)19.0% (n=100)
glm-5.3-flash510010044.7% (n=100)44.7% (n=100)19.0% (n=100)19.0% (n=100)18.0% (n=100)18.0% (n=100)
claude-haiku-4.5010010083.4% (n=100)83.4% (n=100)31.0% (n=100)31.0% (n=100)31.0% (n=100)31.0% (n=100)
claude-haiku-4.5110010078.8% (n=100)78.8% (n=100)25.0% (n=100)25.0% (n=100)25.0% (n=100)25.0% (n=100)
claude-haiku-4.5210010071.5% (n=100)71.5% (n=100)25.0% (n=100)25.0% (n=100)25.0% (n=100)25.0% (n=100)
claude-haiku-4.5310010060.2% (n=100)60.2% (n=100)20.0% (n=100)20.0% (n=100)20.0% (n=100)20.0% (n=100)
claude-haiku-4.5410010057.3% (n=100)57.3% (n=100)19.0% (n=100)19.0% (n=100)19.0% (n=100)19.0% (n=100)
claude-haiku-4.5510010057.1% (n=100)57.1% (n=100)22.0% (n=100)22.0% (n=100)22.0% (n=100)22.0% (n=100)
glm-4.7-flash01009968.4% (n=100)69.0% (n=99)28.0% (n=100)28.3% (n=99)28.0% (n=100)28.3% (n=99)
glm-4.7-flash110010076.0% (n=100)76.0% (n=100)27.0% (n=100)27.0% (n=100)27.0% (n=100)27.0% (n=100)
glm-4.7-flash21009870.7% (n=100)72.1% (n=98)19.0% (n=100)19.4% (n=98)19.0% (n=100)19.4% (n=98)
glm-4.7-flash31008553.0% (n=100)61.6% (n=86)17.0% (n=100)19.8% (n=86)17.0% (n=100)19.8% (n=86)
glm-4.7-flash41008755.8% (n=100)64.1% (n=87)11.0% (n=100)12.6% (n=87)11.0% (n=100)12.6% (n=87)
glm-4.7-flash51009656.0% (n=100)58.3% (n=96)15.0% (n=100)15.6% (n=96)15.0% (n=100)15.6% (n=96)
claude-fable-5.1010011.0% (n=100)100.0% (n=1)1.0% (n=100)100.0% (n=1)1.0% (n=100)100.0% (n=1)
claude-fable-5.1110000.0% (n=100)— (n=0)0.0% (n=100)— (n=0)0.0% (n=100)— (n=0)
claude-fable-5.1210000.0% (n=100)— (n=0)0.0% (n=100)— (n=0)0.0% (n=100)— (n=0)
claude-fable-5.1310011.0% (n=100)100.0% (n=1)1.0% (n=100)100.0% (n=1)1.0% (n=100)100.0% (n=1)
claude-fable-5.1410054.9% (n=100)97.8% (n=5)3.0% (n=100)60.0% (n=5)3.0% (n=100)60.0% (n=5)
claude-fable-5.1510076.9% (n=100)98.1% (n=7)5.0% (n=100)71.4% (n=7)5.0% (n=100)71.4% (n=7)
baseline:direct-facts010010080.6% (n=100)80.6% (n=100)5.0% (n=100)5.0% (n=100)5.0% (n=100)5.0% (n=100)
baseline:direct-facts110010073.0% (n=100)73.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:direct-facts210010077.0% (n=100)77.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:direct-facts310010071.1% (n=100)71.1% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:direct-facts410010071.7% (n=100)71.7% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:direct-facts510010068.8% (n=100)68.8% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:story-copy01001000.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:story-copy11001000.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:story-copy21001000.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:story-copy31001000.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:story-copy41001000.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
baseline:story-copy51001000.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)0.0% (n=100)
scenario
ProviderscenarioExpectedAnsweredFact F1 · all itemsFact F1 · scored onlyExact world · all itemsExact world · scored onlyTask success · all itemsTask success · scored only
baseline:constraint-solverstrata600600100.0% (n=600)100.0% (n=600)100.0% (n=600)100.0% (n=600)100.0% (n=600)100.0% (n=600)
baseline:forward-chainstrata60060099.8% (n=600)99.8% (n=600)98.3% (n=600)98.3% (n=600)98.3% (n=600)98.3% (n=600)
gpt-6-astrastrata60055090.6% (n=600)98.8% (n=550)80.3% (n=600)87.6% (n=550)80.3% (n=600)87.6% (n=550)
gpt-6-solstrata60060096.6% (n=600)96.6% (n=600)74.3% (n=600)74.3% (n=600)74.2% (n=600)74.2% (n=600)
gemini-3.7-flashstrata60060091.3% (n=600)91.3% (n=600)68.7% (n=600)68.7% (n=600)68.7% (n=600)68.7% (n=600)
gpt-5.6-solstrata60060091.0% (n=600)91.0% (n=600)68.5% (n=600)68.5% (n=600)68.5% (n=600)68.5% (n=600)
gemini-3.8-flashstrata60059886.2% (n=600)86.5% (n=598)59.0% (n=600)59.2% (n=598)59.0% (n=600)59.2% (n=598)
glm-5.3strata60056380.1% (n=600)85.2% (n=564)53.3% (n=600)56.7% (n=564)53.2% (n=600)56.6% (n=564)
gpt-5.6-terrastrata60060081.8% (n=600)81.8% (n=600)50.7% (n=600)50.7% (n=600)50.7% (n=600)50.7% (n=600)
deepseek-4.1-flashstrata60059578.7% (n=600)79.4% (n=595)48.7% (n=600)49.1% (n=595)48.7% (n=600)49.1% (n=595)
gemini-3.6-flashstrata60060079.5% (n=600)79.5% (n=600)43.7% (n=600)43.7% (n=600)43.7% (n=600)43.7% (n=600)
deepseek-v4-prostrata60059891.5% (n=600)91.5% (n=600)42.7% (n=600)42.7% (n=600)42.7% (n=600)42.7% (n=600)
gpt-6-lunastrata60060081.5% (n=600)81.5% (n=600)42.5% (n=600)42.5% (n=600)42.3% (n=600)42.3% (n=600)
claude-sonnet-5strata60044566.9% (n=600)90.2% (n=445)41.8% (n=600)56.4% (n=445)41.8% (n=600)56.4% (n=445)
gpt-5.6-lunastrata60060081.4% (n=600)81.4% (n=600)42.7% (n=600)42.7% (n=600)41.7% (n=600)41.7% (n=600)
claude-opus-5.5strata60059191.9% (n=600)93.3% (n=591)40.0% (n=600)40.6% (n=591)39.8% (n=600)40.4% (n=591)
claude-fable-5strata60039362.5% (n=600)95.5% (n=393)39.5% (n=600)60.3% (n=393)39.5% (n=600)60.3% (n=393)
mimo-v2.6-flashstrata60059478.5% (n=600)79.3% (n=594)40.5% (n=600)40.9% (n=594)38.8% (n=600)39.2% (n=594)
mimo-v2.6-prostrata60059376.6% (n=600)76.6% (n=600)39.2% (n=600)39.2% (n=600)38.0% (n=600)38.0% (n=600)
claude-opus-5strata60042457.3% (n=600)81.1% (n=424)37.2% (n=600)52.6% (n=424)37.2% (n=600)52.6% (n=424)
grok-4.6strata60060089.5% (n=600)89.5% (n=600)37.0% (n=600)37.0% (n=600)37.0% (n=600)37.0% (n=600)
kimi-k2.6strata60059990.4% (n=600)90.6% (n=599)36.5% (n=600)36.6% (n=599)36.5% (n=600)36.6% (n=599)
minimax-m3strata60059768.5% (n=600)68.5% (n=600)33.8% (n=600)33.8% (n=600)33.8% (n=600)33.8% (n=600)
qwen3.8-27bstrata60060083.6% (n=600)83.6% (n=600)33.7% (n=600)33.7% (n=600)33.7% (n=600)33.7% (n=600)
kimi-k3strata60044362.8% (n=600)85.0% (n=443)31.2% (n=600)42.2% (n=443)31.2% (n=600)42.2% (n=443)
glm-5.3-flashstrata60059666.7% (n=600)67.1% (n=596)26.0% (n=600)26.2% (n=596)25.8% (n=600)26.0% (n=596)
claude-haiku-4.5strata60060068.0% (n=600)68.0% (n=600)23.7% (n=600)23.7% (n=600)23.7% (n=600)23.7% (n=600)
glm-4.7-flashstrata60056563.3% (n=600)67.1% (n=566)19.5% (n=600)20.7% (n=566)19.5% (n=600)20.7% (n=566)
claude-fable-5.1strata600142.3% (n=600)98.2% (n=14)1.7% (n=600)71.4% (n=14)1.7% (n=600)71.4% (n=14)
baseline:direct-factsstrata60060073.7% (n=600)73.7% (n=600)0.8% (n=600)0.8% (n=600)0.8% (n=600)0.8% (n=600)
baseline:story-copystrata6006000.0% (n=600)0.0% (n=600)0.0% (n=600)0.0% (n=600)0.0% (n=600)0.0% (n=600)
condition
ProviderconditionExpectedAnsweredFact F1 · all itemsFact F1 · scored onlyExact world · all itemsExact world · scored onlyTask success · all itemsTask success · scored only
baseline:constraint-solverexplicit240240100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)
baseline:constraint-solverformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
baseline:constraint-solverimplicit240240100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)
baseline:forward-chainexplicit24024099.8% (n=240)99.8% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)
baseline:forward-chainformal12012099.8% (n=120)99.8% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)
baseline:forward-chainimplicit24024099.8% (n=240)99.8% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)
gpt-6-astraexplicit24022090.8% (n=240)99.1% (n=220)81.2% (n=240)88.6% (n=220)81.2% (n=240)88.6% (n=220)
gpt-6-astraformal12011495.0% (n=120)100.0% (n=114)95.0% (n=120)100.0% (n=114)95.0% (n=120)100.0% (n=114)
gpt-6-astraimplicit24021688.0% (n=240)97.8% (n=216)72.1% (n=240)80.1% (n=216)72.1% (n=240)80.1% (n=216)
gpt-6-solexplicit24024095.0% (n=240)95.0% (n=240)61.3% (n=240)61.3% (n=240)60.8% (n=240)60.8% (n=240)
gpt-6-solformal12012099.2% (n=120)99.2% (n=120)99.2% (n=120)99.2% (n=120)99.2% (n=120)99.2% (n=120)
gpt-6-solimplicit24024097.1% (n=240)97.1% (n=240)75.0% (n=240)75.0% (n=240)75.0% (n=240)75.0% (n=240)
gemini-3.7-flashexplicit24024096.9% (n=240)96.9% (n=240)68.8% (n=240)68.8% (n=240)68.8% (n=240)68.8% (n=240)
gemini-3.7-flashformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gemini-3.7-flashimplicit24024081.4% (n=240)81.4% (n=240)52.9% (n=240)52.9% (n=240)52.9% (n=240)52.9% (n=240)
gpt-5.6-solexplicit24024097.2% (n=240)97.2% (n=240)67.1% (n=240)67.1% (n=240)67.1% (n=240)67.1% (n=240)
gpt-5.6-solformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gpt-5.6-solimplicit24024080.4% (n=240)80.4% (n=240)54.2% (n=240)54.2% (n=240)54.2% (n=240)54.2% (n=240)
gemini-3.8-flashexplicit24023995.0% (n=240)95.3% (n=239)58.3% (n=240)58.6% (n=239)58.3% (n=240)58.6% (n=239)
gemini-3.8-flashformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gemini-3.8-flashimplicit24023970.6% (n=240)70.9% (n=239)39.2% (n=240)39.3% (n=239)39.2% (n=240)39.3% (n=239)
glm-5.3explicit24021677.2% (n=240)85.7% (n=216)48.3% (n=240)53.7% (n=216)47.9% (n=240)53.2% (n=216)
glm-5.3formal12012098.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)
glm-5.3implicit24022773.9% (n=240)77.8% (n=228)35.8% (n=240)37.7% (n=228)35.8% (n=240)37.7% (n=228)
gpt-5.6-terraexplicit24024096.3% (n=240)96.3% (n=240)52.5% (n=240)52.5% (n=240)52.5% (n=240)52.5% (n=240)
gpt-5.6-terraformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gpt-5.6-terraimplicit24024058.1% (n=240)58.1% (n=240)24.2% (n=240)24.2% (n=240)24.2% (n=240)24.2% (n=240)
deepseek-4.1-flashexplicit24023693.7% (n=240)95.3% (n=236)53.8% (n=240)54.7% (n=236)53.8% (n=240)54.7% (n=236)
deepseek-4.1-flashformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
deepseek-4.1-flashimplicit24023953.1% (n=240)53.3% (n=239)17.9% (n=240)18.0% (n=239)17.9% (n=240)18.0% (n=239)
gemini-3.6-flashexplicit24024083.7% (n=240)83.7% (n=240)42.9% (n=240)42.9% (n=240)42.9% (n=240)42.9% (n=240)
gemini-3.6-flashformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gemini-3.6-flashimplicit24024065.0% (n=240)65.0% (n=240)16.2% (n=240)16.2% (n=240)16.2% (n=240)16.2% (n=240)
deepseek-v4-proexplicit24023992.7% (n=240)92.7% (n=240)38.8% (n=240)38.8% (n=240)38.8% (n=240)38.8% (n=240)
deepseek-v4-proformal12012097.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)
deepseek-v4-proimplicit24023987.3% (n=240)87.3% (n=240)19.2% (n=240)19.2% (n=240)19.2% (n=240)19.2% (n=240)
gpt-6-lunaexplicit24024092.2% (n=240)92.2% (n=240)33.3% (n=240)33.3% (n=240)33.3% (n=240)33.3% (n=240)
gpt-6-lunaformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)99.2% (n=120)99.2% (n=120)
gpt-6-lunaimplicit24024061.5% (n=240)61.5% (n=240)22.9% (n=240)22.9% (n=240)22.9% (n=240)22.9% (n=240)
claude-sonnet-5explicit24019374.8% (n=240)93.1% (n=193)34.2% (n=240)42.5% (n=193)34.2% (n=240)42.5% (n=193)
claude-sonnet-5formal12012093.3% (n=120)93.3% (n=120)93.3% (n=120)93.3% (n=120)93.3% (n=120)93.3% (n=120)
claude-sonnet-5implicit24013245.8% (n=240)83.3% (n=132)23.8% (n=240)43.2% (n=132)23.8% (n=240)43.2% (n=132)
gpt-5.6-lunaexplicit24024094.5% (n=240)94.5% (n=240)40.0% (n=240)40.0% (n=240)38.3% (n=240)38.3% (n=240)
gpt-5.6-lunaformal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)98.3% (n=120)98.3% (n=120)
gpt-5.6-lunaimplicit24024058.9% (n=240)58.9% (n=240)16.7% (n=240)16.7% (n=240)16.7% (n=240)16.7% (n=240)
claude-opus-5.5explicit24023590.8% (n=240)92.8% (n=235)28.3% (n=240)28.9% (n=235)27.9% (n=240)28.5% (n=235)
claude-opus-5.5formal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
claude-opus-5.5implicit24023688.8% (n=240)90.3% (n=236)21.7% (n=240)22.0% (n=236)21.7% (n=240)22.0% (n=236)
claude-fable-5explicit24016162.8% (n=240)93.7% (n=161)34.6% (n=240)51.6% (n=161)34.6% (n=240)51.6% (n=161)
claude-fable-5formal1208974.2% (n=120)100.0% (n=89)74.2% (n=120)100.0% (n=89)74.2% (n=120)100.0% (n=89)
claude-fable-5implicit24014356.4% (n=240)94.7% (n=143)27.1% (n=240)45.5% (n=143)27.1% (n=240)45.5% (n=143)
mimo-v2.6-flashexplicit24023789.1% (n=240)90.2% (n=237)40.0% (n=240)40.5% (n=237)38.3% (n=240)38.8% (n=237)
mimo-v2.6-flashformal12012096.3% (n=120)96.3% (n=120)95.0% (n=120)95.0% (n=120)91.7% (n=120)91.7% (n=120)
mimo-v2.6-flashimplicit24023759.0% (n=240)59.8% (n=237)13.8% (n=240)13.9% (n=237)12.9% (n=240)13.1% (n=237)
mimo-v2.6-proexplicit24023384.6% (n=240)84.6% (n=240)38.8% (n=240)38.8% (n=240)36.7% (n=240)36.7% (n=240)
mimo-v2.6-proformal12012097.3% (n=120)97.3% (n=120)94.2% (n=120)94.2% (n=120)92.5% (n=120)92.5% (n=120)
mimo-v2.6-proimplicit24024058.3% (n=240)58.3% (n=240)12.1% (n=240)12.1% (n=240)12.1% (n=240)12.1% (n=240)
claude-opus-5explicit24023082.2% (n=240)85.8% (n=230)58.3% (n=240)60.9% (n=230)58.3% (n=240)60.9% (n=230)
claude-opus-5formal12000.0% (n=120)— (n=0)0.0% (n=120)— (n=0)0.0% (n=120)— (n=0)
claude-opus-5implicit24019461.0% (n=240)75.4% (n=194)34.6% (n=240)42.8% (n=194)34.6% (n=240)42.8% (n=194)
grok-4.6explicit24024088.0% (n=240)88.0% (n=240)21.2% (n=240)21.2% (n=240)21.2% (n=240)21.2% (n=240)
grok-4.6formal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
grok-4.6implicit24024085.7% (n=240)85.7% (n=240)21.2% (n=240)21.2% (n=240)21.2% (n=240)21.2% (n=240)
kimi-k2.6explicit24023992.0% (n=240)92.4% (n=239)23.8% (n=240)23.8% (n=239)23.8% (n=240)23.8% (n=239)
kimi-k2.6formal120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
kimi-k2.6implicit24024084.0% (n=240)84.0% (n=240)17.5% (n=240)17.5% (n=240)17.5% (n=240)17.5% (n=240)
minimax-m3explicit24023869.5% (n=240)69.5% (n=240)24.6% (n=240)24.6% (n=240)24.6% (n=240)24.6% (n=240)
minimax-m3formal12012097.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)
minimax-m3implicit24023952.9% (n=240)52.9% (n=240)11.2% (n=240)11.2% (n=240)11.2% (n=240)11.2% (n=240)
qwen3.8-27bexplicit24024086.5% (n=240)86.5% (n=240)24.2% (n=240)24.2% (n=240)24.2% (n=240)24.2% (n=240)
qwen3.8-27bformal12012095.8% (n=120)95.8% (n=120)95.8% (n=120)95.8% (n=120)95.8% (n=120)95.8% (n=120)
qwen3.8-27bimplicit24024074.6% (n=240)74.6% (n=240)12.1% (n=240)12.1% (n=240)12.1% (n=240)12.1% (n=240)
kimi-k3explicit24017160.6% (n=240)85.0% (n=171)18.8% (n=240)26.3% (n=171)18.8% (n=240)26.3% (n=171)
kimi-k3formal1209377.5% (n=120)100.0% (n=93)77.5% (n=120)100.0% (n=93)77.5% (n=120)100.0% (n=93)
kimi-k3implicit24017957.6% (n=240)77.2% (n=179)20.4% (n=240)27.4% (n=179)20.4% (n=240)27.4% (n=179)
glm-5.3-flashexplicit24023664.0% (n=240)65.1% (n=236)18.3% (n=240)18.6% (n=236)17.9% (n=240)18.2% (n=236)
glm-5.3-flashformal12012099.0% (n=120)99.0% (n=120)83.3% (n=120)83.3% (n=120)83.3% (n=120)83.3% (n=120)
glm-5.3-flashimplicit24024053.2% (n=240)53.2% (n=240)5.0% (n=240)5.0% (n=240)5.0% (n=240)5.0% (n=240)
claude-haiku-4.5explicit24024068.0% (n=240)68.0% (n=240)5.8% (n=240)5.8% (n=240)5.8% (n=240)5.8% (n=240)
claude-haiku-4.5formal12012098.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)
claude-haiku-4.5implicit24024053.0% (n=240)53.0% (n=240)4.2% (n=240)4.2% (n=240)4.2% (n=240)4.2% (n=240)
glm-4.7-flashexplicit24022159.1% (n=240)63.9% (n=222)6.7% (n=240)7.2% (n=222)6.7% (n=240)7.2% (n=222)
glm-4.7-flashformal12012090.4% (n=120)90.4% (n=120)77.5% (n=120)77.5% (n=120)77.5% (n=120)77.5% (n=120)
glm-4.7-flashimplicit24022454.0% (n=240)57.8% (n=224)3.3% (n=240)3.6% (n=224)3.3% (n=240)3.6% (n=224)
claude-fable-5.1explicit24020.8% (n=240)100.0% (n=2)0.8% (n=240)100.0% (n=2)0.8% (n=240)100.0% (n=2)
claude-fable-5.1formal12032.5% (n=120)100.0% (n=3)2.5% (n=120)100.0% (n=3)2.5% (n=120)100.0% (n=3)
claude-fable-5.1implicit24093.6% (n=240)97.3% (n=9)2.1% (n=240)55.6% (n=9)2.1% (n=240)55.6% (n=9)
baseline:direct-factsexplicit24024073.7% (n=240)73.7% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)
baseline:direct-factsformal12012073.7% (n=120)73.7% (n=120)0.8% (n=120)0.8% (n=120)0.8% (n=120)0.8% (n=120)
baseline:direct-factsimplicit24024073.7% (n=240)73.7% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)
baseline:story-copyexplicit2402400.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)
baseline:story-copyformal1201200.0% (n=120)0.0% (n=120)0.0% (n=120)0.0% (n=120)0.0% (n=120)0.0% (n=120)
baseline:story-copyimplicit2402400.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)
realization
ProviderrealizationExpectedAnsweredFact F1 · all itemsFact F1 · scored onlyExact world · all itemsExact world · scored onlyTask success · all itemsTask success · scored only
baseline:constraint-solver0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
baseline:constraint-solver1240240100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)
baseline:constraint-solver2240240100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)100.0% (n=240)
baseline:forward-chain012012099.8% (n=120)99.8% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)
baseline:forward-chain124024099.8% (n=240)99.8% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)
baseline:forward-chain224024099.8% (n=240)99.8% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)98.3% (n=240)
gpt-6-astra012011495.0% (n=120)100.0% (n=114)95.0% (n=120)100.0% (n=114)95.0% (n=120)100.0% (n=114)
gpt-6-astra124022391.4% (n=240)98.4% (n=223)79.2% (n=240)85.2% (n=223)79.2% (n=240)85.2% (n=223)
gpt-6-astra224021387.5% (n=240)98.5% (n=213)74.2% (n=240)83.6% (n=213)74.2% (n=240)83.6% (n=213)
gpt-6-sol012012099.2% (n=120)99.2% (n=120)99.2% (n=120)99.2% (n=120)99.2% (n=120)99.2% (n=120)
gpt-6-sol124024096.1% (n=240)96.1% (n=240)70.4% (n=240)70.4% (n=240)70.4% (n=240)70.4% (n=240)
gpt-6-sol224024096.0% (n=240)96.0% (n=240)65.8% (n=240)65.8% (n=240)65.4% (n=240)65.4% (n=240)
gemini-3.7-flash0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gemini-3.7-flash124024089.6% (n=240)89.6% (n=240)60.0% (n=240)60.0% (n=240)60.0% (n=240)60.0% (n=240)
gemini-3.7-flash224024088.7% (n=240)88.7% (n=240)61.7% (n=240)61.7% (n=240)61.7% (n=240)61.7% (n=240)
gpt-5.6-sol0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gpt-5.6-sol124024087.7% (n=240)87.7% (n=240)61.7% (n=240)61.7% (n=240)61.7% (n=240)61.7% (n=240)
gpt-5.6-sol224024089.8% (n=240)89.8% (n=240)59.6% (n=240)59.6% (n=240)59.6% (n=240)59.6% (n=240)
gemini-3.8-flash0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gemini-3.8-flash124023981.8% (n=240)82.1% (n=239)49.6% (n=240)49.8% (n=239)49.6% (n=240)49.8% (n=239)
gemini-3.8-flash224023983.8% (n=240)84.1% (n=239)47.9% (n=240)48.1% (n=239)47.9% (n=240)48.1% (n=239)
glm-5.3012012098.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)
glm-5.3124022174.8% (n=240)80.8% (n=222)44.2% (n=240)47.7% (n=222)44.2% (n=240)47.7% (n=222)
glm-5.3224022276.2% (n=240)82.4% (n=222)40.0% (n=240)43.2% (n=222)39.6% (n=240)42.8% (n=222)
gpt-5.6-terra0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gpt-5.6-terra124024077.6% (n=240)77.6% (n=240)39.6% (n=240)39.6% (n=240)39.6% (n=240)39.6% (n=240)
gpt-5.6-terra224024076.8% (n=240)76.8% (n=240)37.1% (n=240)37.1% (n=240)37.1% (n=240)37.1% (n=240)
deepseek-4.1-flash0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
deepseek-4.1-flash124023673.9% (n=240)75.1% (n=236)37.1% (n=240)37.7% (n=236)37.1% (n=240)37.7% (n=236)
deepseek-4.1-flash224023972.9% (n=240)73.2% (n=239)34.6% (n=240)34.7% (n=239)34.6% (n=240)34.7% (n=239)
gemini-3.6-flash0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
gemini-3.6-flash124024074.5% (n=240)74.5% (n=240)30.0% (n=240)30.0% (n=240)30.0% (n=240)30.0% (n=240)
gemini-3.6-flash224024074.2% (n=240)74.2% (n=240)29.2% (n=240)29.2% (n=240)29.2% (n=240)29.2% (n=240)
deepseek-v4-pro012012097.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)
deepseek-v4-pro124023889.0% (n=240)89.0% (n=240)29.2% (n=240)29.2% (n=240)29.2% (n=240)29.2% (n=240)
deepseek-v4-pro224024090.9% (n=240)90.9% (n=240)28.7% (n=240)28.7% (n=240)28.7% (n=240)28.7% (n=240)
gpt-6-luna0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)99.2% (n=120)99.2% (n=120)
gpt-6-luna124024075.7% (n=240)75.7% (n=240)25.4% (n=240)25.4% (n=240)25.4% (n=240)25.4% (n=240)
gpt-6-luna224024077.9% (n=240)77.9% (n=240)30.8% (n=240)30.8% (n=240)30.8% (n=240)30.8% (n=240)
claude-sonnet-5012012093.3% (n=120)93.3% (n=120)93.3% (n=120)93.3% (n=120)93.3% (n=120)93.3% (n=120)
claude-sonnet-5124016259.7% (n=240)88.4% (n=162)28.3% (n=240)42.0% (n=162)28.3% (n=240)42.0% (n=162)
claude-sonnet-5224016361.0% (n=240)89.8% (n=163)29.6% (n=240)43.6% (n=163)29.6% (n=240)43.6% (n=163)
gpt-5.6-luna0120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)98.3% (n=120)98.3% (n=120)
gpt-5.6-luna124024075.0% (n=240)75.0% (n=240)25.0% (n=240)25.0% (n=240)23.8% (n=240)23.8% (n=240)
gpt-5.6-luna224024078.5% (n=240)78.5% (n=240)31.7% (n=240)31.7% (n=240)31.2% (n=240)31.2% (n=240)
claude-opus-5.50120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
claude-opus-5.5124023790.4% (n=240)91.6% (n=237)27.1% (n=240)27.4% (n=237)26.7% (n=240)27.0% (n=237)
claude-opus-5.5224023489.3% (n=240)91.5% (n=234)22.9% (n=240)23.5% (n=234)22.9% (n=240)23.5% (n=234)
claude-fable-501208974.2% (n=120)100.0% (n=89)74.2% (n=120)100.0% (n=89)74.2% (n=120)100.0% (n=89)
claude-fable-5124015159.5% (n=240)94.5% (n=151)33.3% (n=240)53.0% (n=151)33.3% (n=240)53.0% (n=151)
claude-fable-5224015359.8% (n=240)93.8% (n=153)28.3% (n=240)44.4% (n=153)28.3% (n=240)44.4% (n=153)
mimo-v2.6-flash012012096.3% (n=120)96.3% (n=120)95.0% (n=120)95.0% (n=120)91.7% (n=120)91.7% (n=120)
mimo-v2.6-flash124023675.6% (n=240)76.8% (n=236)28.7% (n=240)29.2% (n=236)26.7% (n=240)27.1% (n=236)
mimo-v2.6-flash224023872.6% (n=240)73.2% (n=238)25.0% (n=240)25.2% (n=238)24.6% (n=240)24.8% (n=238)
mimo-v2.6-pro012012097.3% (n=120)97.3% (n=120)94.2% (n=120)94.2% (n=120)92.5% (n=120)92.5% (n=120)
mimo-v2.6-pro124023670.6% (n=240)70.6% (n=240)25.8% (n=240)25.8% (n=240)24.6% (n=240)24.6% (n=240)
mimo-v2.6-pro224023772.2% (n=240)72.2% (n=240)25.0% (n=240)25.0% (n=240)24.2% (n=240)24.2% (n=240)
claude-opus-5012000.0% (n=120)— (n=0)0.0% (n=120)— (n=0)0.0% (n=120)— (n=0)
claude-opus-5124021571.0% (n=240)79.2% (n=215)46.2% (n=240)51.6% (n=215)46.2% (n=240)51.6% (n=215)
claude-opus-5224020972.3% (n=240)83.0% (n=209)46.7% (n=240)53.6% (n=209)46.7% (n=240)53.6% (n=209)
grok-4.60120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
grok-4.6124024086.5% (n=240)86.5% (n=240)22.9% (n=240)22.9% (n=240)22.9% (n=240)22.9% (n=240)
grok-4.6224024087.1% (n=240)87.1% (n=240)19.6% (n=240)19.6% (n=240)19.6% (n=240)19.6% (n=240)
kimi-k2.60120120100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)100.0% (n=120)
kimi-k2.6124024088.2% (n=240)88.2% (n=240)20.4% (n=240)20.4% (n=240)20.4% (n=240)20.4% (n=240)
kimi-k2.6224023987.8% (n=240)88.2% (n=239)20.8% (n=240)20.9% (n=239)20.8% (n=240)20.9% (n=239)
minimax-m3012012097.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)97.5% (n=120)
minimax-m3124023959.4% (n=240)59.4% (n=240)16.2% (n=240)16.2% (n=240)16.2% (n=240)16.2% (n=240)
minimax-m3224023863.0% (n=240)63.0% (n=240)19.6% (n=240)19.6% (n=240)19.6% (n=240)19.6% (n=240)
qwen3.8-27b012012095.8% (n=120)95.8% (n=120)95.8% (n=120)95.8% (n=120)95.8% (n=120)95.8% (n=120)
qwen3.8-27b124024082.3% (n=240)82.3% (n=240)18.8% (n=240)18.8% (n=240)18.8% (n=240)18.8% (n=240)
qwen3.8-27b224024078.8% (n=240)78.8% (n=240)17.5% (n=240)17.5% (n=240)17.5% (n=240)17.5% (n=240)
kimi-k301209377.5% (n=120)100.0% (n=93)77.5% (n=120)100.0% (n=93)77.5% (n=120)100.0% (n=93)
kimi-k3124017558.2% (n=240)79.9% (n=175)19.2% (n=240)26.3% (n=175)19.2% (n=240)26.3% (n=175)
kimi-k3224017560.0% (n=240)82.2% (n=175)20.0% (n=240)27.4% (n=175)20.0% (n=240)27.4% (n=175)
glm-5.3-flash012012099.0% (n=120)99.0% (n=120)83.3% (n=120)83.3% (n=120)83.3% (n=120)83.3% (n=120)
glm-5.3-flash124023960.6% (n=240)60.8% (n=239)11.2% (n=240)11.3% (n=239)10.8% (n=240)10.9% (n=239)
glm-5.3-flash224023756.6% (n=240)57.3% (n=237)12.1% (n=240)12.2% (n=237)12.1% (n=240)12.2% (n=237)
claude-haiku-4.5012012098.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)98.3% (n=120)
claude-haiku-4.5124024060.1% (n=240)60.1% (n=240)3.3% (n=240)3.3% (n=240)3.3% (n=240)3.3% (n=240)
claude-haiku-4.5224024060.8% (n=240)60.8% (n=240)6.7% (n=240)6.7% (n=240)6.7% (n=240)6.7% (n=240)
glm-4.7-flash012012090.4% (n=120)90.4% (n=120)77.5% (n=120)77.5% (n=120)77.5% (n=120)77.5% (n=120)
glm-4.7-flash124022056.5% (n=240)61.4% (n=221)4.2% (n=240)4.5% (n=221)4.2% (n=240)4.5% (n=221)
glm-4.7-flash224022556.5% (n=240)60.3% (n=225)5.8% (n=240)6.2% (n=225)5.8% (n=240)6.2% (n=225)
claude-fable-5.1012032.5% (n=120)100.0% (n=3)2.5% (n=120)100.0% (n=3)2.5% (n=120)100.0% (n=3)
claude-fable-5.1124072.8% (n=240)96.5% (n=7)1.2% (n=240)42.9% (n=7)1.2% (n=240)42.9% (n=7)
claude-fable-5.1224041.7% (n=240)100.0% (n=4)1.7% (n=240)100.0% (n=4)1.7% (n=240)100.0% (n=4)
baseline:direct-facts012012073.7% (n=120)73.7% (n=120)0.8% (n=120)0.8% (n=120)0.8% (n=120)0.8% (n=120)
baseline:direct-facts124024073.7% (n=240)73.7% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)
baseline:direct-facts224024073.7% (n=240)73.7% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)0.8% (n=240)
baseline:story-copy01201200.0% (n=120)0.0% (n=120)0.0% (n=120)0.0% (n=120)0.0% (n=120)0.0% (n=120)
baseline:story-copy12402400.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)
baseline:story-copy22402400.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)0.0% (n=240)
genre
ProvidergenreExpectedAnsweredFact F1 · all itemsFact F1 · scored onlyExact world · all itemsExact world · scored onlyTask success · all itemsTask success · scored only
baseline:constraint-solverhotel110110100.0% (n=110)100.0% (n=110)100.0% (n=110)100.0% (n=110)100.0% (n=110)100.0% (n=110)
baseline:constraint-solvermanor105105100.0% (n=105)100.0% (n=105)100.0% (n=105)100.0% (n=105)100.0% (n=105)100.0% (n=105)
baseline:constraint-solvermaritime9090100.0% (n=90)100.0% (n=90)100.0% (n=90)100.0% (n=90)100.0% (n=90)100.0% (n=90)
baseline:constraint-solverobservatory125125100.0% (n=125)100.0% (n=125)100.0% (n=125)100.0% (n=125)100.0% (n=125)100.0% (n=125)
baseline:constraint-solvertheater170170100.0% (n=170)100.0% (n=170)100.0% (n=170)100.0% (n=170)100.0% (n=170)100.0% (n=170)
baseline:forward-chainhotel11011099.2% (n=110)99.2% (n=110)90.9% (n=110)90.9% (n=110)90.9% (n=110)90.9% (n=110)
baseline:forward-chainmanor105105100.0% (n=105)100.0% (n=105)100.0% (n=105)100.0% (n=105)100.0% (n=105)100.0% (n=105)
baseline:forward-chainmaritime9090100.0% (n=90)100.0% (n=90)100.0% (n=90)100.0% (n=90)100.0% (n=90)100.0% (n=90)
baseline:forward-chainobservatory125125100.0% (n=125)100.0% (n=125)100.0% (n=125)100.0% (n=125)100.0% (n=125)100.0% (n=125)
baseline:forward-chaintheater170170100.0% (n=170)100.0% (n=170)100.0% (n=170)100.0% (n=170)100.0% (n=170)100.0% (n=170)
gpt-6-astrahotel11010493.3% (n=110)98.7% (n=104)83.6% (n=110)88.5% (n=104)83.6% (n=110)88.5% (n=104)
gpt-6-astramanor1059589.4% (n=105)98.9% (n=95)79.0% (n=105)87.4% (n=95)79.0% (n=105)87.4% (n=95)
gpt-6-astramaritime908593.0% (n=90)98.5% (n=85)78.9% (n=90)83.5% (n=85)78.9% (n=90)83.5% (n=85)
gpt-6-astraobservatory12511490.5% (n=125)99.2% (n=114)83.2% (n=125)91.2% (n=114)83.2% (n=125)91.2% (n=114)
gpt-6-astratheater17015288.2% (n=170)98.6% (n=152)77.6% (n=170)86.8% (n=152)77.6% (n=170)86.8% (n=152)
gpt-6-solhotel11011096.0% (n=110)96.0% (n=110)74.5% (n=110)74.5% (n=110)74.5% (n=110)74.5% (n=110)
gpt-6-solmanor10510595.6% (n=105)95.6% (n=105)71.4% (n=105)71.4% (n=105)71.4% (n=105)71.4% (n=105)
gpt-6-solmaritime909096.5% (n=90)96.5% (n=90)68.9% (n=90)68.9% (n=90)67.8% (n=90)67.8% (n=90)
gpt-6-solobservatory12512597.1% (n=125)97.1% (n=125)77.6% (n=125)77.6% (n=125)77.6% (n=125)77.6% (n=125)
gpt-6-soltheater17017097.4% (n=170)97.4% (n=170)76.5% (n=170)76.5% (n=170)76.5% (n=170)76.5% (n=170)
gemini-3.7-flashhotel11011089.5% (n=110)89.5% (n=110)66.4% (n=110)66.4% (n=110)66.4% (n=110)66.4% (n=110)
gemini-3.7-flashmanor10510592.8% (n=105)92.8% (n=105)69.5% (n=105)69.5% (n=105)69.5% (n=105)69.5% (n=105)
gemini-3.7-flashmaritime909089.7% (n=90)89.7% (n=90)63.3% (n=90)63.3% (n=90)63.3% (n=90)63.3% (n=90)
gemini-3.7-flashobservatory12512591.7% (n=125)91.7% (n=125)67.2% (n=125)67.2% (n=125)67.2% (n=125)67.2% (n=125)
gemini-3.7-flashtheater17017092.1% (n=170)92.1% (n=170)73.5% (n=170)73.5% (n=170)73.5% (n=170)73.5% (n=170)
gpt-5.6-solhotel11011092.3% (n=110)92.3% (n=110)76.4% (n=110)76.4% (n=110)76.4% (n=110)76.4% (n=110)
gpt-5.6-solmanor10510590.0% (n=105)90.0% (n=105)65.7% (n=105)65.7% (n=105)65.7% (n=105)65.7% (n=105)
gpt-5.6-solmaritime909087.8% (n=90)87.8% (n=90)50.0% (n=90)50.0% (n=90)50.0% (n=90)50.0% (n=90)
gpt-5.6-solobservatory12512590.2% (n=125)90.2% (n=125)75.2% (n=125)75.2% (n=125)75.2% (n=125)75.2% (n=125)
gpt-5.6-soltheater17017093.1% (n=170)93.1% (n=170)70.0% (n=170)70.0% (n=170)70.0% (n=170)70.0% (n=170)
gemini-3.8-flashhotel11010985.2% (n=110)85.9% (n=109)57.3% (n=110)57.8% (n=109)57.3% (n=110)57.8% (n=109)
gemini-3.8-flashmanor10510488.5% (n=105)89.4% (n=104)61.0% (n=105)61.5% (n=104)61.0% (n=105)61.5% (n=104)
gemini-3.8-flashmaritime909086.7% (n=90)86.7% (n=90)61.1% (n=90)61.1% (n=90)61.1% (n=90)61.1% (n=90)
gemini-3.8-flashobservatory12512585.1% (n=125)85.1% (n=125)56.8% (n=125)56.8% (n=125)56.8% (n=125)56.8% (n=125)
gemini-3.8-flashtheater17017086.1% (n=170)86.1% (n=170)59.4% (n=170)59.4% (n=170)59.4% (n=170)59.4% (n=170)
glm-5.3hotel11010681.8% (n=110)84.9% (n=106)52.7% (n=110)54.7% (n=106)52.7% (n=110)54.7% (n=106)
glm-5.3manor10510078.6% (n=105)82.6% (n=100)54.3% (n=105)57.0% (n=100)53.3% (n=105)56.0% (n=100)
glm-5.3maritime908379.3% (n=90)86.0% (n=83)47.8% (n=90)51.8% (n=83)47.8% (n=90)51.8% (n=83)
glm-5.3observatory12511677.6% (n=125)83.6% (n=116)54.4% (n=125)58.6% (n=116)54.4% (n=125)58.6% (n=116)
glm-5.3theater17015882.1% (n=170)87.8% (n=159)55.3% (n=170)59.1% (n=159)55.3% (n=170)59.1% (n=159)
gpt-5.6-terrahotel11011080.3% (n=110)80.3% (n=110)50.0% (n=110)50.0% (n=110)50.0% (n=110)50.0% (n=110)
gpt-5.6-terramanor10510582.6% (n=105)82.6% (n=105)52.4% (n=105)52.4% (n=105)52.4% (n=105)52.4% (n=105)
gpt-5.6-terramaritime909080.0% (n=90)80.0% (n=90)44.4% (n=90)44.4% (n=90)44.4% (n=90)44.4% (n=90)
gpt-5.6-terraobservatory12512582.8% (n=125)82.8% (n=125)54.4% (n=125)54.4% (n=125)54.4% (n=125)54.4% (n=125)
gpt-5.6-terratheater17017082.4% (n=170)82.4% (n=170)50.6% (n=170)50.6% (n=170)50.6% (n=170)50.6% (n=170)
deepseek-4.1-flashhotel11010880.9% (n=110)82.4% (n=108)48.2% (n=110)49.1% (n=108)48.2% (n=110)49.1% (n=108)
deepseek-4.1-flashmanor10510580.9% (n=105)80.9% (n=105)55.2% (n=105)55.2% (n=105)55.2% (n=105)55.2% (n=105)
deepseek-4.1-flashmaritime909083.1% (n=90)83.1% (n=90)46.7% (n=90)46.7% (n=90)46.7% (n=90)46.7% (n=90)
deepseek-4.1-flashobservatory12512573.0% (n=125)73.0% (n=125)46.4% (n=125)46.4% (n=125)46.4% (n=125)46.4% (n=125)
deepseek-4.1-flashtheater17016777.8% (n=170)79.2% (n=167)47.6% (n=170)48.5% (n=167)47.6% (n=170)48.5% (n=167)
gemini-3.6-flashhotel11011080.7% (n=110)80.7% (n=110)44.5% (n=110)44.5% (n=110)44.5% (n=110)44.5% (n=110)
gemini-3.6-flashmanor10510580.6% (n=105)80.6% (n=105)42.9% (n=105)42.9% (n=105)42.9% (n=105)42.9% (n=105)
gemini-3.6-flashmaritime909079.6% (n=90)79.6% (n=90)41.1% (n=90)41.1% (n=90)41.1% (n=90)41.1% (n=90)
gemini-3.6-flashobservatory12512580.6% (n=125)80.6% (n=125)45.6% (n=125)45.6% (n=125)45.6% (n=125)45.6% (n=125)
gemini-3.6-flashtheater17017077.2% (n=170)77.2% (n=170)43.5% (n=170)43.5% (n=170)43.5% (n=170)43.5% (n=170)
deepseek-v4-prohotel11011094.3% (n=110)94.3% (n=110)42.7% (n=110)42.7% (n=110)42.7% (n=110)42.7% (n=110)
deepseek-v4-promanor10510594.1% (n=105)94.1% (n=105)52.4% (n=105)52.4% (n=105)52.4% (n=105)52.4% (n=105)
deepseek-v4-promaritime909088.7% (n=90)88.7% (n=90)34.4% (n=90)34.4% (n=90)34.4% (n=90)34.4% (n=90)
deepseek-v4-proobservatory12512592.2% (n=125)92.2% (n=125)44.8% (n=125)44.8% (n=125)44.8% (n=125)44.8% (n=125)
deepseek-v4-protheater17016889.0% (n=170)89.0% (n=170)39.4% (n=170)39.4% (n=170)39.4% (n=170)39.4% (n=170)
gpt-6-lunahotel11011078.1% (n=110)78.1% (n=110)35.5% (n=110)35.5% (n=110)35.5% (n=110)35.5% (n=110)
gpt-6-lunamanor10510582.4% (n=105)82.4% (n=105)49.5% (n=105)49.5% (n=105)48.6% (n=105)48.6% (n=105)
gpt-6-lunamaritime909077.8% (n=90)77.8% (n=90)31.1% (n=90)31.1% (n=90)31.1% (n=90)31.1% (n=90)
gpt-6-lunaobservatory12512585.0% (n=125)85.0% (n=125)49.6% (n=125)49.6% (n=125)49.6% (n=125)49.6% (n=125)
gpt-6-lunatheater17017082.4% (n=170)82.4% (n=170)43.5% (n=170)43.5% (n=170)43.5% (n=170)43.5% (n=170)
claude-sonnet-5hotel11010685.8% (n=110)89.1% (n=106)49.1% (n=110)50.9% (n=106)49.1% (n=110)50.9% (n=106)
claude-sonnet-5manor1056254.2% (n=105)91.8% (n=62)40.0% (n=105)67.7% (n=62)40.0% (n=105)67.7% (n=62)
claude-sonnet-5maritime905354.9% (n=90)93.3% (n=53)33.3% (n=90)56.6% (n=53)33.3% (n=90)56.6% (n=53)
claude-sonnet-5observatory1255944.0% (n=125)93.2% (n=59)32.0% (n=125)67.8% (n=59)32.0% (n=125)67.8% (n=59)
claude-sonnet-5theater17016585.8% (n=170)88.4% (n=165)50.0% (n=170)51.5% (n=165)50.0% (n=170)51.5% (n=165)
gpt-5.6-lunahotel11011084.2% (n=110)84.2% (n=110)43.6% (n=110)43.6% (n=110)42.7% (n=110)42.7% (n=110)
gpt-5.6-lunamanor10510582.7% (n=105)82.7% (n=105)44.8% (n=105)44.8% (n=105)44.8% (n=105)44.8% (n=105)
gpt-5.6-lunamaritime909079.5% (n=90)79.5% (n=90)26.7% (n=90)26.7% (n=90)26.7% (n=90)26.7% (n=90)
gpt-5.6-lunaobservatory12512579.7% (n=125)79.7% (n=125)48.8% (n=125)48.8% (n=125)47.2% (n=125)47.2% (n=125)
gpt-5.6-lunatheater17017080.9% (n=170)80.9% (n=170)44.7% (n=170)44.7% (n=170)42.9% (n=170)42.9% (n=170)
claude-opus-5.5hotel11011093.2% (n=110)93.2% (n=110)40.0% (n=110)40.0% (n=110)40.0% (n=110)40.0% (n=110)
claude-opus-5.5manor10510594.5% (n=105)94.5% (n=105)41.0% (n=105)41.0% (n=105)41.0% (n=105)41.0% (n=105)
claude-opus-5.5maritime908891.6% (n=90)93.7% (n=88)41.1% (n=90)42.0% (n=88)41.1% (n=90)42.0% (n=88)
claude-opus-5.5observatory12512189.5% (n=125)92.4% (n=121)42.4% (n=125)43.8% (n=121)42.4% (n=125)43.8% (n=121)
claude-opus-5.5theater17016791.3% (n=170)92.9% (n=167)37.1% (n=170)37.7% (n=167)36.5% (n=170)37.1% (n=167)
claude-fable-5hotel1105951.1% (n=110)95.3% (n=59)29.1% (n=110)54.2% (n=59)29.1% (n=110)54.2% (n=59)
claude-fable-5manor1057064.1% (n=105)96.2% (n=70)42.9% (n=105)64.3% (n=70)42.9% (n=105)64.3% (n=70)
claude-fable-5maritime906771.5% (n=90)96.0% (n=67)46.7% (n=90)62.7% (n=67)46.7% (n=90)62.7% (n=67)
claude-fable-5observatory12510981.8% (n=125)93.8% (n=109)50.4% (n=125)57.8% (n=109)50.4% (n=125)57.8% (n=109)
claude-fable-5theater1708850.0% (n=170)96.7% (n=88)32.4% (n=170)62.5% (n=88)32.4% (n=170)62.5% (n=88)
mimo-v2.6-flashhotel11010878.8% (n=110)80.2% (n=108)42.7% (n=110)43.5% (n=108)41.8% (n=110)42.6% (n=108)
mimo-v2.6-flashmanor10510483.0% (n=105)83.8% (n=104)45.7% (n=105)46.2% (n=104)43.8% (n=105)44.2% (n=104)
mimo-v2.6-flashmaritime908978.3% (n=90)79.2% (n=89)38.9% (n=90)39.3% (n=89)38.9% (n=90)39.3% (n=89)
mimo-v2.6-flashobservatory12512577.0% (n=125)77.0% (n=125)36.8% (n=125)36.8% (n=125)35.2% (n=125)35.2% (n=125)
mimo-v2.6-flashtheater17016876.8% (n=170)77.7% (n=168)39.4% (n=170)39.9% (n=168)36.5% (n=170)36.9% (n=168)
mimo-v2.6-prohotel11011080.0% (n=110)80.0% (n=110)41.8% (n=110)41.8% (n=110)41.8% (n=110)41.8% (n=110)
mimo-v2.6-promanor10510583.0% (n=105)83.0% (n=105)44.8% (n=105)44.8% (n=105)41.9% (n=105)41.9% (n=105)
mimo-v2.6-promaritime908777.5% (n=90)77.5% (n=90)36.7% (n=90)36.7% (n=90)36.7% (n=90)36.7% (n=90)
mimo-v2.6-proobservatory12512271.9% (n=125)71.9% (n=125)40.8% (n=125)40.8% (n=125)40.0% (n=125)40.0% (n=125)
mimo-v2.6-protheater17016973.4% (n=170)73.4% (n=170)34.1% (n=170)34.1% (n=170)32.4% (n=170)32.4% (n=170)
claude-opus-5hotel1108565.5% (n=110)84.7% (n=85)49.1% (n=110)63.5% (n=85)49.1% (n=110)63.5% (n=85)
claude-opus-5manor1056747.5% (n=105)74.4% (n=67)29.5% (n=105)46.3% (n=67)29.5% (n=105)46.3% (n=67)
claude-opus-5maritime907063.7% (n=90)81.9% (n=70)33.3% (n=90)42.9% (n=70)33.3% (n=90)42.9% (n=70)
claude-opus-5observatory1257247.1% (n=125)81.8% (n=72)34.4% (n=125)59.7% (n=72)34.4% (n=125)59.7% (n=72)
claude-opus-5theater17013062.2% (n=170)81.3% (n=130)38.2% (n=170)50.0% (n=130)38.2% (n=170)50.0% (n=130)
grok-4.6hotel11011089.9% (n=110)89.9% (n=110)35.5% (n=110)35.5% (n=110)35.5% (n=110)35.5% (n=110)
grok-4.6manor10510589.3% (n=105)89.3% (n=105)34.3% (n=105)34.3% (n=105)34.3% (n=105)34.3% (n=105)
grok-4.6maritime909090.0% (n=90)90.0% (n=90)43.3% (n=90)43.3% (n=90)43.3% (n=90)43.3% (n=90)
grok-4.6observatory12512589.6% (n=125)89.6% (n=125)35.2% (n=125)35.2% (n=125)35.2% (n=125)35.2% (n=125)
grok-4.6theater17017088.9% (n=170)88.9% (n=170)37.6% (n=170)37.6% (n=170)37.6% (n=170)37.6% (n=170)
kimi-k2.6hotel11011090.5% (n=110)90.5% (n=110)34.5% (n=110)34.5% (n=110)34.5% (n=110)34.5% (n=110)
kimi-k2.6manor10510591.2% (n=105)91.2% (n=105)39.0% (n=105)39.0% (n=105)39.0% (n=105)39.0% (n=105)
kimi-k2.6maritime909093.0% (n=90)93.0% (n=90)40.0% (n=90)40.0% (n=90)40.0% (n=90)40.0% (n=90)
kimi-k2.6observatory12512589.8% (n=125)89.8% (n=125)37.6% (n=125)37.6% (n=125)37.6% (n=125)37.6% (n=125)
kimi-k2.6theater17016989.0% (n=170)89.5% (n=169)33.5% (n=170)33.7% (n=169)33.5% (n=170)33.7% (n=169)
minimax-m3hotel11010968.3% (n=110)68.3% (n=110)37.3% (n=110)37.3% (n=110)37.3% (n=110)37.3% (n=110)
minimax-m3manor10510572.7% (n=105)72.7% (n=105)38.1% (n=105)38.1% (n=105)38.1% (n=105)38.1% (n=105)
minimax-m3maritime909063.2% (n=90)63.2% (n=90)25.6% (n=90)25.6% (n=90)25.6% (n=90)25.6% (n=90)
minimax-m3observatory12512361.9% (n=125)61.9% (n=125)32.0% (n=125)32.0% (n=125)32.0% (n=125)32.0% (n=125)
minimax-m3theater17017073.5% (n=170)73.5% (n=170)34.7% (n=170)34.7% (n=170)34.7% (n=170)34.7% (n=170)
qwen3.8-27bhotel11011084.0% (n=110)84.0% (n=110)35.5% (n=110)35.5% (n=110)35.5% (n=110)35.5% (n=110)
qwen3.8-27bmanor10510585.7% (n=105)85.7% (n=105)33.3% (n=105)33.3% (n=105)33.3% (n=105)33.3% (n=105)
qwen3.8-27bmaritime909083.7% (n=90)83.7% (n=90)31.1% (n=90)31.1% (n=90)31.1% (n=90)31.1% (n=90)
qwen3.8-27bobservatory12512582.6% (n=125)82.6% (n=125)32.0% (n=125)32.0% (n=125)32.0% (n=125)32.0% (n=125)
qwen3.8-27btheater17017082.8% (n=170)82.8% (n=170)35.3% (n=170)35.3% (n=170)35.3% (n=170)35.3% (n=170)
kimi-k3hotel1109370.5% (n=110)83.4% (n=93)36.4% (n=110)43.0% (n=93)36.4% (n=110)43.0% (n=93)
kimi-k3manor1057663.4% (n=105)87.6% (n=76)34.3% (n=105)47.4% (n=76)34.3% (n=105)47.4% (n=76)
kimi-k3maritime906159.6% (n=90)87.9% (n=61)23.3% (n=90)34.4% (n=61)23.3% (n=90)34.4% (n=61)
kimi-k3observatory1259560.6% (n=125)79.7% (n=95)32.0% (n=125)42.1% (n=95)32.0% (n=125)42.1% (n=95)
kimi-k3theater17011860.7% (n=170)87.5% (n=118)29.4% (n=170)42.4% (n=118)29.4% (n=170)42.4% (n=118)
glm-5.3-flashhotel11011068.3% (n=110)68.3% (n=110)25.5% (n=110)25.5% (n=110)25.5% (n=110)25.5% (n=110)
glm-5.3-flashmanor10510570.8% (n=105)70.8% (n=105)35.2% (n=105)35.2% (n=105)35.2% (n=105)35.2% (n=105)
glm-5.3-flashmaritime908966.5% (n=90)67.3% (n=89)21.1% (n=90)21.3% (n=89)21.1% (n=90)21.3% (n=89)
glm-5.3-flashobservatory12512565.0% (n=125)65.0% (n=125)25.6% (n=125)25.6% (n=125)25.6% (n=125)25.6% (n=125)
glm-5.3-flashtheater17016764.4% (n=170)65.5% (n=167)23.5% (n=170)24.0% (n=167)22.9% (n=170)23.4% (n=167)
claude-haiku-4.5hotel11011068.4% (n=110)68.4% (n=110)25.5% (n=110)25.5% (n=110)25.5% (n=110)25.5% (n=110)
claude-haiku-4.5manor10510575.4% (n=105)75.4% (n=105)28.6% (n=105)28.6% (n=105)28.6% (n=105)28.6% (n=105)
claude-haiku-4.5maritime909070.3% (n=90)70.3% (n=90)23.3% (n=90)23.3% (n=90)23.3% (n=90)23.3% (n=90)
claude-haiku-4.5observatory12512560.7% (n=125)60.7% (n=125)20.0% (n=125)20.0% (n=125)20.0% (n=125)20.0% (n=125)
claude-haiku-4.5theater17017067.5% (n=170)67.5% (n=170)22.4% (n=170)22.4% (n=170)22.4% (n=170)22.4% (n=170)
glm-4.7-flashhotel1109556.2% (n=110)65.1% (n=95)18.2% (n=110)21.1% (n=95)18.2% (n=110)21.1% (n=95)
glm-4.7-flashmanor10510268.4% (n=105)70.4% (n=102)24.8% (n=105)25.5% (n=102)24.8% (n=105)25.5% (n=102)
glm-4.7-flashmaritime908465.6% (n=90)70.3% (n=84)16.7% (n=90)17.9% (n=84)16.7% (n=90)17.9% (n=84)
glm-4.7-flashobservatory12512067.1% (n=125)69.9% (n=120)20.8% (n=125)21.7% (n=120)20.8% (n=125)21.7% (n=120)
glm-4.7-flashtheater17016460.7% (n=170)62.5% (n=165)17.6% (n=170)18.2% (n=165)17.6% (n=170)18.2% (n=165)
claude-fable-5.1hotel11010.8% (n=110)90.9% (n=1)0.0% (n=110)0.0% (n=1)0.0% (n=110)0.0% (n=1)
claude-fable-5.1manor10532.8% (n=105)99.3% (n=3)1.9% (n=105)66.7% (n=3)1.9% (n=105)66.7% (n=3)
claude-fable-5.1maritime9044.4% (n=90)98.1% (n=4)3.3% (n=90)75.0% (n=4)3.3% (n=90)75.0% (n=4)
claude-fable-5.1observatory12521.6% (n=125)100.0% (n=2)1.6% (n=125)100.0% (n=2)1.6% (n=125)100.0% (n=2)
claude-fable-5.1theater17042.3% (n=170)98.6% (n=4)1.8% (n=170)75.0% (n=4)1.8% (n=170)75.0% (n=4)
baseline:direct-factshotel11011074.6% (n=110)74.6% (n=110)0.0% (n=110)0.0% (n=110)0.0% (n=110)0.0% (n=110)
baseline:direct-factsmanor10510573.4% (n=105)73.4% (n=105)0.0% (n=105)0.0% (n=105)0.0% (n=105)0.0% (n=105)
baseline:direct-factsmaritime909076.6% (n=90)76.6% (n=90)5.6% (n=90)5.6% (n=90)5.6% (n=90)5.6% (n=90)
baseline:direct-factsobservatory12512573.6% (n=125)73.6% (n=125)0.0% (n=125)0.0% (n=125)0.0% (n=125)0.0% (n=125)
baseline:direct-factstheater17017071.8% (n=170)71.8% (n=170)0.0% (n=170)0.0% (n=170)0.0% (n=170)0.0% (n=170)
baseline:story-copyhotel1101100.0% (n=110)0.0% (n=110)0.0% (n=110)0.0% (n=110)0.0% (n=110)0.0% (n=110)
baseline:story-copymanor1051050.0% (n=105)0.0% (n=105)0.0% (n=105)0.0% (n=105)0.0% (n=105)0.0% (n=105)
baseline:story-copymaritime90900.0% (n=90)0.0% (n=90)0.0% (n=90)0.0% (n=90)0.0% (n=90)0.0% (n=90)
baseline:story-copyobservatory1251250.0% (n=125)0.0% (n=125)0.0% (n=125)0.0% (n=125)0.0% (n=125)0.0% (n=125)
baseline:story-copytheater1701700.0% (n=170)0.0% (n=170)0.0% (n=170)0.0% (n=170)0.0% (n=170)0.0% (n=170)
renderer
ProviderrendererExpectedAnsweredFact F1 · all itemsFact F1 · scored onlyExact world · all itemsExact world · scored onlyTask success · all itemsTask success · scored only
baseline:constraint-solvertemplate600600100.0% (n=600)100.0% (n=600)100.0% (n=600)100.0% (n=600)100.0% (n=600)100.0% (n=600)
baseline:forward-chaintemplate60060099.8% (n=600)99.8% (n=600)98.3% (n=600)98.3% (n=600)98.3% (n=600)98.3% (n=600)
gpt-6-astratemplate60055090.6% (n=600)98.8% (n=550)80.3% (n=600)87.6% (n=550)80.3% (n=600)87.6% (n=550)
gpt-6-soltemplate60060096.6% (n=600)96.6% (n=600)74.3% (n=600)74.3% (n=600)74.2% (n=600)74.2% (n=600)
gemini-3.7-flashtemplate60060091.3% (n=600)91.3% (n=600)68.7% (n=600)68.7% (n=600)68.7% (n=600)68.7% (n=600)
gpt-5.6-soltemplate60060091.0% (n=600)91.0% (n=600)68.5% (n=600)68.5% (n=600)68.5% (n=600)68.5% (n=600)
gemini-3.8-flashtemplate60059886.2% (n=600)86.5% (n=598)59.0% (n=600)59.2% (n=598)59.0% (n=600)59.2% (n=598)
glm-5.3template60056380.1% (n=600)85.2% (n=564)53.3% (n=600)56.7% (n=564)53.2% (n=600)56.6% (n=564)
gpt-5.6-terratemplate60060081.8% (n=600)81.8% (n=600)50.7% (n=600)50.7% (n=600)50.7% (n=600)50.7% (n=600)
deepseek-4.1-flashtemplate60059578.7% (n=600)79.4% (n=595)48.7% (n=600)49.1% (n=595)48.7% (n=600)49.1% (n=595)
gemini-3.6-flashtemplate60060079.5% (n=600)79.5% (n=600)43.7% (n=600)43.7% (n=600)43.7% (n=600)43.7% (n=600)
deepseek-v4-protemplate60059891.5% (n=600)91.5% (n=600)42.7% (n=600)42.7% (n=600)42.7% (n=600)42.7% (n=600)
gpt-6-lunatemplate60060081.5% (n=600)81.5% (n=600)42.5% (n=600)42.5% (n=600)42.3% (n=600)42.3% (n=600)
claude-sonnet-5template60044566.9% (n=600)90.2% (n=445)41.8% (n=600)56.4% (n=445)41.8% (n=600)56.4% (n=445)
gpt-5.6-lunatemplate60060081.4% (n=600)81.4% (n=600)42.7% (n=600)42.7% (n=600)41.7% (n=600)41.7% (n=600)
claude-opus-5.5template60059191.9% (n=600)93.3% (n=591)40.0% (n=600)40.6% (n=591)39.8% (n=600)40.4% (n=591)
claude-fable-5template60039362.5% (n=600)95.5% (n=393)39.5% (n=600)60.3% (n=393)39.5% (n=600)60.3% (n=393)
mimo-v2.6-flashtemplate60059478.5% (n=600)79.3% (n=594)40.5% (n=600)40.9% (n=594)38.8% (n=600)39.2% (n=594)
mimo-v2.6-protemplate60059376.6% (n=600)76.6% (n=600)39.2% (n=600)39.2% (n=600)38.0% (n=600)38.0% (n=600)
claude-opus-5template60042457.3% (n=600)81.1% (n=424)37.2% (n=600)52.6% (n=424)37.2% (n=600)52.6% (n=424)
grok-4.6template60060089.5% (n=600)89.5% (n=600)37.0% (n=600)37.0% (n=600)37.0% (n=600)37.0% (n=600)
kimi-k2.6template60059990.4% (n=600)90.6% (n=599)36.5% (n=600)36.6% (n=599)36.5% (n=600)36.6% (n=599)
minimax-m3template60059768.5% (n=600)68.5% (n=600)33.8% (n=600)33.8% (n=600)33.8% (n=600)33.8% (n=600)
qwen3.8-27btemplate60060083.6% (n=600)83.6% (n=600)33.7% (n=600)33.7% (n=600)33.7% (n=600)33.7% (n=600)
kimi-k3template60044362.8% (n=600)85.0% (n=443)31.2% (n=600)42.2% (n=443)31.2% (n=600)42.2% (n=443)
glm-5.3-flashtemplate60059666.7% (n=600)67.1% (n=596)26.0% (n=600)26.2% (n=596)25.8% (n=600)26.0% (n=596)
claude-haiku-4.5template60060068.0% (n=600)68.0% (n=600)23.7% (n=600)23.7% (n=600)23.7% (n=600)23.7% (n=600)
glm-4.7-flashtemplate60056563.3% (n=600)67.1% (n=566)19.5% (n=600)20.7% (n=566)19.5% (n=600)20.7% (n=566)
claude-fable-5.1template600142.3% (n=600)98.2% (n=14)1.7% (n=600)71.4% (n=14)1.7% (n=600)71.4% (n=14)
baseline:direct-factstemplate60060073.7% (n=600)73.7% (n=600)0.8% (n=600)0.8% (n=600)0.8% (n=600)0.8% (n=600)
baseline:story-copytemplate6006000.0% (n=600)0.0% (n=600)0.0% (n=600)0.0% (n=600)0.0% (n=600)0.0% (n=600)
Model pairs · fact F1 difference (percentage points, left − right)baseline:story-copy − gpt-6-baseline:story-copy − gpt-6-astra · Δ fact F1: -98.8baseline:story-copy − claudebaseline:story-copy − claude-fable-5.1 · Δ fact F1: -98.2baseline:story-copy − gpt-6-baseline:story-copy − gpt-6-sol · Δ fact F1: -96.6baseline:story-copy − claudebaseline:story-copy − claude-fable-5 · Δ fact F1: -95.5baseline:story-copy − claudebaseline:story-copy − claude-opus-5.5 · Δ fact F1: -93.3baseline:story-copy − deepsebaseline:story-copy − deepseek-v4-pro · Δ fact F1: -91.5baseline:story-copy − geminibaseline:story-copy − gemini-3.7-flash · Δ fact F1: -91.3baseline:story-copy − gpt-5.baseline:story-copy − gpt-5.6-sol · Δ fact F1: -91baseline:story-copy − kimi-kbaseline:story-copy − kimi-k2.6 · Δ fact F1: -90.6baseline:story-copy − claudebaseline:story-copy − claude-sonnet-5 · Δ fact F1: -90.2baseline:story-copy − grok-4baseline:story-copy − grok-4.6 · Δ fact F1: -89.5baseline:story-copy − geminibaseline:story-copy − gemini-3.8-flash · Δ fact F1: -86.5baseline:story-copy − glm-5.baseline:story-copy − glm-5.3 · Δ fact F1: -85.2baseline:story-copy − kimi-kbaseline:story-copy − kimi-k3 · Δ fact F1: -85baseline:story-copy − qwen3.baseline:story-copy − qwen3.8-27b · Δ fact F1: -83.6baseline:story-copy − gpt-5.baseline:story-copy − gpt-5.6-terra · Δ fact F1: -81.8baseline:story-copy − gpt-6-baseline:story-copy − gpt-6-luna · Δ fact F1: -81.5baseline:story-copy − gpt-5.baseline:story-copy − gpt-5.6-luna · Δ fact F1: -81.4baseline:story-copy − claudebaseline:story-copy − claude-opus-5 · Δ fact F1: -81.1baseline:story-copy − geminibaseline:story-copy − gemini-3.6-flash · Δ fact F1: -79.5baseline:story-copy − deepsebaseline:story-copy − deepseek-4.1-flash · Δ fact F1: -79.4baseline:story-copy − mimo-vbaseline:story-copy − mimo-v2.6-flash · Δ fact F1: -79.3baseline:story-copy − mimo-vbaseline:story-copy − mimo-v2.6-pro · Δ fact F1: -76.6baseline:story-copy − minimabaseline:story-copy − minimax-m3 · Δ fact F1: -68.5baseline:story-copy − claudebaseline:story-copy − claude-haiku-4.5 · Δ fact F1: -68baseline:story-copy − glm-4.baseline:story-copy − glm-4.7-flash · Δ fact F1: -67.1baseline:story-copy − glm-5.baseline:story-copy − glm-5.3-flash · Δ fact F1: -67.1glm-4.7-flash − gpt-6-astraglm-4.7-flash − gpt-6-astra · Δ fact F1: -30.2glm-4.7-flash − gpt-6-solglm-4.7-flash − gpt-6-sol · Δ fact F1: -29.5glm-5.3-flash − gpt-6-solglm-5.3-flash − gpt-6-sol · Δ fact F1: -29.5claude-haiku-4.5 − gpt-6-astclaude-haiku-4.5 − gpt-6-astra · Δ fact F1: -29.4glm-5.3-flash − gpt-6-astraglm-5.3-flash − gpt-6-astra · Δ fact F1: -29.3claude-haiku-4.5 − gpt-6-solclaude-haiku-4.5 − gpt-6-sol · Δ fact F1: -28.6baseline:direct-facts − claubaseline:direct-facts − claude-fable-5.1 · Δ fact F1: -27baseline:direct-facts − basebaseline:direct-facts − baseline:forward-chain · Δ fact F1: -26.2claude-haiku-4.5 − claude-opclaude-haiku-4.5 − claude-opus-5.5 · Δ fact F1: -25baseline:direct-facts − gpt-baseline:direct-facts − gpt-6-astra · Δ fact F1: -24.6glm-4.7-flash − gpt-5.6-solglm-4.7-flash − gpt-5.6-sol · Δ fact F1: -24.1glm-5.3-flash − gpt-5.6-solglm-5.3-flash − gpt-5.6-sol · Δ fact F1: -23.9glm-4.7-flash − kimi-k2.6glm-4.7-flash − kimi-k2.6 · Δ fact F1: -23.8claude-haiku-4.5 − deepseek-claude-haiku-4.5 − deepseek-v4-pro · Δ fact F1: -23.4claude-haiku-4.5 − gemini-3.claude-haiku-4.5 − gemini-3.7-flash · Δ fact F1: -23.3glm-5.3-flash − kimi-k2.6glm-5.3-flash − kimi-k2.6 · Δ fact F1: -23.3baseline:direct-facts − gpt-baseline:direct-facts − gpt-6-sol · Δ fact F1: -23claude-haiku-4.5 − gpt-5.6-sclaude-haiku-4.5 − gpt-5.6-sol · Δ fact F1: -23glm-4.7-flash − grok-4.6glm-4.7-flash − grok-4.6 · Δ fact F1: -22.6claude-haiku-4.5 − kimi-k2.6claude-haiku-4.5 − kimi-k2.6 · Δ fact F1: -22.5glm-5.3-flash − grok-4.6glm-5.3-flash − grok-4.6 · Δ fact F1: -22.3baseline:direct-facts − claubaseline:direct-facts − claude-fable-5 · Δ fact F1: -21.4claude-haiku-4.5 − grok-4.6claude-haiku-4.5 − grok-4.6 · Δ fact F1: -21.4claude-haiku-4.5 − claude-opclaude-haiku-4.5 − claude-opus-5 · Δ fact F1: -19.6baseline:direct-facts − claubaseline:direct-facts − claude-opus-5.5 · Δ fact F1: -19.5claude-haiku-4.5 − gemini-3.claude-haiku-4.5 − gemini-3.8-flash · Δ fact F1: -18.5deepseek-4.1-flash − gpt-6-adeepseek-4.1-flash − gpt-6-astra · Δ fact F1: -17.9baseline:direct-facts − deepbaseline:direct-facts − deepseek-v4-pro · Δ fact F1: -17.8glm-4.7-flash − glm-5.3glm-4.7-flash − glm-5.3 · Δ fact F1: -17.8baseline:direct-facts − gemibaseline:direct-facts − gemini-3.7-flash · Δ fact F1: -17.6claude-haiku-4.5 − claude-soclaude-haiku-4.5 − claude-sonnet-5 · Δ fact F1: -17.4baseline:direct-facts − gpt-baseline:direct-facts − gpt-5.6-sol · Δ fact F1: -17.3deepseek-4.1-flash − gpt-6-sdeepseek-4.1-flash − gpt-6-sol · Δ fact F1: -17.3gemini-3.6-flash − gpt-6-solgemini-3.6-flash − gpt-6-sol · Δ fact F1: -17.2gemini-3.6-flash − gpt-6-astgemini-3.6-flash − gpt-6-astra · Δ fact F1: -17.1gpt-5.6-luna − gpt-6-astragpt-5.6-luna − gpt-6-astra · Δ fact F1: -17baseline:direct-facts − kimibaseline:direct-facts − kimi-k2.6 · Δ fact F1: -16.9glm-4.7-flash − qwen3.8-27bglm-4.7-flash − qwen3.8-27b · Δ fact F1: -16.8claude-opus-5 − gpt-6-astraclaude-opus-5 − gpt-6-astra · Δ fact F1: -16.7baseline:direct-facts − claubaseline:direct-facts − claude-sonnet-5 · Δ fact F1: -16.6glm-5.3-flash − qwen3.8-27bglm-5.3-flash − qwen3.8-27b · Δ fact F1: -16.5claude-haiku-4.5 − glm-5.3claude-haiku-4.5 − glm-5.3 · Δ fact F1: -16.2glm-4.7-flash − kimi-k3glm-4.7-flash − kimi-k3 · Δ fact F1: -16baseline:direct-facts − grokbaseline:direct-facts − grok-4.6 · Δ fact F1: -15.8claude-haiku-4.5 − qwen3.8-2claude-haiku-4.5 − qwen3.8-27b · Δ fact F1: -15.6gpt-5.6-terra − gpt-6-astragpt-5.6-terra − gpt-6-astra · Δ fact F1: -15.6gpt-5.6-luna − gpt-6-solgpt-5.6-luna − gpt-6-sol · Δ fact F1: -15.3glm-4.7-flash − gpt-6-lunaglm-4.7-flash − gpt-6-luna · Δ fact F1: -15.2gpt-6-luna − gpt-6-solgpt-6-luna − gpt-6-sol · Δ fact F1: -15.2minimax-m3 − qwen3.8-27bminimax-m3 − qwen3.8-27b · Δ fact F1: -15.2claude-opus-5 − gpt-6-solclaude-opus-5 − gpt-6-sol · Δ fact F1: -15.1glm-4.7-flash − gpt-5.6-terrglm-4.7-flash − gpt-5.6-terra · Δ fact F1: -15.1gpt-5.6-terra − gpt-6-solgpt-5.6-terra − gpt-6-sol · Δ fact F1: -14.9glm-5.3-flash − gpt-5.6-terrglm-5.3-flash − gpt-5.6-terra · Δ fact F1: -14.5glm-4.7-flash − gpt-5.6-lunaglm-4.7-flash − gpt-5.6-luna · Δ fact F1: -14.3glm-5.3-flash − gpt-5.6-lunaglm-5.3-flash − gpt-5.6-luna · Δ fact F1: -14.2glm-5.3-flash − gpt-6-lunaglm-5.3-flash − gpt-6-luna · Δ fact F1: -14.2claude-haiku-4.5 − kimi-k3claude-haiku-4.5 − kimi-k3 · Δ fact F1: -14.1claude-haiku-4.5 − gpt-5.6-tclaude-haiku-4.5 − gpt-5.6-terra · Δ fact F1: -13.7claude-haiku-4.5 − gpt-6-lunclaude-haiku-4.5 − gpt-6-luna · Δ fact F1: -13.4claude-haiku-4.5 − gpt-5.6-lclaude-haiku-4.5 − gpt-5.6-luna · Δ fact F1: -13.3glm-4.7-flash − mimo-v2.6-flglm-4.7-flash − mimo-v2.6-flash · Δ fact F1: -12.9baseline:direct-facts − gemibaseline:direct-facts − gemini-3.8-flash · Δ fact F1: -12.8deepseek-4.1-flash − gemini-deepseek-4.1-flash − gemini-3.7-flash · Δ fact F1: -12.3glm-5.3-flash − mimo-v2.6-flglm-5.3-flash − mimo-v2.6-flash · Δ fact F1: -12.3deepseek-4.1-flash − deepseedeepseek-4.1-flash − deepseek-v4-pro · Δ fact F1: -12.1glm-5.3 − gpt-6-astraglm-5.3 − gpt-6-astra · Δ fact F1: -12gemini-3.6-flash − gemini-3.gemini-3.6-flash − gemini-3.7-flash · Δ fact F1: -11.8deepseek-4.1-flash − gpt-5.6deepseek-4.1-flash − gpt-5.6-sol · Δ fact F1: -11.6gemini-3.6-flash − gpt-5.6-sgemini-3.6-flash − gpt-5.6-sol · Δ fact F1: -11.5glm-5.3 − gpt-6-solglm-5.3 − gpt-6-sol · Δ fact F1: -11.5glm-5.3-flash − kimi-k3glm-5.3-flash − kimi-k3 · Δ fact F1: -11.5baseline:direct-facts − glm-baseline:direct-facts − glm-5.3 · Δ fact F1: -11.4claude-haiku-4.5 − gemini-3.claude-haiku-4.5 − gemini-3.6-flash · Δ fact F1: -11.4claude-haiku-4.5 − mimo-v2.6claude-haiku-4.5 − mimo-v2.6-flash · Δ fact F1: -11.4claude-haiku-4.5 − deepseek-claude-haiku-4.5 − deepseek-4.1-flash · Δ fact F1: -11.2deepseek-4.1-flash − kimi-k2deepseek-4.1-flash − kimi-k2.6 · Δ fact F1: -11.2gemini-3.8-flash − gpt-6-astgemini-3.8-flash − gpt-6-astra · Δ fact F1: -11.2gemini-3.6-flash − kimi-k2.6gemini-3.6-flash − kimi-k2.6 · Δ fact F1: -11.1claude-opus-5 − claude-opus-claude-opus-5 − claude-opus-5.5 · Δ fact F1: -10.5baseline:direct-facts − kimibaseline:direct-facts − kimi-k3 · Δ fact F1: -10.2deepseek-4.1-flash − grok-4.deepseek-4.1-flash − grok-4.6 · Δ fact F1: -10.2gemini-3.8-flash − gpt-6-solgemini-3.8-flash − gpt-6-sol · Δ fact F1: -10.1gemini-3.6-flash − grok-4.6gemini-3.6-flash − grok-4.6 · Δ fact F1: -10glm-4.7-flash − mimo-v2.6-prglm-4.7-flash − mimo-v2.6-pro · Δ fact F1: -10baseline:direct-facts − qwenbaseline:direct-facts − qwen3.8-27b · Δ fact F1: -9.9gpt-5.6-luna − gpt-5.6-solgpt-5.6-luna − gpt-5.6-sol · Δ fact F1: -9.6glm-5.3-flash − mimo-v2.6-prglm-5.3-flash − mimo-v2.6-pro · Δ fact F1: -9.3gpt-5.6-luna − kimi-k2.6gpt-5.6-luna − kimi-k2.6 · Δ fact F1: -9.2gpt-6-luna − kimi-k2.6gpt-6-luna − kimi-k2.6 · Δ fact F1: -9.1claude-opus-5 − deepseek-v4-claude-opus-5 − deepseek-v4-pro · Δ fact F1: -9claude-opus-5 − gemini-3.7-fclaude-opus-5 − gemini-3.7-flash · Δ fact F1: -8.8gpt-5.6-terra − kimi-k2.6gpt-5.6-terra − kimi-k2.6 · Δ fact F1: -8.8claude-haiku-4.5 − mimo-v2.6claude-haiku-4.5 − mimo-v2.6-pro · Δ fact F1: -8.6claude-opus-5 − gpt-5.6-solclaude-opus-5 − gpt-5.6-sol · Δ fact F1: -8.4baseline:direct-facts − gpt-baseline:direct-facts − gpt-5.6-terra · Δ fact F1: -8.1claude-sonnet-5 − gpt-6-astrclaude-sonnet-5 − gpt-6-astra · Δ fact F1: -8.1gpt-5.6-luna − grok-4.6gpt-5.6-luna − grok-4.6 · Δ fact F1: -8.1gpt-6-luna − grok-4.6gpt-6-luna − grok-4.6 · Δ fact F1: -8baseline:direct-facts − gpt-baseline:direct-facts − gpt-6-luna · Δ fact F1: -7.8baseline:direct-facts − gpt-baseline:direct-facts − gpt-5.6-luna · Δ fact F1: -7.7gpt-5.6-terra − grok-4.6gpt-5.6-terra − grok-4.6 · Δ fact F1: -7.7claude-opus-5 − kimi-k2.6claude-opus-5 − kimi-k2.6 · Δ fact F1: -7.5deepseek-4.1-flash − gemini-deepseek-4.1-flash − gemini-3.8-flash · Δ fact F1: -7.2baseline:direct-facts − claubaseline:direct-facts − claude-opus-5 · Δ fact F1: -7gemini-3.6-flash − gemini-3.gemini-3.6-flash − gemini-3.8-flash · Δ fact F1: -7mimo-v2.6-pro − qwen3.8-27bmimo-v2.6-pro − qwen3.8-27b · Δ fact F1: -7deepseek-v4-pro − gpt-6-astrdeepseek-v4-pro − gpt-6-astra · Δ fact F1: -6.9gpt-5.6-sol − gpt-6-astragpt-5.6-sol − gpt-6-astra · Δ fact F1: -6.9claude-sonnet-5 − gpt-6-solclaude-sonnet-5 − gpt-6-sol · Δ fact F1: -6.8claude-opus-5 − claude-sonneclaude-opus-5 − claude-sonnet-5 · Δ fact F1: -6.6gemini-3.7-flash − gpt-6-astgemini-3.7-flash − gpt-6-astra · Δ fact F1: -6.6claude-opus-5 − grok-4.6claude-opus-5 − grok-4.6 · Δ fact F1: -6.2deepseek-4.1-flash − glm-5.3deepseek-4.1-flash − glm-5.3 · Δ fact F1: -6glm-5.3 − gpt-5.6-solglm-5.3 − gpt-5.6-sol · Δ fact F1: -5.9baseline:direct-facts − gemibaseline:direct-facts − gemini-3.6-flash · Δ fact F1: -5.8baseline:direct-facts − deepbaseline:direct-facts − deepseek-4.1-flash · Δ fact F1: -5.6baseline:direct-facts − mimobaseline:direct-facts − mimo-v2.6-flash · Δ fact F1: -5.6gpt-5.6-sol − gpt-6-solgpt-5.6-sol − gpt-6-sol · Δ fact F1: -5.6glm-5.3 − kimi-k2.6glm-5.3 − kimi-k2.6 · Δ fact F1: -5.5claude-opus-5.5 − gpt-6-astrclaude-opus-5.5 − gpt-6-astra · Δ fact F1: -5.3gemini-3.6-flash − glm-5.3gemini-3.6-flash − glm-5.3 · Δ fact F1: -5.3gemini-3.7-flash − gpt-6-solgemini-3.7-flash − gpt-6-sol · Δ fact F1: -5.3deepseek-v4-pro − gpt-6-soldeepseek-v4-pro − gpt-6-sol · Δ fact F1: -5.2gemini-3.8-flash − gpt-5.6-sgemini-3.8-flash − gpt-5.6-sol · Δ fact F1: -4.6deepseek-4.1-flash − qwen3.8deepseek-4.1-flash − qwen3.8-27b · Δ fact F1: -4.5glm-5.3 − grok-4.6glm-5.3 − grok-4.6 · Δ fact F1: -4.4mimo-v2.6-flash − qwen3.8-27mimo-v2.6-flash − qwen3.8-27b · Δ fact F1: -4.2gemini-3.6-flash − qwen3.8-2gemini-3.6-flash − qwen3.8-27b · Δ fact F1: -4.1gemini-3.8-flash − kimi-k2.6gemini-3.8-flash − kimi-k2.6 · Δ fact F1: -4.1claude-fable-5 − gpt-6-astraclaude-fable-5 − gpt-6-astra · Δ fact F1: -3.6claude-opus-5 − gemini-3.8-fclaude-opus-5 − gemini-3.8-flash · Δ fact F1: -3.6claude-sonnet-5 − gpt-5.6-soclaude-sonnet-5 − gpt-5.6-sol · Δ fact F1: -3.6claude-opus-5.5 − gpt-6-solclaude-opus-5.5 − gpt-6-sol · Δ fact F1: -3.4claude-sonnet-5 − gemini-3.7claude-sonnet-5 − gemini-3.7-flash · Δ fact F1: -3.4baseline:direct-facts − mimobaseline:direct-facts − mimo-v2.6-pro · Δ fact F1: -2.9gemini-3.8-flash − grok-4.6gemini-3.8-flash − grok-4.6 · Δ fact F1: -2.9deepseek-4.1-flash − kimi-k3deepseek-4.1-flash − kimi-k3 · Δ fact F1: -2.8deepseek-4.1-flash − gpt-5.6deepseek-4.1-flash − gpt-5.6-terra · Δ fact F1: -2.4gemini-3.6-flash − gpt-5.6-tgemini-3.6-flash − gpt-5.6-terra · Δ fact F1: -2.3gpt-5.6-luna − kimi-k3gpt-5.6-luna − kimi-k3 · Δ fact F1: -2.3gpt-5.6-luna − qwen3.8-27bgpt-5.6-luna − qwen3.8-27b · Δ fact F1: -2.3glm-4.7-flash − minimax-m3glm-4.7-flash − minimax-m3 · Δ fact F1: -2.2gpt-6-luna − qwen3.8-27bgpt-6-luna − qwen3.8-27b · Δ fact F1: -2.2deepseek-4.1-flash − gpt-6-ldeepseek-4.1-flash − gpt-6-luna · Δ fact F1: -2.1gemini-3.6-flash − gpt-6-lungemini-3.6-flash − gpt-6-luna · Δ fact F1: -2claude-sonnet-5 − deepseek-vclaude-sonnet-5 − deepseek-v4-pro · Δ fact F1: -1.9deepseek-4.1-flash − gpt-5.6deepseek-4.1-flash − gpt-5.6-luna · Δ fact F1: -1.9gemini-3.6-flash − gpt-5.6-lgemini-3.6-flash − gpt-5.6-luna · Δ fact F1: -1.9gpt-5.6-terra − qwen3.8-27bgpt-5.6-terra − qwen3.8-27b · Δ fact F1: -1.9claude-fable-5 − gpt-6-solclaude-fable-5 − gpt-6-sol · Δ fact F1: -1.8claude-sonnet-5 − kimi-k2.6claude-sonnet-5 − kimi-k2.6 · Δ fact F1: -1.7claude-fable-5 − claude-fablclaude-fable-5 − claude-fable-5.1 · Δ fact F1: -1.3claude-opus-5 − glm-5.3claude-opus-5 − glm-5.3 · Δ fact F1: -1.2glm-5.3-flash − minimax-m3glm-5.3-flash − minimax-m3 · Δ fact F1: -1.2gemini-3.6-flash − kimi-k3gemini-3.6-flash − kimi-k3 · Δ fact F1: -1.1gpt-6-luna − kimi-k3gpt-6-luna − kimi-k3 · Δ fact F1: -1.1grok-4.6 − kimi-k2.6grok-4.6 − kimi-k2.6 · Δ fact F1: -1.1claude-sonnet-5 − grok-4.6claude-sonnet-5 − grok-4.6 · Δ fact F1: -1kimi-k3 − qwen3.8-27bkimi-k3 − qwen3.8-27b · Δ fact F1: -1claude-fable-5.1 − gpt-6-astclaude-fable-5.1 − gpt-6-astra · Δ fact F1: -0.9gpt-5.6-terra − kimi-k3gpt-5.6-terra − kimi-k3 · Δ fact F1: -0.9glm-4.7-flash − glm-5.3-flasglm-4.7-flash − glm-5.3-flash · Δ fact F1: -0.5claude-haiku-4.5 − minimax-mclaude-haiku-4.5 − minimax-m3 · Δ fact F1: -0.4gpt-5.6-luna − gpt-5.6-terragpt-5.6-luna − gpt-5.6-terra · Δ fact F1: -0.4claude-opus-5 − qwen3.8-27bclaude-opus-5 − qwen3.8-27b · Δ fact F1: -0.3deepseek-4.1-flash − gemini-deepseek-4.1-flash − gemini-3.6-flash · Δ fact F1: -0.2claude-opus-5 − kimi-k3claude-opus-5 − kimi-k3 · Δ fact F1: -0.1deepseek-4.1-flash − mimo-v2deepseek-4.1-flash − mimo-v2.6-flash · Δ fact F1: -0.1gpt-5.6-luna − gpt-6-lunagpt-5.6-luna − gpt-6-luna · Δ fact F1: -0.1gemini-3.6-flash − mimo-v2.6gemini-3.6-flash − mimo-v2.6-flash · Δ fact F1: 0baseline:constraint-solver −baseline:constraint-solver − baseline:forward-chain · Δ fact F1: 0.2deepseek-v4-pro − gemini-3.7deepseek-v4-pro − gemini-3.7-flash · Δ fact F1: 0.2gemini-3.7-flash − gpt-5.6-sgemini-3.7-flash − gpt-5.6-sol · Δ fact F1: 0.3gpt-5.6-terra − gpt-6-lunagpt-5.6-terra − gpt-6-luna · Δ fact F1: 0.3gpt-5.6-sol − kimi-k2.6gpt-5.6-sol − kimi-k2.6 · Δ fact F1: 0.4claude-fable-5.1 − gpt-6-solclaude-fable-5.1 − gpt-6-sol · Δ fact F1: 0.5deepseek-v4-pro − gpt-5.6-sodeepseek-v4-pro − gpt-5.6-sol · Δ fact F1: 0.5claude-sonnet-5 − gemini-3.8claude-sonnet-5 − gemini-3.8-flash · Δ fact F1: 0.7gemini-3.7-flash − kimi-k2.6gemini-3.7-flash − kimi-k2.6 · Δ fact F1: 0.7claude-haiku-4.5 − glm-5.3-fclaude-haiku-4.5 − glm-5.3-flash · Δ fact F1: 0.9deepseek-v4-pro − kimi-k2.6deepseek-v4-pro − kimi-k2.6 · Δ fact F1: 0.9baseline:forward-chain − gptbaseline:forward-chain − gpt-6-astra · Δ fact F1: 1.1baseline:constraint-solver −baseline:constraint-solver − gpt-6-astra · Δ fact F1: 1.2glm-5.3 − qwen3.8-27bglm-5.3 − qwen3.8-27b · Δ fact F1: 1.2gemini-3.8-flash − glm-5.3gemini-3.8-flash − glm-5.3 · Δ fact F1: 1.3gpt-5.6-sol − grok-4.6gpt-5.6-sol − grok-4.6 · Δ fact F1: 1.5baseline:constraint-solver −baseline:constraint-solver − claude-fable-5.1 · Δ fact F1: 1.8baseline:forward-chain − clabaseline:forward-chain − claude-fable-5.1 · Δ fact F1: 1.8claude-fable-5 − claude-opusclaude-fable-5 − claude-opus-5.5 · Δ fact F1: 1.8claude-opus-5.5 − deepseek-vclaude-opus-5.5 − deepseek-v4-pro · Δ fact F1: 1.8gemini-3.7-flash − grok-4.6gemini-3.7-flash − grok-4.6 · Δ fact F1: 1.8claude-opus-5.5 − gemini-3.7claude-opus-5.5 − gemini-3.7-flash · Δ fact F1: 1.9deepseek-v4-pro − grok-4.6deepseek-v4-pro − grok-4.6 · Δ fact F1: 2gpt-5.6-luna − mimo-v2.6-flagpt-5.6-luna − mimo-v2.6-flash · Δ fact F1: 2gpt-6-astra − gpt-6-solgpt-6-astra − gpt-6-sol · Δ fact F1: 2gpt-6-luna − mimo-v2.6-flashgpt-6-luna − mimo-v2.6-flash · Δ fact F1: 2claude-opus-5 − gpt-5.6-terrclaude-opus-5 − gpt-5.6-terra · Δ fact F1: 2.1claude-opus-5.5 − gpt-5.6-soclaude-opus-5.5 − gpt-5.6-sol · Δ fact F1: 2.1gpt-5.6-terra − mimo-v2.6-flgpt-5.6-terra − mimo-v2.6-flash · Δ fact F1: 2.3claude-opus-5 − gpt-5.6-lunaclaude-opus-5 − gpt-5.6-luna · Δ fact F1: 2.4claude-haiku-4.5 − glm-4.7-fclaude-haiku-4.5 − glm-4.7-flash · Δ fact F1: 2.6claude-sonnet-5 − kimi-k3claude-sonnet-5 − kimi-k3 · Δ fact F1: 2.6kimi-k3 − mimo-v2.6-flashkimi-k3 − mimo-v2.6-flash · Δ fact F1: 2.6claude-opus-5.5 − kimi-k2.6claude-opus-5.5 − kimi-k2.6 · Δ fact F1: 2.7claude-fable-5 − deepseek-v4claude-fable-5 − deepseek-v4-pro · Δ fact F1: 2.8deepseek-4.1-flash − mimo-v2deepseek-4.1-flash − mimo-v2.6-pro · Δ fact F1: 2.8gemini-3.6-flash − mimo-v2.6gemini-3.6-flash − mimo-v2.6-pro · Δ fact F1: 2.9gemini-3.8-flash − qwen3.8-2gemini-3.8-flash − qwen3.8-27b · Δ fact F1: 2.9mimo-v2.6-flash − mimo-v2.6-mimo-v2.6-flash − mimo-v2.6-pro · Δ fact F1: 2.9baseline:forward-chain − gptbaseline:forward-chain − gpt-6-sol · Δ fact F1: 3.2baseline:constraint-solver −baseline:constraint-solver − gpt-6-sol · Δ fact F1: 3.4claude-fable-5 − gemini-3.7-claude-fable-5 − gemini-3.7-flash · Δ fact F1: 3.4glm-5.3 − gpt-5.6-terraglm-5.3 − gpt-5.6-terra · Δ fact F1: 3.4glm-5.3 − gpt-5.6-lunaglm-5.3 − gpt-5.6-luna · Δ fact F1: 3.5glm-5.3 − gpt-6-lunaglm-5.3 − gpt-6-luna · Δ fact F1: 3.5claude-opus-5 − gpt-6-lunaclaude-opus-5 − gpt-6-luna · Δ fact F1: 3.6claude-fable-5 − gpt-5.6-solclaude-fable-5 − gpt-5.6-sol · Δ fact F1: 3.7claude-fable-5 − kimi-k2.6claude-fable-5 − kimi-k2.6 · Δ fact F1: 3.7claude-sonnet-5 − glm-5.3claude-sonnet-5 − glm-5.3 · Δ fact F1: 3.7claude-opus-5.5 − grok-4.6claude-opus-5.5 − grok-4.6 · Δ fact F1: 3.8claude-opus-5.5 − claude-sonclaude-opus-5.5 − claude-sonnet-5 · Δ fact F1: 3.9claude-sonnet-5 − gpt-5.6-luclaude-sonnet-5 − gpt-5.6-luna · Δ fact F1: 3.9kimi-k3 − mimo-v2.6-prokimi-k3 − mimo-v2.6-pro · Δ fact F1: 3.9claude-sonnet-5 − gpt-5.6-teclaude-sonnet-5 − gpt-5.6-terra · Δ fact F1: 4glm-5.3 − kimi-k3glm-5.3 − kimi-k3 · Δ fact F1: 4claude-opus-5 − mimo-v2.6-flclaude-opus-5 − mimo-v2.6-flash · Δ fact F1: 4.3gemini-3.8-flash − kimi-k3gemini-3.8-flash − kimi-k3 · Δ fact F1: 4.3baseline:forward-chain − clabaseline:forward-chain − claude-fable-5 · Δ fact F1: 4.4baseline:constraint-solver −baseline:constraint-solver − claude-fable-5 · Δ fact F1: 4.5claude-sonnet-5 − qwen3.8-27claude-sonnet-5 − qwen3.8-27b · Δ fact F1: 4.6claude-fable-5.1 − claude-opclaude-fable-5.1 − claude-opus-5.5 · Δ fact F1: 4.7gemini-3.8-flash − gpt-5.6-tgemini-3.8-flash − gpt-5.6-terra · Δ fact F1: 4.7gemini-3.7-flash − gemini-3.gemini-3.7-flash − gemini-3.8-flash · Δ fact F1: 4.8gpt-5.6-luna − mimo-v2.6-progpt-5.6-luna − mimo-v2.6-pro · Δ fact F1: 4.8gpt-6-luna − mimo-v2.6-progpt-6-luna − mimo-v2.6-pro · Δ fact F1: 4.9claude-sonnet-5 − deepseek-4claude-sonnet-5 − deepseek-4.1-flash · Δ fact F1: 5deepseek-v4-pro − gemini-3.8deepseek-v4-pro − gemini-3.8-flash · Δ fact F1: 5gemini-3.8-flash − gpt-6-lungemini-3.8-flash − gpt-6-luna · Δ fact F1: 5claude-fable-5 − grok-4.6claude-fable-5 − grok-4.6 · Δ fact F1: 5.1gemini-3.8-flash − gpt-5.6-lgemini-3.8-flash − gpt-5.6-luna · Δ fact F1: 5.1grok-4.6 − kimi-k3grok-4.6 − kimi-k3 · Δ fact F1: 5.1baseline:direct-facts − minibaseline:direct-facts − minimax-m3 · Δ fact F1: 5.2gpt-5.6-terra − mimo-v2.6-prgpt-5.6-terra − mimo-v2.6-pro · Δ fact F1: 5.2claude-fable-5 − claude-sonnclaude-fable-5 − claude-sonnet-5 · Δ fact F1: 5.4claude-opus-5 − deepseek-4.1claude-opus-5 − deepseek-4.1-flash · Δ fact F1: 5.4claude-sonnet-5 − gpt-6-lunaclaude-sonnet-5 − gpt-6-luna · Δ fact F1: 5.5baseline:direct-facts − claubaseline:direct-facts − claude-haiku-4.5 · Δ fact F1: 5.6glm-5.3 − mimo-v2.6-flashglm-5.3 − mimo-v2.6-flash · Δ fact F1: 5.8grok-4.6 − qwen3.8-27bgrok-4.6 − qwen3.8-27b · Δ fact F1: 5.8gemini-3.7-flash − glm-5.3gemini-3.7-flash − glm-5.3 · Δ fact F1: 6.1gpt-6-sol − kimi-k2.6gpt-6-sol − kimi-k2.6 · Δ fact F1: 6.1kimi-k2.6 − kimi-k3kimi-k2.6 − kimi-k3 · Δ fact F1: 6.2claude-opus-5 − gemini-3.6-fclaude-opus-5 − gemini-3.6-flash · Δ fact F1: 6.3deepseek-v4-pro − glm-5.3deepseek-v4-pro − glm-5.3 · Δ fact F1: 6.4baseline:direct-facts − glm-baseline:direct-facts − glm-5.3-flash · Δ fact F1: 6.6baseline:forward-chain − clabaseline:forward-chain − claude-opus-5.5 · Δ fact F1: 6.6claude-opus-5.5 − gemini-3.8claude-opus-5.5 − gemini-3.8-flash · Δ fact F1: 6.6baseline:constraint-solver −baseline:constraint-solver − claude-opus-5.5 · Δ fact F1: 6.7baseline:direct-facts − glm-baseline:direct-facts − glm-4.7-flash · Δ fact F1: 6.9claude-fable-5 − gemini-3.8-claude-fable-5 − gemini-3.8-flash · Δ fact F1: 6.9deepseek-v4-pro − kimi-k3deepseek-v4-pro − kimi-k3 · Δ fact F1: 6.9gemini-3.8-flash − mimo-v2.6gemini-3.8-flash − mimo-v2.6-flash · Δ fact F1: 7kimi-k2.6 − qwen3.8-27bkimi-k2.6 − qwen3.8-27b · Δ fact F1: 7gpt-6-sol − grok-4.6gpt-6-sol − grok-4.6 · Δ fact F1: 7.2gpt-5.6-sol − qwen3.8-27bgpt-5.6-sol − qwen3.8-27b · Δ fact F1: 7.4gpt-5.6-sol − kimi-k3gpt-5.6-sol − kimi-k3 · Δ fact F1: 7.6gemini-3.7-flash − qwen3.8-2gemini-3.7-flash − qwen3.8-27b · Δ fact F1: 7.7claude-sonnet-5 − mimo-v2.6-claude-sonnet-5 − mimo-v2.6-flash · Δ fact F1: 7.8deepseek-v4-pro − qwen3.8-27deepseek-v4-pro − qwen3.8-27b · Δ fact F1: 7.8claude-opus-5 − mimo-v2.6-prclaude-opus-5 − mimo-v2.6-pro · Δ fact F1: 7.9claude-opus-5.5 − glm-5.3claude-opus-5.5 − glm-5.3 · Δ fact F1: 7.9claude-sonnet-5 − gemini-3.6claude-sonnet-5 − gemini-3.6-flash · Δ fact F1: 7.9glm-5.3 − mimo-v2.6-proglm-5.3 − mimo-v2.6-pro · Δ fact F1: 7.9gpt-6-astra − kimi-k2.6gpt-6-astra − kimi-k2.6 · Δ fact F1: 7.9mimo-v2.6-pro − minimax-m3mimo-v2.6-pro − minimax-m3 · Δ fact F1: 8.1claude-opus-5.5 − kimi-k3claude-opus-5.5 − kimi-k3 · Δ fact F1: 8.3gemini-3.7-flash − kimi-k3gemini-3.7-flash − kimi-k3 · Δ fact F1: 8.3baseline:forward-chain − deebaseline:forward-chain − deepseek-v4-pro · Δ fact F1: 8.4baseline:constraint-solver −baseline:constraint-solver − deepseek-v4-pro · Δ fact F1: 8.5baseline:forward-chain − gembaseline:forward-chain − gemini-3.7-flash · Δ fact F1: 8.5baseline:constraint-solver −baseline:constraint-solver − gemini-3.7-flash · Δ fact F1: 8.7baseline:forward-chain − gptbaseline:forward-chain − gpt-5.6-sol · Δ fact F1: 8.8gpt-6-astra − grok-4.6gpt-6-astra − grok-4.6 · Δ fact F1: 8.8baseline:constraint-solver −baseline:constraint-solver − gpt-5.6-sol · Δ fact F1: 9baseline:forward-chain − kimbaseline:forward-chain − kimi-k2.6 · Δ fact F1: 9.3gpt-5.6-sol − gpt-5.6-terragpt-5.6-sol − gpt-5.6-terra · Δ fact F1: 9.3baseline:constraint-solver −baseline:constraint-solver − kimi-k2.6 · Δ fact F1: 9.4claude-opus-5.5 − qwen3.8-27claude-opus-5.5 − qwen3.8-27b · Δ fact F1: 9.5gpt-5.6-sol − gpt-6-lunagpt-5.6-sol − gpt-6-luna · Δ fact F1: 9.5baseline:forward-chain − clabaseline:forward-chain − claude-sonnet-5 · Δ fact F1: 9.6gemini-3.7-flash − gpt-5.6-tgemini-3.7-flash − gpt-5.6-terra · Δ fact F1: 9.6deepseek-v4-pro − gpt-5.6-tedeepseek-v4-pro − gpt-5.6-terra · Δ fact F1: 9.7baseline:constraint-solver −baseline:constraint-solver − claude-sonnet-5 · Δ fact F1: 9.8gemini-3.7-flash − gpt-6-lungemini-3.7-flash − gpt-6-luna · Δ fact F1: 9.8claude-sonnet-5 − mimo-v2.6-claude-sonnet-5 − mimo-v2.6-pro · Δ fact F1: 9.9gemini-3.7-flash − gpt-5.6-lgemini-3.7-flash − gpt-5.6-luna · Δ fact F1: 9.9deepseek-v4-pro − gpt-6-lunadeepseek-v4-pro − gpt-6-luna · Δ fact F1: 10gemini-3.8-flash − mimo-v2.6gemini-3.8-flash − mimo-v2.6-pro · Δ fact F1: 10claude-fable-5 − kimi-k3claude-fable-5 − kimi-k3 · Δ fact F1: 10.1claude-fable-5 − qwen3.8-27bclaude-fable-5 − qwen3.8-27b · Δ fact F1: 10.1deepseek-v4-pro − gpt-5.6-ludeepseek-v4-pro − gpt-5.6-luna · Δ fact F1: 10.1claude-fable-5 − glm-5.3claude-fable-5 − glm-5.3 · Δ fact F1: 10.2grok-4.6 − mimo-v2.6-flashgrok-4.6 − mimo-v2.6-flash · Δ fact F1: 10.3baseline:forward-chain − grobaseline:forward-chain − grok-4.6 · Δ fact F1: 10.4baseline:constraint-solver −baseline:constraint-solver − grok-4.6 · Δ fact F1: 10.5mimo-v2.6-flash − minimax-m3mimo-v2.6-flash − minimax-m3 · Δ fact F1: 10.9gemini-3.6-flash − minimax-mgemini-3.6-flash − minimax-m3 · Δ fact F1: 11deepseek-4.1-flash − minimaxdeepseek-4.1-flash − minimax-m3 · Δ fact F1: 11.1claude-fable-5 − gpt-5.6-lunclaude-fable-5 − gpt-5.6-luna · Δ fact F1: 11.2claude-fable-5.1 − grok-4.6claude-fable-5.1 − grok-4.6 · Δ fact F1: 11.3gpt-6-sol − kimi-k3gpt-6-sol − kimi-k3 · Δ fact F1: 11.3kimi-k2.6 − mimo-v2.6-flashkimi-k2.6 − mimo-v2.6-flash · Δ fact F1: 11.3claude-opus-5.5 − gpt-5.6-teclaude-opus-5.5 − gpt-5.6-terra · Δ fact F1: 11.6gpt-5.6-sol − mimo-v2.6-flasgpt-5.6-sol − mimo-v2.6-flash · Δ fact F1: 11.6claude-opus-5.5 − gpt-5.6-luclaude-opus-5.5 − gpt-5.6-luna · Δ fact F1: 11.7claude-opus-5.5 − gpt-6-lunaclaude-opus-5.5 − gpt-6-luna · Δ fact F1: 11.7gemini-3.7-flash − mimo-v2.6gemini-3.7-flash − mimo-v2.6-flash · Δ fact F1: 11.9claude-fable-5 − claude-opusclaude-fable-5 − claude-opus-5 · Δ fact F1: 12claude-fable-5 − deepseek-4.claude-fable-5 − deepseek-4.1-flash · Δ fact F1: 12claude-fable-5 − gpt-6-lunaclaude-fable-5 − gpt-6-luna · Δ fact F1: 12deepseek-4.1-flash − glm-5.3deepseek-4.1-flash − glm-5.3-flash · Δ fact F1: 12deepseek-v4-pro − gemini-3.6deepseek-v4-pro − gemini-3.6-flash · Δ fact F1: 12deepseek-v4-pro − mimo-v2.6-deepseek-v4-pro − mimo-v2.6-flash · Δ fact F1: 12.1claude-fable-5 − gpt-5.6-terclaude-fable-5 − gpt-5.6-terra · Δ fact F1: 12.2gemini-3.6-flash − glm-5.3-fgemini-3.6-flash − glm-5.3-flash · Δ fact F1: 12.2deepseek-4.1-flash − glm-4.7deepseek-4.1-flash − glm-4.7-flash · Δ fact F1: 12.3kimi-k3 − minimax-m3kimi-k3 − minimax-m3 · Δ fact F1: 12.6gpt-5.6-luna − minimax-m3gpt-5.6-luna − minimax-m3 · Δ fact F1: 12.9grok-4.6 − mimo-v2.6-progrok-4.6 − mimo-v2.6-pro · Δ fact F1: 12.9gpt-6-luna − minimax-m3gpt-6-luna − minimax-m3 · Δ fact F1: 13gpt-6-sol − qwen3.8-27bgpt-6-sol − qwen3.8-27b · Δ fact F1: 13baseline:forward-chain − gembaseline:forward-chain − gemini-3.8-flash · Δ fact F1: 13.3gemini-3.6-flash − glm-4.7-fgemini-3.6-flash − glm-4.7-flash · Δ fact F1: 13.3gpt-5.6-terra − minimax-m3gpt-5.6-terra − minimax-m3 · Δ fact F1: 13.3gpt-6-astra − kimi-k3gpt-6-astra − kimi-k3 · Δ fact F1: 13.4baseline:constraint-solver −baseline:constraint-solver − gemini-3.8-flash · Δ fact F1: 13.5claude-opus-5.5 − deepseek-4claude-opus-5.5 − deepseek-4.1-flash · Δ fact F1: 13.8claude-opus-5.5 − gemini-3.6claude-opus-5.5 − gemini-3.6-flash · Δ fact F1: 13.8gpt-6-astra − qwen3.8-27bgpt-6-astra − qwen3.8-27b · Δ fact F1: 13.8claude-fable-5 − gemini-3.6-claude-fable-5 − gemini-3.6-flash · Δ fact F1: 14kimi-k2.6 − mimo-v2.6-prokimi-k2.6 − mimo-v2.6-pro · Δ fact F1: 14claude-opus-5.5 − mimo-v2.6-claude-opus-5.5 − mimo-v2.6-flash · Δ fact F1: 14.1claude-fable-5 − mimo-v2.6-fclaude-fable-5 − mimo-v2.6-flash · Δ fact F1: 14.2claude-fable-5.1 − gpt-5.6-sclaude-fable-5.1 − gpt-5.6-sol · Δ fact F1: 14.3gpt-5.6-sol − mimo-v2.6-progpt-5.6-sol − mimo-v2.6-pro · Δ fact F1: 14.4baseline:forward-chain − glmbaseline:forward-chain − glm-5.3 · Δ fact F1: 14.7gemini-3.7-flash − mimo-v2.6gemini-3.7-flash − mimo-v2.6-pro · Δ fact F1: 14.7baseline:constraint-solver −baseline:constraint-solver − glm-5.3 · Δ fact F1: 14.8baseline:forward-chain − kimbaseline:forward-chain − kimi-k3 · Δ fact F1: 14.8deepseek-v4-pro − mimo-v2.6-deepseek-v4-pro − mimo-v2.6-pro · Δ fact F1: 14.9baseline:constraint-solver −baseline:constraint-solver − kimi-k3 · Δ fact F1: 15baseline:forward-chain − qwebaseline:forward-chain − qwen3.8-27b · Δ fact F1: 16.2gpt-6-astra − gpt-6-lunagpt-6-astra − gpt-6-luna · Δ fact F1: 16.3baseline:constraint-solver −baseline:constraint-solver − qwen3.8-27b · Δ fact F1: 16.4claude-sonnet-5 − minimax-m3claude-sonnet-5 − minimax-m3 · Δ fact F1: 16.4claude-opus-5.5 − mimo-v2.6-claude-opus-5.5 − mimo-v2.6-pro · Δ fact F1: 16.5glm-5.3 − minimax-m3glm-5.3 − minimax-m3 · Δ fact F1: 16.6claude-fable-5 − mimo-v2.6-pclaude-fable-5 − mimo-v2.6-pro · Δ fact F1: 16.7glm-5.3 − glm-5.3-flashglm-5.3 − glm-5.3-flash · Δ fact F1: 17.3gpt-6-sol − mimo-v2.6-flashgpt-6-sol − mimo-v2.6-flash · Δ fact F1: 17.3baseline:forward-chain − gptbaseline:forward-chain − gpt-5.6-terra · Δ fact F1: 18.1gemini-3.8-flash − minimax-mgemini-3.8-flash − minimax-m3 · Δ fact F1: 18.1baseline:constraint-solver −baseline:constraint-solver − gpt-5.6-terra · Δ fact F1: 18.2claude-fable-5.1 − deepseek-claude-fable-5.1 − deepseek-v4-pro · Δ fact F1: 18.2gpt-6-astra − mimo-v2.6-flasgpt-6-astra − mimo-v2.6-flash · Δ fact F1: 18.2baseline:forward-chain − gptbaseline:forward-chain − gpt-6-luna · Δ fact F1: 18.4baseline:constraint-solver −baseline:constraint-solver − gpt-6-luna · Δ fact F1: 18.5baseline:forward-chain − gptbaseline:forward-chain − gpt-5.6-luna · Δ fact F1: 18.5claude-fable-5.1 − glm-5.3claude-fable-5.1 − glm-5.3 · Δ fact F1: 18.5claude-sonnet-5 − glm-5.3-flclaude-sonnet-5 − glm-5.3-flash · Δ fact F1: 18.5baseline:constraint-solver −baseline:constraint-solver − gpt-5.6-luna · Δ fact F1: 18.6baseline:forward-chain − clabaseline:forward-chain − claude-opus-5 · Δ fact F1: 18.8baseline:constraint-solver −baseline:constraint-solver − claude-opus-5 · Δ fact F1: 18.9claude-fable-5.1 − kimi-k2.6claude-fable-5.1 − kimi-k2.6 · Δ fact F1: 19.1claude-fable-5.1 − claude-soclaude-fable-5.1 − claude-sonnet-5 · Δ fact F1: 19.2gemini-3.8-flash − glm-5.3-fgemini-3.8-flash − glm-5.3-flash · Δ fact F1: 19.2claude-opus-5 − minimax-m3claude-opus-5 − minimax-m3 · Δ fact F1: 19.3claude-opus-5 − glm-4.7-flasclaude-opus-5 − glm-4.7-flash · Δ fact F1: 19.6gpt-6-sol − mimo-v2.6-progpt-6-sol − mimo-v2.6-pro · Δ fact F1: 20baseline:forward-chain − gembaseline:forward-chain − gemini-3.6-flash · Δ fact F1: 20.4baseline:constraint-solver −baseline:constraint-solver − gemini-3.6-flash · Δ fact F1: 20.5baseline:forward-chain − deebaseline:forward-chain − deepseek-4.1-flash · Δ fact F1: 20.5baseline:forward-chain − mimbaseline:forward-chain − mimo-v2.6-flash · Δ fact F1: 20.5claude-fable-5.1 − qwen3.8-2claude-fable-5.1 − qwen3.8-27b · Δ fact F1: 20.5gemini-3.8-flash − glm-4.7-fgemini-3.8-flash − glm-4.7-flash · Δ fact F1: 20.5gpt-6-astra − mimo-v2.6-progpt-6-astra − mimo-v2.6-pro · Δ fact F1: 20.5baseline:constraint-solver −baseline:constraint-solver − deepseek-4.1-flash · Δ fact F1: 20.6baseline:constraint-solver −baseline:constraint-solver − mimo-v2.6-flash · Δ fact F1: 20.7claude-fable-5.1 − gemini-3.claude-fable-5.1 − gemini-3.7-flash · Δ fact F1: 20.7claude-opus-5 − glm-5.3-flasclaude-opus-5 − glm-5.3-flash · Δ fact F1: 20.9grok-4.6 − minimax-m3grok-4.6 − minimax-m3 · Δ fact F1: 21kimi-k2.6 − minimax-m3kimi-k2.6 − minimax-m3 · Δ fact F1: 22.1gpt-5.6-sol − minimax-m3gpt-5.6-sol − minimax-m3 · Δ fact F1: 22.6claude-sonnet-5 − glm-4.7-flclaude-sonnet-5 − glm-4.7-flash · Δ fact F1: 22.8gemini-3.7-flash − minimax-mgemini-3.7-flash − minimax-m3 · Δ fact F1: 22.9deepseek-v4-pro − minimax-m3deepseek-v4-pro − minimax-m3 · Δ fact F1: 23baseline:forward-chain − mimbaseline:forward-chain − mimo-v2.6-pro · Δ fact F1: 23.2baseline:constraint-solver −baseline:constraint-solver − mimo-v2.6-pro · Δ fact F1: 23.4claude-fable-5.1 − gpt-5.6-lclaude-fable-5.1 − gpt-5.6-luna · Δ fact F1: 23.7gemini-3.7-flash − glm-5.3-fgemini-3.7-flash − glm-5.3-flash · Δ fact F1: 24.1deepseek-v4-pro − glm-5.3-fldeepseek-v4-pro − glm-5.3-flash · Δ fact F1: 24.3deepseek-v4-pro − glm-4.7-fldeepseek-v4-pro − glm-4.7-flash · Δ fact F1: 24.5claude-fable-5 − minimax-m3claude-fable-5 − minimax-m3 · Δ fact F1: 24.6claude-opus-5.5 − minimax-m3claude-opus-5.5 − minimax-m3 · Δ fact F1: 24.7gemini-3.7-flash − glm-4.7-fgemini-3.7-flash − glm-4.7-flash · Δ fact F1: 24.9claude-fable-5 − claude-haikclaude-fable-5 − claude-haiku-4.5 · Δ fact F1: 25.5claude-fable-5 − glm-5.3-flaclaude-fable-5 − glm-5.3-flash · Δ fact F1: 25.7claude-opus-5.5 − glm-5.3-flclaude-opus-5.5 − glm-5.3-flash · Δ fact F1: 26claude-opus-5.5 − glm-4.7-flclaude-opus-5.5 − glm-4.7-flash · Δ fact F1: 26.1baseline:constraint-solver −baseline:constraint-solver − baseline:direct-facts · Δ fact F1: 26.3claude-fable-5 − glm-4.7-flaclaude-fable-5 − glm-4.7-flash · Δ fact F1: 26.6claude-fable-5.1 − mimo-v2.6claude-fable-5.1 − mimo-v2.6-flash · Δ fact F1: 27.4gpt-6-astra − minimax-m3gpt-6-astra − minimax-m3 · Δ fact F1: 28.2gpt-6-sol − minimax-m3gpt-6-sol − minimax-m3 · Δ fact F1: 28.2claude-fable-5.1 − gpt-6-lunclaude-fable-5.1 − gpt-6-luna · Δ fact F1: 29.8claude-fable-5.1 − glm-4.7-fclaude-fable-5.1 − glm-4.7-flash · Δ fact F1: 31.1baseline:forward-chain − minbaseline:forward-chain − minimax-m3 · Δ fact F1: 31.4baseline:constraint-solver −baseline:constraint-solver − minimax-m3 · Δ fact F1: 31.5baseline:forward-chain − clabaseline:forward-chain − claude-haiku-4.5 · Δ fact F1: 31.8baseline:constraint-solver −baseline:constraint-solver − claude-haiku-4.5 · Δ fact F1: 32baseline:forward-chain − glmbaseline:forward-chain − glm-5.3-flash · Δ fact F1: 32.7baseline:forward-chain − glmbaseline:forward-chain − glm-4.7-flash · Δ fact F1: 32.8baseline:constraint-solver −baseline:constraint-solver − glm-4.7-flash · Δ fact F1: 32.9baseline:constraint-solver −baseline:constraint-solver − glm-5.3-flash · Δ fact F1: 32.9claude-fable-5.1 − glm-5.3-fclaude-fable-5.1 − glm-5.3-flash · Δ fact F1: 33.5claude-fable-5.1 − gemini-3.claude-fable-5.1 − gemini-3.6-flash · Δ fact F1: 34.8claude-fable-5.1 − gemini-3.claude-fable-5.1 − gemini-3.8-flash · Δ fact F1: 36claude-fable-5.1 − claude-opclaude-fable-5.1 − claude-opus-5 · Δ fact F1: 38.7claude-fable-5.1 − claude-haclaude-fable-5.1 − claude-haiku-4.5 · Δ fact F1: 39.4claude-fable-5.1 − gpt-5.6-tclaude-fable-5.1 − gpt-5.6-terra · Δ fact F1: 39.8claude-fable-5.1 − minimax-mclaude-fable-5.1 − minimax-m3 · Δ fact F1: 40claude-fable-5.1 − kimi-k3claude-fable-5.1 − kimi-k3 · Δ fact F1: 40.3claude-fable-5.1 − mimo-v2.6claude-fable-5.1 − mimo-v2.6-pro · Δ fact F1: 43.5claude-fable-5.1 − deepseek-claude-fable-5.1 − deepseek-4.1-flash · Δ fact F1: 46.1baseline:direct-facts − basebaseline:direct-facts − baseline:story-copy · Δ fact F1: 73.7baseline:forward-chain − basbaseline:forward-chain − baseline:story-copy · Δ fact F1: 99.8baseline:constraint-solver −baseline:constraint-solver − baseline:story-copy · Δ fact F1: 100Δ fact F1

Differences are left minus right, in percentage points. Complete scored pairs only; condition pairs require all configured realizations on both sides. Missing pairs are excluded.

{
  "caution": "Descriptive intervals, not multiplicity-adjusted; few families give unstable uncertainty estimates.",
  "confidence": 0.95,
  "method": "family-cluster percentile bootstrap",
  "resamples": 2000,
  "seed": 0,
  "strata_intervals": false
}
models
ProviderLeftRightMetricDifference (pp)95% CI (pp)Expected pairsComplete pairsMissing pairsFamilies
All providersbaseline:constraint-solverbaseline:direct-factsfact_f126.3%24.5% to 28.2%6006000120
All providersbaseline:constraint-solverbaseline:direct-factsexact_world99.2%97.5% to 100.0%6006000120
All providersbaseline:constraint-solverbaseline:direct-factstask_success99.2%97.5% to 100.0%6006000120
All providersbaseline:constraint-solverbaseline:direct-factsdecision_correct65.8%57.5% to 74.2%6006000120
All providersbaseline:constraint-solverbaseline:forward-chainfact_f10.2%0.0% to 0.4%6006000120
All providersbaseline:constraint-solverbaseline:forward-chainexact_world1.7%0.0% to 4.2%6006000120
All providersbaseline:constraint-solverbaseline:forward-chaintask_success1.7%0.0% to 4.2%6006000120
All providersbaseline:constraint-solverbaseline:forward-chaindecision_correct0.8%0.0% to 2.5%6006000120
All providersbaseline:constraint-solverbaseline:story-copyfact_f1100.0%100.0% to 100.0%6006000120
All providersbaseline:constraint-solverbaseline:story-copyexact_world100.0%100.0% to 100.0%6006000120
All providersbaseline:constraint-solverbaseline:story-copytask_success100.0%100.0% to 100.0%6006000120
All providersbaseline:constraint-solverbaseline:story-copydecision_correct100.0%100.0% to 100.0%6006000120
All providersbaseline:constraint-solverclaude-fable-5fact_f14.5%3.6% to 5.5%600393207120
All providersbaseline:constraint-solverclaude-fable-5exact_world39.7%34.0% to 45.2%600393207120
All providersbaseline:constraint-solverclaude-fable-5task_success39.7%34.0% to 45.2%600393207120
All providersbaseline:constraint-solverclaude-fable-5decision_correct1.3%0.2% to 2.7%600393207120
All providersbaseline:constraint-solverclaude-fable-5.1fact_f11.8%0.3% to 3.5%6001458613
All providersbaseline:constraint-solverclaude-fable-5.1exact_world28.6%7.7% to 50.0%6001458613
All providersbaseline:constraint-solverclaude-fable-5.1task_success28.6%7.7% to 50.0%6001458613
All providersbaseline:constraint-solverclaude-fable-5.1decision_correct0.0%0.0% to 0.0%6001458613
All providersbaseline:constraint-solverclaude-haiku-4.5fact_f132.0%29.1% to 34.8%6006000120
All providersbaseline:constraint-solverclaude-haiku-4.5exact_world76.3%74.3% to 78.2%6006000120
All providersbaseline:constraint-solverclaude-haiku-4.5task_success76.3%74.3% to 78.2%6006000120
All providersbaseline:constraint-solverclaude-haiku-4.5decision_correct4.5%2.7% to 6.5%6006000120
All providersbaseline:constraint-solverclaude-opus-5fact_f118.9%15.7% to 22.1%600424176119
All providersbaseline:constraint-solverclaude-opus-5exact_world47.4%41.7% to 52.8%600424176119
All providersbaseline:constraint-solverclaude-opus-5task_success47.4%41.7% to 52.8%600424176119
All providersbaseline:constraint-solverclaude-opus-5decision_correct8.5%5.9% to 11.4%600424176119
All providersbaseline:constraint-solverclaude-opus-5.5fact_f16.7%5.9% to 7.6%6005919120
All providersbaseline:constraint-solverclaude-opus-5.5exact_world59.4%55.7% to 62.8%6005919120
All providersbaseline:constraint-solverclaude-opus-5.5task_success59.6%55.8% to 63.0%6005919120
All providersbaseline:constraint-solverclaude-opus-5.5decision_correct4.7%2.9% to 6.9%6005919120
All providersbaseline:constraint-solverclaude-sonnet-5fact_f19.8%7.6% to 11.9%600445155120
All providersbaseline:constraint-solverclaude-sonnet-5exact_world43.6%39.1% to 48.7%600445155120
All providersbaseline:constraint-solverclaude-sonnet-5task_success43.6%39.1% to 48.7%600445155120
All providersbaseline:constraint-solverclaude-sonnet-5decision_correct4.0%2.3% to 5.9%600445155120
All providersbaseline:constraint-solverdeepseek-4.1-flashfact_f120.6%18.3% to 22.9%6005955120
All providersbaseline:constraint-solverdeepseek-4.1-flashexact_world50.9%46.9% to 55.1%6005955120
All providersbaseline:constraint-solverdeepseek-4.1-flashtask_success50.9%46.9% to 55.1%6005955120
All providersbaseline:constraint-solverdeepseek-4.1-flashdecision_correct0.0%0.0% to 0.0%6005955120
All providersbaseline:constraint-solverdeepseek-v4-profact_f18.5%7.3% to 9.8%6006000120
All providersbaseline:constraint-solverdeepseek-v4-proexact_world57.3%53.2% to 61.2%6006000120
All providersbaseline:constraint-solverdeepseek-v4-protask_success57.3%53.2% to 61.2%6006000120
All providersbaseline:constraint-solverdeepseek-v4-prodecision_correct4.7%2.8% to 6.7%6006000120
All providersbaseline:constraint-solvergemini-3.6-flashfact_f120.5%17.9% to 23.2%6006000120
All providersbaseline:constraint-solvergemini-3.6-flashexact_world56.3%52.2% to 60.7%6006000120
All providersbaseline:constraint-solvergemini-3.6-flashtask_success56.3%52.2% to 60.7%6006000120
All providersbaseline:constraint-solvergemini-3.6-flashdecision_correct1.0%0.2% to 2.2%6006000120
All providersbaseline:constraint-solvergemini-3.7-flashfact_f18.7%7.0% to 10.5%6006000120
All providersbaseline:constraint-solvergemini-3.7-flashexact_world31.3%27.2% to 35.2%6006000120
All providersbaseline:constraint-solvergemini-3.7-flashtask_success31.3%27.2% to 35.2%6006000120
All providersbaseline:constraint-solvergemini-3.7-flashdecision_correct0.5%0.0% to 1.3%6006000120
All providersbaseline:constraint-solvergemini-3.8-flashfact_f113.5%11.3% to 15.6%6005982120
All providersbaseline:constraint-solvergemini-3.8-flashexact_world40.8%36.4% to 45.0%6005982120
All providersbaseline:constraint-solvergemini-3.8-flashtask_success40.8%36.4% to 45.0%6005982120
All providersbaseline:constraint-solvergemini-3.8-flashdecision_correct0.3%0.0% to 0.8%6005982120
All providersbaseline:constraint-solverglm-4.7-flashfact_f132.9%30.1% to 35.6%60056634120
All providersbaseline:constraint-solverglm-4.7-flashexact_world79.3%77.0% to 81.5%60056634120
All providersbaseline:constraint-solverglm-4.7-flashtask_success79.3%77.0% to 81.5%60056634120
All providersbaseline:constraint-solverglm-4.7-flashdecision_correct17.5%14.2% to 20.9%60056634120
All providersbaseline:constraint-solverglm-5.3fact_f114.8%11.9% to 17.8%60056436120
All providersbaseline:constraint-solverglm-5.3exact_world43.3%38.5% to 47.8%60056436120
All providersbaseline:constraint-solverglm-5.3task_success43.4%38.6% to 47.9%60056436120
All providersbaseline:constraint-solverglm-5.3decision_correct3.7%2.3% to 5.4%60056436120
All providersbaseline:constraint-solverglm-5.3-flashfact_f132.9%29.5% to 36.1%6005964120
All providersbaseline:constraint-solverglm-5.3-flashexact_world73.8%70.6% to 76.8%6005964120
All providersbaseline:constraint-solverglm-5.3-flashtask_success74.0%70.7% to 77.0%6005964120
All providersbaseline:constraint-solverglm-5.3-flashdecision_correct1.7%0.8% to 2.7%6005964120
All providersbaseline:constraint-solvergpt-5.6-lunafact_f118.6%16.6% to 20.6%6006000120
All providersbaseline:constraint-solvergpt-5.6-lunaexact_world57.3%54.0% to 60.7%6006000120
All providersbaseline:constraint-solvergpt-5.6-lunatask_success58.3%55.0% to 61.7%6006000120
All providersbaseline:constraint-solvergpt-5.6-lunadecision_correct2.8%1.5% to 4.3%6006000120
All providersbaseline:constraint-solvergpt-5.6-solfact_f19.0%7.2% to 10.7%6006000120
All providersbaseline:constraint-solvergpt-5.6-solexact_world31.5%27.2% to 36.2%6006000120
All providersbaseline:constraint-solvergpt-5.6-soltask_success31.5%27.2% to 36.2%6006000120
All providersbaseline:constraint-solvergpt-5.6-soldecision_correct0.0%0.0% to 0.0%6006000120
All providersbaseline:constraint-solvergpt-5.6-terrafact_f118.2%16.2% to 20.3%6006000120
All providersbaseline:constraint-solvergpt-5.6-terraexact_world49.3%45.7% to 53.0%6006000120
All providersbaseline:constraint-solvergpt-5.6-terratask_success49.3%45.7% to 53.0%6006000120
All providersbaseline:constraint-solvergpt-5.6-terradecision_correct0.2%0.0% to 0.5%6006000120
All providersbaseline:constraint-solvergpt-6-astrafact_f11.2%0.8% to 1.7%60055050115
All providersbaseline:constraint-solvergpt-6-astraexact_world12.4%8.7% to 16.5%60055050115
All providersbaseline:constraint-solvergpt-6-astratask_success12.4%8.7% to 16.5%60055050115
All providersbaseline:constraint-solvergpt-6-astradecision_correct0.0%0.0% to 0.0%60055050115
All providersbaseline:constraint-solvergpt-6-lunafact_f118.5%16.3% to 20.8%6006000120
All providersbaseline:constraint-solvergpt-6-lunaexact_world57.5%53.7% to 61.0%6006000120
All providersbaseline:constraint-solvergpt-6-lunatask_success57.7%54.0% to 61.2%6006000120
All providersbaseline:constraint-solvergpt-6-lunadecision_correct1.7%0.7% to 2.7%6006000120
All providersbaseline:constraint-solvergpt-6-solfact_f13.4%2.6% to 4.2%6006000120
All providersbaseline:constraint-solvergpt-6-solexact_world25.7%21.5% to 29.8%6006000120
All providersbaseline:constraint-solvergpt-6-soltask_success25.8%21.7% to 30.0%6006000120
All providersbaseline:constraint-solvergpt-6-soldecision_correct1.5%0.7% to 2.5%6006000120
All providersbaseline:constraint-solvergrok-4.6fact_f110.5%9.3% to 11.7%6006000120
All providersbaseline:constraint-solvergrok-4.6exact_world63.0%59.2% to 66.5%6006000120
All providersbaseline:constraint-solvergrok-4.6task_success63.0%59.2% to 66.5%6006000120
All providersbaseline:constraint-solvergrok-4.6decision_correct3.3%1.3% to 5.5%6006000120
All providersbaseline:constraint-solverkimi-k2.6fact_f19.4%8.3% to 10.7%6005991120
All providersbaseline:constraint-solverkimi-k2.6exact_world63.4%59.9% to 66.9%6005991120
All providersbaseline:constraint-solverkimi-k2.6task_success63.4%59.9% to 66.9%6005991120
All providersbaseline:constraint-solverkimi-k2.6decision_correct2.2%1.0% to 3.5%6005991120
All providersbaseline:constraint-solverkimi-k3fact_f115.0%12.2% to 17.9%60044315796
All providersbaseline:constraint-solverkimi-k3exact_world57.8%53.0% to 62.4%60044315796
All providersbaseline:constraint-solverkimi-k3task_success57.8%53.0% to 62.4%60044315796
All providersbaseline:constraint-solverkimi-k3decision_correct0.2%0.0% to 0.7%60044315796
All providersbaseline:constraint-solvermimo-v2.6-flashfact_f120.7%18.3% to 22.9%6005946120
All providersbaseline:constraint-solvermimo-v2.6-flashexact_world59.1%55.6% to 62.3%6005946120
All providersbaseline:constraint-solvermimo-v2.6-flashtask_success60.8%57.2% to 64.0%6005946120
All providersbaseline:constraint-solvermimo-v2.6-flashdecision_correct10.1%7.5% to 12.9%6005946120
All providersbaseline:constraint-solvermimo-v2.6-profact_f123.4%20.9% to 26.0%6006000120
All providersbaseline:constraint-solvermimo-v2.6-proexact_world60.8%57.3% to 64.3%6006000120
All providersbaseline:constraint-solvermimo-v2.6-protask_success62.0%58.5% to 65.7%6006000120
All providersbaseline:constraint-solvermimo-v2.6-prodecision_correct11.5%8.8% to 14.3%6006000120
All providersbaseline:constraint-solverminimax-m3fact_f131.5%28.3% to 34.7%6006000120
All providersbaseline:constraint-solverminimax-m3exact_world66.2%62.8% to 69.3%6006000120
All providersbaseline:constraint-solverminimax-m3task_success66.2%62.8% to 69.3%6006000120
All providersbaseline:constraint-solverminimax-m3decision_correct3.3%1.8% to 5.0%6006000120
All providersbaseline:constraint-solverqwen3.8-27bfact_f116.4%14.3% to 18.7%6006000120
All providersbaseline:constraint-solverqwen3.8-27bexact_world66.3%62.5% to 69.8%6006000120
All providersbaseline:constraint-solverqwen3.8-27btask_success66.3%62.5% to 69.8%6006000120
All providersbaseline:constraint-solverqwen3.8-27bdecision_correct3.0%1.5% to 4.8%6006000120
All providersbaseline:direct-factsbaseline:forward-chainfact_f1-26.2%-28.0% to -24.3%6006000120
All providersbaseline:direct-factsbaseline:forward-chainexact_world-97.5%-100.0% to -94.2%6006000120
All providersbaseline:direct-factsbaseline:forward-chaintask_success-97.5%-100.0% to -94.2%6006000120
All providersbaseline:direct-factsbaseline:forward-chaindecision_correct-65.0%-73.3% to -56.7%6006000120
All providersbaseline:direct-factsbaseline:story-copyfact_f173.7%71.8% to 75.5%6006000120
All providersbaseline:direct-factsbaseline:story-copyexact_world0.8%0.0% to 2.5%6006000120
All providersbaseline:direct-factsbaseline:story-copytask_success0.8%0.0% to 2.5%6006000120
All providersbaseline:direct-factsbaseline:story-copydecision_correct34.2%25.8% to 42.5%6006000120
All providersbaseline:direct-factsclaude-fable-5fact_f1-21.4%-23.6% to -19.2%600393207120
All providersbaseline:direct-factsclaude-fable-5exact_world-59.3%-65.2% to -53.2%600393207120
All providersbaseline:direct-factsclaude-fable-5task_success-59.3%-65.2% to -53.2%600393207120
All providersbaseline:direct-factsclaude-fable-5decision_correct-65.6%-74.9% to -56.1%600393207120
All providersbaseline:direct-factsclaude-fable-5.1fact_f1-27.0%-34.2% to -21.1%6001458613
All providersbaseline:direct-factsclaude-fable-5.1exact_world-71.4%-92.3% to -50.0%6001458613
All providersbaseline:direct-factsclaude-fable-5.1task_success-71.4%-92.3% to -50.0%6001458613
All providersbaseline:direct-factsclaude-fable-5.1decision_correct-64.3%-92.3% to -37.5%6001458613
All providersbaseline:direct-factsclaude-haiku-4.5fact_f15.6%2.8% to 8.3%6006000120
All providersbaseline:direct-factsclaude-haiku-4.5exact_world-22.8%-24.8% to -20.7%6006000120
All providersbaseline:direct-factsclaude-haiku-4.5task_success-22.8%-24.8% to -20.7%6006000120
All providersbaseline:direct-factsclaude-haiku-4.5decision_correct-61.3%-69.5% to -53.0%6006000120
All providersbaseline:direct-factsclaude-opus-5fact_f1-7.0%-10.4% to -3.9%600424176119
All providersbaseline:direct-factsclaude-opus-5exact_world-51.7%-57.3% to -46.1%600424176119
All providersbaseline:direct-factsclaude-opus-5task_success-51.7%-57.3% to -46.1%600424176119
All providersbaseline:direct-factsclaude-opus-5decision_correct-58.5%-67.5% to -49.4%600424176119
All providersbaseline:direct-factsclaude-opus-5.5fact_f1-19.5%-21.7% to -17.5%6005919120
All providersbaseline:direct-factsclaude-opus-5.5exact_world-39.8%-44.0% to -35.4%6005919120
All providersbaseline:direct-factsclaude-opus-5.5task_success-39.6%-43.8% to -35.3%6005919120
All providersbaseline:direct-factsclaude-opus-5.5decision_correct-60.9%-69.0% to -52.9%6005919120
All providersbaseline:direct-factsclaude-sonnet-5fact_f1-16.6%-19.4% to -13.9%600445155120
All providersbaseline:direct-factsclaude-sonnet-5exact_world-55.3%-60.3% to -49.7%600445155120
All providersbaseline:direct-factsclaude-sonnet-5task_success-55.3%-60.3% to -49.7%600445155120
All providersbaseline:direct-factsclaude-sonnet-5decision_correct-65.2%-74.0% to -56.8%600445155120
All providersbaseline:direct-factsdeepseek-4.1-flashfact_f1-5.6%-8.3% to -2.8%6005955120
All providersbaseline:direct-factsdeepseek-4.1-flashexact_world-48.2%-52.5% to -43.6%6005955120
All providersbaseline:direct-factsdeepseek-4.1-flashtask_success-48.2%-52.5% to -43.6%6005955120
All providersbaseline:direct-factsdeepseek-4.1-flashdecision_correct-65.5%-73.9% to -57.2%6005955120
All providersbaseline:direct-factsdeepseek-v4-profact_f1-17.8%-19.8% to -15.7%6006000120
All providersbaseline:direct-factsdeepseek-v4-proexact_world-41.8%-46.3% to -37.5%6006000120
All providersbaseline:direct-factsdeepseek-v4-protask_success-41.8%-46.3% to -37.5%6006000120
All providersbaseline:direct-factsdeepseek-v4-prodecision_correct-61.2%-69.2% to -52.8%6006000120
All providersbaseline:direct-factsgemini-3.6-flashfact_f1-5.8%-8.7% to -2.9%6006000120
All providersbaseline:direct-factsgemini-3.6-flashexact_world-42.8%-47.0% to -38.7%6006000120
All providersbaseline:direct-factsgemini-3.6-flashtask_success-42.8%-47.0% to -38.7%6006000120
All providersbaseline:direct-factsgemini-3.6-flashdecision_correct-64.8%-73.0% to -56.5%6006000120
All providersbaseline:direct-factsgemini-3.7-flashfact_f1-17.6%-19.9% to -15.5%6006000120
All providersbaseline:direct-factsgemini-3.7-flashexact_world-67.8%-72.2% to -63.8%6006000120
All providersbaseline:direct-factsgemini-3.7-flashtask_success-67.8%-72.2% to -63.8%6006000120
All providersbaseline:direct-factsgemini-3.7-flashdecision_correct-65.3%-73.5% to -57.2%6006000120
All providersbaseline:direct-factsgemini-3.8-flashfact_f1-12.8%-15.3% to -10.5%6005982120
All providersbaseline:direct-factsgemini-3.8-flashexact_world-58.4%-62.8% to -54.0%6005982120
All providersbaseline:direct-factsgemini-3.8-flashtask_success-58.4%-62.8% to -54.0%6005982120
All providersbaseline:direct-factsgemini-3.8-flashdecision_correct-65.4%-73.6% to -57.1%6005982120
All providersbaseline:direct-factsglm-4.7-flashfact_f16.9%3.7% to 10.0%60056634120
All providersbaseline:direct-factsglm-4.7-flashexact_world-19.8%-22.5% to -16.9%60056634120
All providersbaseline:direct-factsglm-4.7-flashtask_success-19.8%-22.5% to -16.9%60056634120
All providersbaseline:direct-factsglm-4.7-flashdecision_correct-46.5%-55.5% to -37.3%60056634120
All providersbaseline:direct-factsglm-5.3fact_f1-11.4%-14.7% to -8.1%60056436120
All providersbaseline:direct-factsglm-5.3exact_world-56.0%-61.1% to -51.4%60056436120
All providersbaseline:direct-factsglm-5.3task_success-55.9%-61.0% to -51.3%60056436120
All providersbaseline:direct-factsglm-5.3decision_correct-62.2%-70.7% to -53.7%60056436120
All providersbaseline:direct-factsglm-5.3-flashfact_f16.6%3.0% to 10.0%6005964120
All providersbaseline:direct-factsglm-5.3-flashexact_world-25.5%-29.1% to -22.1%6005964120
All providersbaseline:direct-factsglm-5.3-flashtask_success-25.3%-28.9% to -22.0%6005964120
All providersbaseline:direct-factsglm-5.3-flashdecision_correct-64.3%-72.7% to -55.8%6005964120
All providersbaseline:direct-factsgpt-5.6-lunafact_f1-7.7%-10.3% to -5.0%6006000120
All providersbaseline:direct-factsgpt-5.6-lunaexact_world-41.8%-45.7% to -38.0%6006000120
All providersbaseline:direct-factsgpt-5.6-lunatask_success-40.8%-44.7% to -37.0%6006000120
All providersbaseline:direct-factsgpt-5.6-lunadecision_correct-63.0%-71.2% to -54.7%6006000120
All providersbaseline:direct-factsgpt-5.6-solfact_f1-17.3%-19.9% to -14.7%6006000120
All providersbaseline:direct-factsgpt-5.6-solexact_world-67.7%-72.5% to -62.5%6006000120
All providersbaseline:direct-factsgpt-5.6-soltask_success-67.7%-72.5% to -62.5%6006000120
All providersbaseline:direct-factsgpt-5.6-soldecision_correct-65.8%-74.2% to -57.5%6006000120
All providersbaseline:direct-factsgpt-5.6-terrafact_f1-8.1%-11.0% to -5.3%6006000120
All providersbaseline:direct-factsgpt-5.6-terraexact_world-49.8%-54.0% to -45.5%6006000120
All providersbaseline:direct-factsgpt-5.6-terratask_success-49.8%-54.0% to -45.5%6006000120
All providersbaseline:direct-factsgpt-5.6-terradecision_correct-65.7%-74.0% to -57.5%6006000120
All providersbaseline:direct-factsgpt-6-astrafact_f1-24.6%-26.7% to -22.5%60055050115
All providersbaseline:direct-factsgpt-6-astraexact_world-86.7%-91.2% to -81.7%60055050115
All providersbaseline:direct-factsgpt-6-astratask_success-86.7%-91.2% to -81.7%60055050115
All providersbaseline:direct-factsgpt-6-astradecision_correct-66.0%-74.7% to -57.1%60055050115
All providersbaseline:direct-factsgpt-6-lunafact_f1-7.8%-10.7% to -5.0%6006000120
All providersbaseline:direct-factsgpt-6-lunaexact_world-41.7%-45.8% to -37.7%6006000120
All providersbaseline:direct-factsgpt-6-lunatask_success-41.5%-45.5% to -37.5%6006000120
All providersbaseline:direct-factsgpt-6-lunadecision_correct-64.2%-72.3% to -55.7%6006000120
All providersbaseline:direct-factsgpt-6-solfact_f1-23.0%-25.2% to -20.8%6006000120
All providersbaseline:direct-factsgpt-6-solexact_world-73.5%-78.0% to -68.8%6006000120
All providersbaseline:direct-factsgpt-6-soltask_success-73.3%-77.8% to -68.7%6006000120
All providersbaseline:direct-factsgpt-6-soldecision_correct-64.3%-72.7% to -56.0%6006000120
All providersbaseline:direct-factsgrok-4.6fact_f1-15.8%-18.2% to -13.6%6006000120
All providersbaseline:direct-factsgrok-4.6exact_world-36.2%-40.0% to -32.3%6006000120
All providersbaseline:direct-factsgrok-4.6task_success-36.2%-40.0% to -32.3%6006000120
All providersbaseline:direct-factsgrok-4.6decision_correct-62.5%-70.8% to -53.8%6006000120
All providersbaseline:direct-factskimi-k2.6fact_f1-16.9%-18.9% to -14.8%6005991120
All providersbaseline:direct-factskimi-k2.6exact_world-35.7%-39.3% to -32.2%6005991120
All providersbaseline:direct-factskimi-k2.6task_success-35.7%-39.3% to -32.2%6005991120
All providersbaseline:direct-factskimi-k2.6decision_correct-63.8%-72.2% to -55.2%6005991120
All providersbaseline:direct-factskimi-k3fact_f1-10.2%-13.4% to -7.1%60044315796
All providersbaseline:direct-factskimi-k3exact_world-41.1%-46.3% to -36.0%60044315796
All providersbaseline:direct-factskimi-k3task_success-41.1%-46.3% to -36.0%60044315796
All providersbaseline:direct-factskimi-k3decision_correct-64.3%-74.2% to -54.3%60044315796
All providersbaseline:direct-factsmimo-v2.6-flashfact_f1-5.6%-8.4% to -3.0%6005946120
All providersbaseline:direct-factsmimo-v2.6-flashexact_world-40.1%-43.8% to -36.4%6005946120
All providersbaseline:direct-factsmimo-v2.6-flashtask_success-38.4%-42.1% to -34.8%6005946120
All providersbaseline:direct-factsmimo-v2.6-flashdecision_correct-55.4%-63.9% to -46.3%6005946120
All providersbaseline:direct-factsmimo-v2.6-profact_f1-2.9%-5.9% to 0.1%6006000120
All providersbaseline:direct-factsmimo-v2.6-proexact_world-38.3%-42.0% to -34.5%6006000120
All providersbaseline:direct-factsmimo-v2.6-protask_success-37.2%-41.0% to -33.3%6006000120
All providersbaseline:direct-factsmimo-v2.6-prodecision_correct-54.3%-63.5% to -45.2%6006000120
All providersbaseline:direct-factsminimax-m3fact_f15.2%1.9% to 8.6%6006000120
All providersbaseline:direct-factsminimax-m3exact_world-33.0%-36.5% to -29.5%6006000120
All providersbaseline:direct-factsminimax-m3task_success-33.0%-36.5% to -29.5%6006000120
All providersbaseline:direct-factsminimax-m3decision_correct-62.5%-71.0% to -54.2%6006000120
All providersbaseline:direct-factsqwen3.8-27bfact_f1-9.9%-12.3% to -7.6%6006000120
All providersbaseline:direct-factsqwen3.8-27bexact_world-32.8%-37.0% to -28.8%6006000120
All providersbaseline:direct-factsqwen3.8-27btask_success-32.8%-37.0% to -28.8%6006000120
All providersbaseline:direct-factsqwen3.8-27bdecision_correct-62.8%-71.0% to -54.7%6006000120
All providersbaseline:forward-chainbaseline:story-copyfact_f199.8%99.6% to 100.0%6006000120
All providersbaseline:forward-chainbaseline:story-copyexact_world98.3%95.8% to 100.0%6006000120
All providersbaseline:forward-chainbaseline:story-copytask_success98.3%95.8% to 100.0%6006000120
All providersbaseline:forward-chainbaseline:story-copydecision_correct99.2%97.5% to 100.0%6006000120
All providersbaseline:forward-chainclaude-fable-5fact_f14.4%3.5% to 5.4%600393207120
All providersbaseline:forward-chainclaude-fable-5exact_world38.7%32.9% to 44.3%600393207120
All providersbaseline:forward-chainclaude-fable-5task_success38.7%32.9% to 44.3%600393207120
All providersbaseline:forward-chainclaude-fable-5decision_correct0.8%-0.8% to 2.5%600393207120
All providersbaseline:forward-chainclaude-fable-5.1fact_f11.8%0.3% to 3.5%6001458613
All providersbaseline:forward-chainclaude-fable-5.1exact_world28.6%7.7% to 50.0%6001458613
All providersbaseline:forward-chainclaude-fable-5.1task_success28.6%7.7% to 50.0%6001458613
All providersbaseline:forward-chainclaude-fable-5.1decision_correct0.0%0.0% to 0.0%6001458613
All providersbaseline:forward-chainclaude-haiku-4.5fact_f131.8%28.9% to 34.6%6006000120
All providersbaseline:forward-chainclaude-haiku-4.5exact_world74.7%71.7% to 77.2%6006000120
All providersbaseline:forward-chainclaude-haiku-4.5task_success74.7%71.7% to 77.2%6006000120
All providersbaseline:forward-chainclaude-haiku-4.5decision_correct3.7%2.2% to 5.2%6006000120
All providersbaseline:forward-chainclaude-opus-5fact_f118.8%15.6% to 21.9%600424176119
All providersbaseline:forward-chainclaude-opus-5exact_world45.5%38.7% to 51.8%600424176119
All providersbaseline:forward-chainclaude-opus-5task_success45.5%38.7% to 51.8%600424176119
All providersbaseline:forward-chainclaude-opus-5decision_correct7.5%4.1% to 10.7%600424176119
All providersbaseline:forward-chainclaude-opus-5.5fact_f16.6%5.7% to 7.5%6005919120
All providersbaseline:forward-chainclaude-opus-5.5exact_world57.7%53.2% to 61.9%6005919120
All providersbaseline:forward-chainclaude-opus-5.5task_success57.9%53.4% to 62.0%6005919120
All providersbaseline:forward-chainclaude-opus-5.5decision_correct3.9%1.3% to 6.1%6005919120
All providersbaseline:forward-chainclaude-sonnet-5fact_f19.6%7.5% to 11.8%600445155120
All providersbaseline:forward-chainclaude-sonnet-5exact_world41.6%36.4% to 46.9%600445155120
All providersbaseline:forward-chainclaude-sonnet-5task_success41.6%36.4% to 46.9%600445155120
All providersbaseline:forward-chainclaude-sonnet-5decision_correct2.9%0.7% to 5.0%600445155120
All providersbaseline:forward-chaindeepseek-4.1-flashfact_f120.5%18.1% to 22.8%6005955120
All providersbaseline:forward-chaindeepseek-4.1-flashexact_world49.4%44.6% to 54.1%6005955120
All providersbaseline:forward-chaindeepseek-4.1-flashtask_success49.4%44.6% to 54.1%6005955120
All providersbaseline:forward-chaindeepseek-4.1-flashdecision_correct-0.7%-2.0% to 0.0%6005955120
All providersbaseline:forward-chaindeepseek-v4-profact_f18.4%7.1% to 9.7%6006000120
All providersbaseline:forward-chaindeepseek-v4-proexact_world55.7%50.5% to 60.0%6006000120
All providersbaseline:forward-chaindeepseek-v4-protask_success55.7%50.5% to 60.0%6006000120
All providersbaseline:forward-chaindeepseek-v4-prodecision_correct3.8%1.5% to 6.2%6006000120
All providersbaseline:forward-chaingemini-3.6-flashfact_f120.4%17.7% to 23.0%6006000120
All providersbaseline:forward-chaingemini-3.6-flashexact_world54.7%49.8% to 59.2%6006000120
All providersbaseline:forward-chaingemini-3.6-flashtask_success54.7%49.8% to 59.2%6006000120
All providersbaseline:forward-chaingemini-3.6-flashdecision_correct0.2%-0.8% to 1.0%6006000120
All providersbaseline:forward-chaingemini-3.7-flashfact_f18.5%6.9% to 10.3%6006000120
All providersbaseline:forward-chaingemini-3.7-flashexact_world29.7%25.5% to 33.8%6006000120
All providersbaseline:forward-chaingemini-3.7-flashtask_success29.7%25.5% to 33.8%6006000120
All providersbaseline:forward-chaingemini-3.7-flashdecision_correct-0.3%-1.5% to 0.5%6006000120
All providersbaseline:forward-chaingemini-3.8-flashfact_f113.3%11.2% to 15.4%6005982120
All providersbaseline:forward-chaingemini-3.8-flashexact_world39.1%34.2% to 43.7%6005982120
All providersbaseline:forward-chaingemini-3.8-flashtask_success39.1%34.2% to 43.7%6005982120
All providersbaseline:forward-chaingemini-3.8-flashdecision_correct-0.5%-2.0% to 0.5%6005982120
All providersbaseline:forward-chainglm-4.7-flashfact_f132.8%29.9% to 35.5%60056634120
All providersbaseline:forward-chainglm-4.7-flashexact_world78.3%75.3% to 81.0%60056634120
All providersbaseline:forward-chainglm-4.7-flashtask_success78.3%75.3% to 81.0%60056634120
All providersbaseline:forward-chainglm-4.7-flashdecision_correct17.3%14.0% to 20.7%60056634120
All providersbaseline:forward-chainglm-5.3fact_f114.7%11.7% to 17.7%60056436120
All providersbaseline:forward-chainglm-5.3exact_world41.8%36.5% to 46.7%60056436120
All providersbaseline:forward-chainglm-5.3task_success42.0%36.8% to 46.9%60056436120
All providersbaseline:forward-chainglm-5.3decision_correct3.0%0.7% to 5.0%60056436120
All providersbaseline:forward-chainglm-5.3-flashfact_f132.7%29.4% to 36.0%6005964120
All providersbaseline:forward-chainglm-5.3-flashexact_world72.1%68.3% to 75.7%6005964120
All providersbaseline:forward-chainglm-5.3-flashtask_success72.3%68.4% to 75.9%6005964120
All providersbaseline:forward-chainglm-5.3-flashdecision_correct0.8%-1.4% to 2.5%6005964120
All providersbaseline:forward-chaingpt-5.6-lunafact_f118.5%16.4% to 20.5%6006000120
All providersbaseline:forward-chaingpt-5.6-lunaexact_world55.7%51.2% to 59.8%6006000120
All providersbaseline:forward-chaingpt-5.6-lunatask_success56.7%52.2% to 60.8%6006000120
All providersbaseline:forward-chaingpt-5.6-lunadecision_correct2.0%-0.0% to 3.8%6006000120
All providersbaseline:forward-chaingpt-5.6-solfact_f18.8%7.0% to 10.6%6006000120
All providersbaseline:forward-chaingpt-5.6-solexact_world29.8%24.7% to 35.2%6006000120
All providersbaseline:forward-chaingpt-5.6-soltask_success29.8%24.7% to 35.2%6006000120
All providersbaseline:forward-chaingpt-5.6-soldecision_correct-0.8%-2.5% to 0.0%6006000120
All providersbaseline:forward-chaingpt-5.6-terrafact_f118.1%16.0% to 20.2%6006000120
All providersbaseline:forward-chaingpt-5.6-terraexact_world47.7%43.0% to 51.8%6006000120
All providersbaseline:forward-chaingpt-5.6-terratask_success47.7%43.0% to 51.8%6006000120
All providersbaseline:forward-chaingpt-5.6-terradecision_correct-0.7%-2.0% to 0.0%6006000120
All providersbaseline:forward-chaingpt-6-astrafact_f11.1%0.5% to 1.6%60055050115
All providersbaseline:forward-chaingpt-6-astraexact_world10.7%6.2% to 15.5%60055050115
All providersbaseline:forward-chaingpt-6-astratask_success10.7%6.2% to 15.5%60055050115
All providersbaseline:forward-chaingpt-6-astradecision_correct-0.7%-2.2% to 0.0%60055050115
All providersbaseline:forward-chaingpt-6-lunafact_f118.4%16.2% to 20.6%6006000120
All providersbaseline:forward-chaingpt-6-lunaexact_world55.8%51.7% to 59.7%6006000120
All providersbaseline:forward-chaingpt-6-lunatask_success56.0%51.7% to 59.8%6006000120
All providersbaseline:forward-chaingpt-6-lunadecision_correct0.8%-1.3% to 2.5%6006000120
All providersbaseline:forward-chaingpt-6-solfact_f13.2%2.4% to 4.0%6006000120
All providersbaseline:forward-chaingpt-6-solexact_world24.0%19.5% to 28.5%6006000120
All providersbaseline:forward-chaingpt-6-soltask_success24.2%19.7% to 28.7%6006000120
All providersbaseline:forward-chaingpt-6-soldecision_correct0.7%-1.2% to 2.0%6006000120
All providersbaseline:forward-chaingrok-4.6fact_f110.4%9.1% to 11.6%6006000120
All providersbaseline:forward-chaingrok-4.6exact_world61.3%57.0% to 65.3%6006000120
All providersbaseline:forward-chaingrok-4.6task_success61.3%57.0% to 65.3%6006000120
All providersbaseline:forward-chaingrok-4.6decision_correct2.5%0.7% to 4.7%6006000120
All providersbaseline:forward-chainkimi-k2.6fact_f19.3%8.2% to 10.5%6005991120
All providersbaseline:forward-chainkimi-k2.6exact_world61.8%57.8% to 65.6%6005991120
All providersbaseline:forward-chainkimi-k2.6task_success61.8%57.8% to 65.6%6005991120
All providersbaseline:forward-chainkimi-k2.6decision_correct1.3%-1.0% to 3.3%6005991120
All providersbaseline:forward-chainkimi-k3fact_f114.8%12.0% to 17.7%60044315796
All providersbaseline:forward-chainkimi-k3exact_world55.5%50.1% to 60.5%60044315796
All providersbaseline:forward-chainkimi-k3task_success55.5%50.1% to 60.5%60044315796
All providersbaseline:forward-chainkimi-k3decision_correct-0.9%-2.8% to 0.0%60044315796
All providersbaseline:forward-chainmimo-v2.6-flashfact_f120.5%18.2% to 22.7%6005946120
All providersbaseline:forward-chainmimo-v2.6-flashexact_world57.4%53.0% to 61.3%6005946120
All providersbaseline:forward-chainmimo-v2.6-flashtask_success59.1%54.6% to 63.1%6005946120
All providersbaseline:forward-chainmimo-v2.6-flashdecision_correct9.3%6.2% to 12.3%6005946120
All providersbaseline:forward-chainmimo-v2.6-profact_f123.2%20.7% to 25.8%6006000120
All providersbaseline:forward-chainmimo-v2.6-proexact_world59.2%54.8% to 63.3%6006000120
All providersbaseline:forward-chainmimo-v2.6-protask_success60.3%56.0% to 64.8%6006000120
All providersbaseline:forward-chainmimo-v2.6-prodecision_correct10.7%7.2% to 14.0%6006000120
All providersbaseline:forward-chainminimax-m3fact_f131.4%28.2% to 34.6%6006000120
All providersbaseline:forward-chainminimax-m3exact_world64.5%60.2% to 68.3%6006000120
All providersbaseline:forward-chainminimax-m3task_success64.5%60.2% to 68.3%6006000120
All providersbaseline:forward-chainminimax-m3decision_correct2.5%0.7% to 4.2%6006000120
All providersbaseline:forward-chainqwen3.8-27bfact_f116.2%14.1% to 18.5%6006000120
All providersbaseline:forward-chainqwen3.8-27bexact_world64.7%60.0% to 68.8%6006000120
All providersbaseline:forward-chainqwen3.8-27btask_success64.7%60.0% to 68.8%6006000120
All providersbaseline:forward-chainqwen3.8-27bdecision_correct2.2%0.7% to 3.8%6006000120
All providersbaseline:story-copyclaude-fable-5fact_f1-95.5%-96.4% to -94.5%600393207120
All providersbaseline:story-copyclaude-fable-5exact_world-60.3%-66.0% to -54.8%600393207120
All providersbaseline:story-copyclaude-fable-5task_success-60.3%-66.0% to -54.8%600393207120
All providersbaseline:story-copyclaude-fable-5decision_correct-98.7%-99.8% to -97.3%600393207120
All providersbaseline:story-copyclaude-fable-5.1fact_f1-98.2%-99.7% to -96.5%6001458613
All providersbaseline:story-copyclaude-fable-5.1exact_world-71.4%-92.3% to -50.0%6001458613
All providersbaseline:story-copyclaude-fable-5.1task_success-71.4%-92.3% to -50.0%6001458613
All providersbaseline:story-copyclaude-fable-5.1decision_correct-100.0%-100.0% to -100.0%6001458613
All providersbaseline:story-copyclaude-haiku-4.5fact_f1-68.0%-70.9% to -65.2%6006000120
All providersbaseline:story-copyclaude-haiku-4.5exact_world-23.7%-25.7% to -21.8%6006000120
All providersbaseline:story-copyclaude-haiku-4.5task_success-23.7%-25.7% to -21.8%6006000120
All providersbaseline:story-copyclaude-haiku-4.5decision_correct-95.5%-97.3% to -93.5%6006000120
All providersbaseline:story-copyclaude-opus-5fact_f1-81.1%-84.3% to -77.9%600424176119
All providersbaseline:story-copyclaude-opus-5exact_world-52.6%-58.3% to -47.2%600424176119
All providersbaseline:story-copyclaude-opus-5task_success-52.6%-58.3% to -47.2%600424176119
All providersbaseline:story-copyclaude-opus-5decision_correct-91.5%-94.1% to -88.6%600424176119
All providersbaseline:story-copyclaude-opus-5.5fact_f1-93.3%-94.1% to -92.4%6005919120
All providersbaseline:story-copyclaude-opus-5.5exact_world-40.6%-44.3% to -37.2%6005919120
All providersbaseline:story-copyclaude-opus-5.5task_success-40.4%-44.2% to -37.0%6005919120
All providersbaseline:story-copyclaude-opus-5.5decision_correct-95.3%-97.1% to -93.1%6005919120
All providersbaseline:story-copyclaude-sonnet-5fact_f1-90.2%-92.4% to -88.1%600445155120
All providersbaseline:story-copyclaude-sonnet-5exact_world-56.4%-60.9% to -51.3%600445155120
All providersbaseline:story-copyclaude-sonnet-5task_success-56.4%-60.9% to -51.3%600445155120
All providersbaseline:story-copyclaude-sonnet-5decision_correct-96.0%-97.7% to -94.1%600445155120
All providersbaseline:story-copydeepseek-4.1-flashfact_f1-79.4%-81.7% to -77.1%6005955120
All providersbaseline:story-copydeepseek-4.1-flashexact_world-49.1%-53.1% to -44.9%6005955120
All providersbaseline:story-copydeepseek-4.1-flashtask_success-49.1%-53.1% to -44.9%6005955120
All providersbaseline:story-copydeepseek-4.1-flashdecision_correct-100.0%-100.0% to -100.0%6005955120
All providersbaseline:story-copydeepseek-v4-profact_f1-91.5%-92.7% to -90.2%6006000120
All providersbaseline:story-copydeepseek-v4-proexact_world-42.7%-46.8% to -38.8%6006000120
All providersbaseline:story-copydeepseek-v4-protask_success-42.7%-46.8% to -38.8%6006000120
All providersbaseline:story-copydeepseek-v4-prodecision_correct-95.3%-97.2% to -93.3%6006000120
All providersbaseline:story-copygemini-3.6-flashfact_f1-79.5%-82.1% to -76.8%6006000120
All providersbaseline:story-copygemini-3.6-flashexact_world-43.7%-47.8% to -39.3%6006000120
All providersbaseline:story-copygemini-3.6-flashtask_success-43.7%-47.8% to -39.3%6006000120
All providersbaseline:story-copygemini-3.6-flashdecision_correct-99.0%-99.8% to -97.8%6006000120
All providersbaseline:story-copygemini-3.7-flashfact_f1-91.3%-93.0% to -89.5%6006000120
All providersbaseline:story-copygemini-3.7-flashexact_world-68.7%-72.8% to -64.8%6006000120
All providersbaseline:story-copygemini-3.7-flashtask_success-68.7%-72.8% to -64.8%6006000120
All providersbaseline:story-copygemini-3.7-flashdecision_correct-99.5%-100.0% to -98.7%6006000120
All providersbaseline:story-copygemini-3.8-flashfact_f1-86.5%-88.7% to -84.4%6005982120
All providersbaseline:story-copygemini-3.8-flashexact_world-59.2%-63.6% to -55.0%6005982120
All providersbaseline:story-copygemini-3.8-flashtask_success-59.2%-63.6% to -55.0%6005982120
All providersbaseline:story-copygemini-3.8-flashdecision_correct-99.7%-100.0% to -99.2%6005982120
All providersbaseline:story-copyglm-4.7-flashfact_f1-67.1%-69.9% to -64.4%60056634120
All providersbaseline:story-copyglm-4.7-flashexact_world-20.7%-23.0% to -18.5%60056634120
All providersbaseline:story-copyglm-4.7-flashtask_success-20.7%-23.0% to -18.5%60056634120
All providersbaseline:story-copyglm-4.7-flashdecision_correct-82.5%-85.8% to -79.1%60056634120
All providersbaseline:story-copyglm-5.3fact_f1-85.2%-88.1% to -82.2%60056436120
All providersbaseline:story-copyglm-5.3exact_world-56.7%-61.5% to -52.2%60056436120
All providersbaseline:story-copyglm-5.3task_success-56.6%-61.4% to -52.1%60056436120
All providersbaseline:story-copyglm-5.3decision_correct-96.3%-97.7% to -94.6%60056436120
All providersbaseline:story-copyglm-5.3-flashfact_f1-67.1%-70.5% to -63.9%6005964120
All providersbaseline:story-copyglm-5.3-flashexact_world-26.2%-29.4% to -23.2%6005964120
All providersbaseline:story-copyglm-5.3-flashtask_success-26.0%-29.3% to -23.0%6005964120
All providersbaseline:story-copyglm-5.3-flashdecision_correct-98.3%-99.2% to -97.3%6005964120
All providersbaseline:story-copygpt-5.6-lunafact_f1-81.4%-83.4% to -79.4%6006000120
All providersbaseline:story-copygpt-5.6-lunaexact_world-42.7%-46.0% to -39.3%6006000120
All providersbaseline:story-copygpt-5.6-lunatask_success-41.7%-45.0% to -38.3%6006000120
All providersbaseline:story-copygpt-5.6-lunadecision_correct-97.2%-98.5% to -95.7%6006000120
All providersbaseline:story-copygpt-5.6-solfact_f1-91.0%-92.8% to -89.3%6006000120
All providersbaseline:story-copygpt-5.6-solexact_world-68.5%-72.8% to -63.8%6006000120
All providersbaseline:story-copygpt-5.6-soltask_success-68.5%-72.8% to -63.8%6006000120
All providersbaseline:story-copygpt-5.6-soldecision_correct-100.0%-100.0% to -100.0%6006000120
All providersbaseline:story-copygpt-5.6-terrafact_f1-81.8%-83.8% to -79.7%6006000120
All providersbaseline:story-copygpt-5.6-terraexact_world-50.7%-54.3% to -47.0%6006000120
All providersbaseline:story-copygpt-5.6-terratask_success-50.7%-54.3% to -47.0%6006000120
All providersbaseline:story-copygpt-5.6-terradecision_correct-99.8%-100.0% to -99.5%6006000120
All providersbaseline:story-copygpt-6-astrafact_f1-98.8%-99.2% to -98.3%60055050115
All providersbaseline:story-copygpt-6-astraexact_world-87.6%-91.3% to -83.5%60055050115
All providersbaseline:story-copygpt-6-astratask_success-87.6%-91.3% to -83.5%60055050115
All providersbaseline:story-copygpt-6-astradecision_correct-100.0%-100.0% to -100.0%60055050115
All providersbaseline:story-copygpt-6-lunafact_f1-81.5%-83.7% to -79.2%6006000120
All providersbaseline:story-copygpt-6-lunaexact_world-42.5%-46.3% to -39.0%6006000120
All providersbaseline:story-copygpt-6-lunatask_success-42.3%-46.0% to -38.8%6006000120
All providersbaseline:story-copygpt-6-lunadecision_correct-98.3%-99.3% to -97.3%6006000120
All providersbaseline:story-copygpt-6-solfact_f1-96.6%-97.4% to -95.8%6006000120
All providersbaseline:story-copygpt-6-solexact_world-74.3%-78.5% to -70.2%6006000120
All providersbaseline:story-copygpt-6-soltask_success-74.2%-78.3% to -70.0%6006000120
All providersbaseline:story-copygpt-6-soldecision_correct-98.5%-99.3% to -97.5%6006000120
All providersbaseline:story-copygrok-4.6fact_f1-89.5%-90.7% to -88.3%6006000120
All providersbaseline:story-copygrok-4.6exact_world-37.0%-40.8% to -33.5%6006000120
All providersbaseline:story-copygrok-4.6task_success-37.0%-40.8% to -33.5%6006000120
All providersbaseline:story-copygrok-4.6decision_correct-96.7%-98.7% to -94.5%6006000120
All providersbaseline:story-copykimi-k2.6fact_f1-90.6%-91.7% to -89.3%6005991120
All providersbaseline:story-copykimi-k2.6exact_world-36.6%-40.1% to -33.1%6005991120
All providersbaseline:story-copykimi-k2.6task_success-36.6%-40.1% to -33.1%6005991120
All providersbaseline:story-copykimi-k2.6decision_correct-97.8%-99.0% to -96.5%6005991120
All providersbaseline:story-copykimi-k3fact_f1-85.0%-87.8% to -82.1%60044315796
All providersbaseline:story-copykimi-k3exact_world-42.2%-47.0% to -37.6%60044315796
All providersbaseline:story-copykimi-k3task_success-42.2%-47.0% to -37.6%60044315796
All providersbaseline:story-copykimi-k3decision_correct-99.8%-100.0% to -99.3%60044315796
All providersbaseline:story-copymimo-v2.6-flashfact_f1-79.3%-81.7% to -77.1%6005946120
All providersbaseline:story-copymimo-v2.6-flashexact_world-40.9%-44.4% to -37.7%6005946120
All providersbaseline:story-copymimo-v2.6-flashtask_success-39.2%-42.8% to -36.0%6005946120
All providersbaseline:story-copymimo-v2.6-flashdecision_correct-89.9%-92.5% to -87.1%6005946120
All providersbaseline:story-copymimo-v2.6-profact_f1-76.6%-79.1% to -74.0%6006000120
All providersbaseline:story-copymimo-v2.6-proexact_world-39.2%-42.7% to -35.7%6006000120
All providersbaseline:story-copymimo-v2.6-protask_success-38.0%-41.5% to -34.3%6006000120
All providersbaseline:story-copymimo-v2.6-prodecision_correct-88.5%-91.2% to -85.7%6006000120
All providersbaseline:story-copyminimax-m3fact_f1-68.5%-71.7% to -65.3%6006000120
All providersbaseline:story-copyminimax-m3exact_world-33.8%-37.2% to -30.7%6006000120
All providersbaseline:story-copyminimax-m3task_success-33.8%-37.2% to -30.7%6006000120
All providersbaseline:story-copyminimax-m3decision_correct-96.7%-98.2% to -95.0%6006000120
All providersbaseline:story-copyqwen3.8-27bfact_f1-83.6%-85.7% to -81.3%6006000120
All providersbaseline:story-copyqwen3.8-27bexact_world-33.7%-37.5% to -30.2%6006000120
All providersbaseline:story-copyqwen3.8-27btask_success-33.7%-37.5% to -30.2%6006000120
All providersbaseline:story-copyqwen3.8-27bdecision_correct-97.0%-98.5% to -95.2%6006000120
All providersclaude-fable-5claude-fable-5.1fact_f1-1.3%-3.0% to 0.0%60095919
All providersclaude-fable-5claude-fable-5.1exact_world-11.1%-33.3% to 0.0%60095919
All providersclaude-fable-5claude-fable-5.1task_success-11.1%-33.3% to 0.0%60095919
All providersclaude-fable-5claude-fable-5.1decision_correct0.0%0.0% to 0.0%60095919
All providersclaude-fable-5claude-haiku-4.5fact_f125.5%21.9% to 29.1%600393207120
All providersclaude-fable-5claude-haiku-4.5exact_world33.8%27.9% to 39.6%600393207120
All providersclaude-fable-5claude-haiku-4.5task_success33.8%27.9% to 39.6%600393207120
All providersclaude-fable-5claude-haiku-4.5decision_correct3.1%0.5% to 5.7%600393207120
All providersclaude-fable-5claude-opus-5fact_f112.0%7.7% to 16.4%600268332112
All providersclaude-fable-5claude-opus-5exact_world-4.1%-14.1% to 5.5%600268332112
All providersclaude-fable-5claude-opus-5task_success-4.1%-14.1% to 5.5%600268332112
All providersclaude-fable-5claude-opus-5decision_correct6.3%2.9% to 9.9%600268332112
All providersclaude-fable-5claude-opus-5.5fact_f11.8%0.5% to 3.0%600388212120
All providersclaude-fable-5claude-opus-5.5exact_world17.8%11.3% to 24.3%600388212120
All providersclaude-fable-5claude-opus-5.5task_success17.8%11.3% to 24.3%600388212120
All providersclaude-fable-5claude-opus-5.5decision_correct4.1%1.3% to 7.1%600388212120
All providersclaude-fable-5claude-sonnet-5fact_f15.4%2.7% to 8.1%600292308117
All providersclaude-fable-5claude-sonnet-5exact_world9.6%2.4% to 16.8%600292308117
All providersclaude-fable-5claude-sonnet-5task_success9.6%2.4% to 16.8%600292308117
All providersclaude-fable-5claude-sonnet-5decision_correct3.8%1.4% to 6.0%600292308117
All providersclaude-fable-5deepseek-4.1-flashfact_f112.0%9.3% to 14.7%600390210120
All providersclaude-fable-5deepseek-4.1-flashexact_world5.6%-1.1% to 12.1%600390210120
All providersclaude-fable-5deepseek-4.1-flashtask_success5.6%-1.1% to 12.1%600390210120
All providersclaude-fable-5deepseek-4.1-flashdecision_correct-1.3%-2.7% to -0.2%600390210120
All providersclaude-fable-5deepseek-v4-profact_f12.8%1.1% to 4.7%600393207120
All providersclaude-fable-5deepseek-v4-proexact_world14.0%7.2% to 20.6%600393207120
All providersclaude-fable-5deepseek-v4-protask_success14.0%7.2% to 20.6%600393207120
All providersclaude-fable-5deepseek-v4-prodecision_correct3.6%0.8% to 6.5%600393207120
All providersclaude-fable-5gemini-3.6-flashfact_f114.0%10.8% to 17.1%600393207120
All providersclaude-fable-5gemini-3.6-flashexact_world14.0%7.2% to 20.6%600393207120
All providersclaude-fable-5gemini-3.6-flashtask_success14.0%7.2% to 20.6%600393207120
All providersclaude-fable-5gemini-3.6-flashdecision_correct-0.8%-2.2% to 0.3%600393207120
All providersclaude-fable-5gemini-3.7-flashfact_f13.4%1.5% to 5.4%600393207120
All providersclaude-fable-5gemini-3.7-flashexact_world-9.7%-16.5% to -3.1%600393207120
All providersclaude-fable-5gemini-3.7-flashtask_success-9.7%-16.5% to -3.1%600393207120
All providersclaude-fable-5gemini-3.7-flashdecision_correct-1.0%-2.5% to 0.3%600393207120
All providersclaude-fable-5gemini-3.8-flashfact_f16.9%4.4% to 9.2%600391209120
All providersclaude-fable-5gemini-3.8-flashexact_world-2.8%-9.5% to 4.0%600391209120
All providersclaude-fable-5gemini-3.8-flashtask_success-2.8%-9.5% to 4.0%600391209120
All providersclaude-fable-5gemini-3.8-flashdecision_correct-0.8%-2.3% to 0.5%600391209120
All providersclaude-fable-5glm-4.7-flashfact_f126.6%23.5% to 29.9%600369231119
All providersclaude-fable-5glm-4.7-flashexact_world37.4%31.9% to 43.4%600369231119
All providersclaude-fable-5glm-4.7-flashtask_success37.4%31.9% to 43.4%600369231119
All providersclaude-fable-5glm-4.7-flashdecision_correct16.3%12.0% to 20.6%600369231119
All providersclaude-fable-5glm-5.3fact_f110.2%6.8% to 13.8%600368232119
All providersclaude-fable-5glm-5.3exact_world3.8%-3.5% to 11.1%600368232119
All providersclaude-fable-5glm-5.3task_success4.1%-3.1% to 11.4%600368232119
All providersclaude-fable-5glm-5.3decision_correct2.7%0.5% to 4.9%600368232119
All providersclaude-fable-5glm-5.3-flashfact_f125.7%21.4% to 29.5%600390210120
All providersclaude-fable-5glm-5.3-flashexact_world31.5%25.1% to 38.0%600390210120
All providersclaude-fable-5glm-5.3-flashtask_success31.8%25.4% to 38.2%600390210120
All providersclaude-fable-5glm-5.3-flashdecision_correct-0.5%-2.1% to 1.0%600390210120
All providersclaude-fable-5gpt-5.6-lunafact_f111.2%8.8% to 13.6%600393207120
All providersclaude-fable-5gpt-5.6-lunaexact_world14.5%8.0% to 21.4%600393207120
All providersclaude-fable-5gpt-5.6-lunatask_success15.8%9.3% to 22.8%600393207120
All providersclaude-fable-5gpt-5.6-lunadecision_correct1.8%-0.5% to 4.1%600393207120
All providersclaude-fable-5gpt-5.6-solfact_f13.7%1.5% to 5.8%600393207120
All providersclaude-fable-5gpt-5.6-solexact_world-8.4%-16.2% to -0.5%600393207120
All providersclaude-fable-5gpt-5.6-soltask_success-8.4%-16.2% to -0.5%600393207120
All providersclaude-fable-5gpt-5.6-soldecision_correct-1.3%-2.7% to -0.2%600393207120
All providersclaude-fable-5gpt-5.6-terrafact_f112.2%9.4% to 14.8%600393207120
All providersclaude-fable-5gpt-5.6-terraexact_world8.9%1.9% to 15.6%600393207120
All providersclaude-fable-5gpt-5.6-terratask_success8.9%1.9% to 15.6%600393207120
All providersclaude-fable-5gpt-5.6-terradecision_correct-1.3%-2.7% to -0.2%600393207120
All providersclaude-fable-5gpt-6-astrafact_f1-3.6%-4.7% to -2.5%600362238115
All providersclaude-fable-5gpt-6-astraexact_world-28.2%-34.5% to -21.4%600362238115
All providersclaude-fable-5gpt-6-astratask_success-28.2%-34.5% to -21.4%600362238115
All providersclaude-fable-5gpt-6-astradecision_correct-1.4%-2.9% to -0.3%600362238115
All providersclaude-fable-5gpt-6-lunafact_f112.0%9.3% to 14.7%600393207120
All providersclaude-fable-5gpt-6-lunaexact_world15.5%9.4% to 21.7%600393207120
All providersclaude-fable-5gpt-6-lunatask_success15.8%9.6% to 22.0%600393207120
All providersclaude-fable-5gpt-6-lunadecision_correct0.5%-1.3% to 2.3%600393207120
All providersclaude-fable-5gpt-6-solfact_f1-1.8%-2.9% to -0.7%600393207120
All providersclaude-fable-5gpt-6-solexact_world-14.8%-21.0% to -8.4%600393207120
All providersclaude-fable-5gpt-6-soltask_success-14.5%-20.8% to -8.1%600393207120
All providersclaude-fable-5gpt-6-soldecision_correct0.0%-1.7% to 1.5%600393207120
All providersclaude-fable-5grok-4.6fact_f15.1%3.6% to 6.6%600393207120
All providersclaude-fable-5grok-4.6exact_world20.6%14.8% to 26.4%600393207120
All providersclaude-fable-5grok-4.6task_success20.6%14.8% to 26.4%600393207120
All providersclaude-fable-5grok-4.6decision_correct2.8%0.2% to 5.6%600393207120
All providersclaude-fable-5kimi-k2.6fact_f13.7%2.4% to 5.1%600393207120
All providersclaude-fable-5kimi-k2.6exact_world21.6%16.1% to 26.9%600393207120
All providersclaude-fable-5kimi-k2.6task_success21.6%16.1% to 26.9%600393207120
All providersclaude-fable-5kimi-k2.6decision_correct1.5%-0.5% to 3.7%600393207120
All providersclaude-fable-5kimi-k3fact_f110.1%6.6% to 13.5%60029330794
All providersclaude-fable-5kimi-k3exact_world16.4%10.3% to 22.6%60029330794
All providersclaude-fable-5kimi-k3task_success16.4%10.3% to 22.6%60029330794
All providersclaude-fable-5kimi-k3decision_correct-1.0%-2.8% to 0.4%60029330794
All providersclaude-fable-5mimo-v2.6-flashfact_f114.2%11.2% to 16.9%600387213120
All providersclaude-fable-5mimo-v2.6-flashexact_world15.8%10.2% to 21.4%600387213120
All providersclaude-fable-5mimo-v2.6-flashtask_success17.3%11.6% to 23.1%600387213120
All providersclaude-fable-5mimo-v2.6-flashdecision_correct9.0%5.8% to 12.7%600387213120
All providersclaude-fable-5mimo-v2.6-profact_f116.7%13.5% to 19.9%600393207120
All providersclaude-fable-5mimo-v2.6-proexact_world15.5%9.2% to 21.7%600393207120
All providersclaude-fable-5mimo-v2.6-protask_success17.0%10.7% to 23.4%600393207120
All providersclaude-fable-5mimo-v2.6-prodecision_correct10.7%7.1% to 14.4%600393207120
All providersclaude-fable-5minimax-m3fact_f124.6%20.7% to 28.4%600393207120
All providersclaude-fable-5minimax-m3exact_world22.6%16.4% to 28.8%600393207120
All providersclaude-fable-5minimax-m3task_success22.6%16.4% to 28.8%600393207120
All providersclaude-fable-5minimax-m3decision_correct2.8%0.3% to 5.4%600393207120
All providersclaude-fable-5qwen3.8-27bfact_f110.1%7.6% to 12.7%600393207120
All providersclaude-fable-5qwen3.8-27bexact_world25.2%18.3% to 32.0%600393207120
All providersclaude-fable-5qwen3.8-27btask_success25.2%18.3% to 32.0%600393207120
All providersclaude-fable-5qwen3.8-27bdecision_correct2.3%0.0% to 4.8%600393207120
All providersclaude-fable-5.1claude-haiku-4.5fact_f139.4%24.0% to 53.9%6001458613
All providersclaude-fable-5.1claude-haiku-4.5exact_world50.0%26.7% to 73.3%6001458613
All providersclaude-fable-5.1claude-haiku-4.5task_success50.0%26.7% to 73.3%6001458613
All providersclaude-fable-5.1claude-haiku-4.5decision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1claude-opus-5fact_f138.7%10.3% to 65.2%60095918
All providersclaude-fable-5.1claude-opus-5exact_world22.2%0.0% to 50.0%60095918
All providersclaude-fable-5.1claude-opus-5task_success22.2%0.0% to 50.0%60095918
All providersclaude-fable-5.1claude-opus-5decision_correct33.3%11.1% to 62.5%60095918
All providersclaude-fable-5.1claude-opus-5.5fact_f14.7%0.3% to 12.9%6001458613
All providersclaude-fable-5.1claude-opus-5.5exact_world14.3%0.0% to 35.7%6001458613
All providersclaude-fable-5.1claude-opus-5.5task_success14.3%0.0% to 35.7%6001458613
All providersclaude-fable-5.1claude-opus-5.5decision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1claude-sonnet-5fact_f119.2%-0.7% to 39.5%60085928
All providersclaude-fable-5.1claude-sonnet-5exact_world12.5%-25.0% to 50.0%60085928
All providersclaude-fable-5.1claude-sonnet-5task_success12.5%-25.0% to 50.0%60085928
All providersclaude-fable-5.1claude-sonnet-5decision_correct0.0%0.0% to 0.0%60085928
All providersclaude-fable-5.1deepseek-4.1-flashfact_f146.1%27.9% to 62.1%6001458613
All providersclaude-fable-5.1deepseek-4.1-flashexact_world42.9%18.8% to 69.2%6001458613
All providersclaude-fable-5.1deepseek-4.1-flashtask_success42.9%18.8% to 69.2%6001458613
All providersclaude-fable-5.1deepseek-4.1-flashdecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1deepseek-v4-profact_f118.2%7.1% to 29.2%6001458613
All providersclaude-fable-5.1deepseek-v4-proexact_world50.0%26.7% to 73.3%6001458613
All providersclaude-fable-5.1deepseek-v4-protask_success50.0%26.7% to 73.3%6001458613
All providersclaude-fable-5.1deepseek-v4-prodecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1gemini-3.6-flashfact_f134.8%18.9% to 49.9%6001458613
All providersclaude-fable-5.1gemini-3.6-flashexact_world35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1gemini-3.6-flashtask_success35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1gemini-3.6-flashdecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1gemini-3.7-flashfact_f120.7%7.7% to 36.0%6001458613
All providersclaude-fable-5.1gemini-3.7-flashexact_world28.6%6.7% to 53.8%6001458613
All providersclaude-fable-5.1gemini-3.7-flashtask_success28.6%6.7% to 53.8%6001458613
All providersclaude-fable-5.1gemini-3.7-flashdecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1gemini-3.8-flashfact_f136.0%20.6% to 49.8%6001458613
All providersclaude-fable-5.1gemini-3.8-flashexact_world35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1gemini-3.8-flashtask_success35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1gemini-3.8-flashdecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1glm-4.7-flashfact_f131.1%14.5% to 50.2%6001358712
All providersclaude-fable-5.1glm-4.7-flashexact_world53.8%25.0% to 76.9%6001358712
All providersclaude-fable-5.1glm-4.7-flashtask_success53.8%25.0% to 76.9%6001358712
All providersclaude-fable-5.1glm-4.7-flashdecision_correct15.4%0.0% to 38.5%6001358712
All providersclaude-fable-5.1glm-5.3fact_f118.5%4.3% to 33.8%6001458613
All providersclaude-fable-5.1glm-5.3exact_world35.7%7.1% to 64.3%6001458613
All providersclaude-fable-5.1glm-5.3task_success35.7%7.1% to 64.3%6001458613
All providersclaude-fable-5.1glm-5.3decision_correct14.3%0.0% to 33.3%6001458613
All providersclaude-fable-5.1glm-5.3-flashfact_f133.5%14.9% to 53.2%6001458613
All providersclaude-fable-5.1glm-5.3-flashexact_world57.1%33.3% to 78.6%6001458613
All providersclaude-fable-5.1glm-5.3-flashtask_success57.1%33.3% to 78.6%6001458613
All providersclaude-fable-5.1glm-5.3-flashdecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1gpt-5.6-lunafact_f123.7%5.8% to 44.0%6001458613
All providersclaude-fable-5.1gpt-5.6-lunaexact_world28.6%7.7% to 50.0%6001458613
All providersclaude-fable-5.1gpt-5.6-lunatask_success28.6%7.7% to 50.0%6001458613
All providersclaude-fable-5.1gpt-5.6-lunadecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1gpt-5.6-solfact_f114.3%-0.3% to 29.3%6001458613
All providersclaude-fable-5.1gpt-5.6-solexact_world7.1%-14.3% to 35.7%6001458613
All providersclaude-fable-5.1gpt-5.6-soltask_success7.1%-14.3% to 35.7%6001458613
All providersclaude-fable-5.1gpt-5.6-soldecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1gpt-5.6-terrafact_f139.8%18.5% to 61.6%6001458613
All providersclaude-fable-5.1gpt-5.6-terraexact_world35.7%5.9% to 69.2%6001458613
All providersclaude-fable-5.1gpt-5.6-terratask_success35.7%5.9% to 69.2%6001458613
All providersclaude-fable-5.1gpt-5.6-terradecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1gpt-6-astrafact_f1-0.9%-2.9% to 0.0%60095918
All providersclaude-fable-5.1gpt-6-astraexact_world-11.1%-37.5% to 0.0%60095918
All providersclaude-fable-5.1gpt-6-astratask_success-11.1%-37.5% to 0.0%60095918
All providersclaude-fable-5.1gpt-6-astradecision_correct0.0%0.0% to 0.0%60095918
All providersclaude-fable-5.1gpt-6-lunafact_f129.8%10.1% to 51.9%6001458613
All providersclaude-fable-5.1gpt-6-lunaexact_world21.4%-13.3% to 61.5%6001458613
All providersclaude-fable-5.1gpt-6-lunatask_success21.4%-13.3% to 61.5%6001458613
All providersclaude-fable-5.1gpt-6-lunadecision_correct7.1%0.0% to 23.1%6001458613
All providersclaude-fable-5.1gpt-6-solfact_f10.5%-1.8% to 3.8%6001458613
All providersclaude-fable-5.1gpt-6-solexact_world-7.1%-35.3% to 26.7%6001458613
All providersclaude-fable-5.1gpt-6-soltask_success-7.1%-35.3% to 26.7%6001458613
All providersclaude-fable-5.1gpt-6-soldecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1grok-4.6fact_f111.3%4.1% to 20.5%6001458613
All providersclaude-fable-5.1grok-4.6exact_world35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1grok-4.6task_success35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1grok-4.6decision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1kimi-k2.6fact_f119.1%7.7% to 30.8%6001458613
All providersclaude-fable-5.1kimi-k2.6exact_world35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1kimi-k2.6task_success35.7%12.5% to 61.5%6001458613
All providersclaude-fable-5.1kimi-k2.6decision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1kimi-k3fact_f140.3%3.3% to 64.9%60055954
All providersclaude-fable-5.1kimi-k3exact_world40.0%0.0% to 75.0%60055954
All providersclaude-fable-5.1kimi-k3task_success40.0%0.0% to 75.0%60055954
All providersclaude-fable-5.1kimi-k3decision_correct0.0%0.0% to 0.0%60055954
All providersclaude-fable-5.1mimo-v2.6-flashfact_f127.4%13.8% to 41.8%6001458613
All providersclaude-fable-5.1mimo-v2.6-flashexact_world42.9%18.8% to 69.2%6001458613
All providersclaude-fable-5.1mimo-v2.6-flashtask_success42.9%18.8% to 69.2%6001458613
All providersclaude-fable-5.1mimo-v2.6-flashdecision_correct14.3%0.0% to 35.7%6001458613
All providersclaude-fable-5.1mimo-v2.6-profact_f143.5%26.0% to 58.8%6001458613
All providersclaude-fable-5.1mimo-v2.6-proexact_world42.9%21.4% to 68.8%6001458613
All providersclaude-fable-5.1mimo-v2.6-protask_success42.9%21.4% to 68.8%6001458613
All providersclaude-fable-5.1mimo-v2.6-prodecision_correct21.4%0.0% to 42.9%6001458613
All providersclaude-fable-5.1minimax-m3fact_f140.0%19.8% to 58.4%6001458613
All providersclaude-fable-5.1minimax-m3exact_world35.7%14.3% to 61.5%6001458613
All providersclaude-fable-5.1minimax-m3task_success35.7%14.3% to 61.5%6001458613
All providersclaude-fable-5.1minimax-m3decision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-fable-5.1qwen3.8-27bfact_f120.5%7.8% to 35.1%6001458613
All providersclaude-fable-5.1qwen3.8-27bexact_world42.9%21.4% to 68.8%6001458613
All providersclaude-fable-5.1qwen3.8-27btask_success42.9%21.4% to 68.8%6001458613
All providersclaude-fable-5.1qwen3.8-27bdecision_correct0.0%0.0% to 0.0%6001458613
All providersclaude-haiku-4.5claude-opus-5fact_f1-19.6%-23.7% to -15.7%600424176119
All providersclaude-haiku-4.5claude-opus-5exact_world-47.4%-53.2% to -41.6%600424176119
All providersclaude-haiku-4.5claude-opus-5task_success-47.4%-53.2% to -41.6%600424176119
All providersclaude-haiku-4.5claude-opus-5decision_correct2.8%-1.2% to 6.7%600424176119
All providersclaude-haiku-4.5claude-opus-5.5fact_f1-25.0%-28.0% to -21.9%6005919120
All providersclaude-haiku-4.5claude-opus-5.5exact_world-16.6%-20.7% to -12.4%6005919120
All providersclaude-haiku-4.5claude-opus-5.5task_success-16.4%-20.5% to -12.2%6005919120
All providersclaude-haiku-4.5claude-opus-5.5decision_correct0.2%-2.4% to 2.7%6005919120
All providersclaude-haiku-4.5claude-sonnet-5fact_f1-17.4%-20.1% to -14.6%600445155120
All providersclaude-haiku-4.5claude-sonnet-5exact_world-25.4%-30.0% to -20.6%600445155120
All providersclaude-haiku-4.5claude-sonnet-5task_success-25.4%-30.0% to -20.6%600445155120
All providersclaude-haiku-4.5claude-sonnet-5decision_correct-0.7%-3.1% to 1.8%600445155120
All providersclaude-haiku-4.5deepseek-4.1-flashfact_f1-11.2%-13.8% to -8.3%6005955120
All providersclaude-haiku-4.5deepseek-4.1-flashexact_world-25.2%-29.0% to -21.1%6005955120
All providersclaude-haiku-4.5deepseek-4.1-flashtask_success-25.2%-29.0% to -21.1%6005955120
All providersclaude-haiku-4.5deepseek-4.1-flashdecision_correct-4.4%-6.2% to -2.7%6005955120
All providersclaude-haiku-4.5deepseek-v4-profact_f1-23.4%-26.3% to -20.6%6006000120
All providersclaude-haiku-4.5deepseek-v4-proexact_world-19.0%-22.7% to -15.5%6006000120
All providersclaude-haiku-4.5deepseek-v4-protask_success-19.0%-22.7% to -15.5%6006000120
All providersclaude-haiku-4.5deepseek-v4-prodecision_correct0.2%-2.0% to 2.3%6006000120
All providersclaude-haiku-4.5gemini-3.6-flashfact_f1-11.4%-13.9% to -8.9%6006000120
All providersclaude-haiku-4.5gemini-3.6-flashexact_world-20.0%-23.7% to -16.3%6006000120
All providersclaude-haiku-4.5gemini-3.6-flashtask_success-20.0%-23.7% to -16.3%6006000120
All providersclaude-haiku-4.5gemini-3.6-flashdecision_correct-3.5%-5.0% to -2.0%6006000120
All providersclaude-haiku-4.5gemini-3.7-flashfact_f1-23.3%-25.7% to -20.7%6006000120
All providersclaude-haiku-4.5gemini-3.7-flashexact_world-45.0%-48.8% to -41.2%6006000120
All providersclaude-haiku-4.5gemini-3.7-flashtask_success-45.0%-48.8% to -41.2%6006000120
All providersclaude-haiku-4.5gemini-3.7-flashdecision_correct-4.0%-5.5% to -2.5%6006000120
All providersclaude-haiku-4.5gemini-3.8-flashfact_f1-18.5%-20.8% to -16.2%6005982120
All providersclaude-haiku-4.5gemini-3.8-flashexact_world-35.5%-39.9% to -31.1%6005982120
All providersclaude-haiku-4.5gemini-3.8-flashtask_success-35.5%-39.9% to -31.1%6005982120
All providersclaude-haiku-4.5gemini-3.8-flashdecision_correct-4.2%-5.9% to -2.7%6005982120
All providersclaude-haiku-4.5glm-4.7-flashfact_f12.6%-0.6% to 5.9%60056634120
All providersclaude-haiku-4.5glm-4.7-flashexact_world4.4%1.8% to 7.1%60056634120
All providersclaude-haiku-4.5glm-4.7-flashtask_success4.4%1.8% to 7.1%60056634120
All providersclaude-haiku-4.5glm-4.7-flashdecision_correct14.3%11.0% to 17.7%60056634120
All providersclaude-haiku-4.5glm-5.3fact_f1-16.2%-19.5% to -13.0%60056436120
All providersclaude-haiku-4.5glm-5.3exact_world-31.9%-36.5% to -27.9%60056436120
All providersclaude-haiku-4.5glm-5.3task_success-31.7%-36.3% to -27.7%60056436120
All providersclaude-haiku-4.5glm-5.3decision_correct-0.5%-2.9% to 1.8%60056436120
All providersclaude-haiku-4.5glm-5.3-flashfact_f10.9%-2.0% to 3.9%6005964120
All providersclaude-haiku-4.5glm-5.3-flashexact_world-2.3%-5.4% to 0.5%6005964120
All providersclaude-haiku-4.5glm-5.3-flashtask_success-2.2%-5.2% to 0.7%6005964120
All providersclaude-haiku-4.5glm-5.3-flashdecision_correct-2.9%-5.2% to -0.7%6005964120
All providersclaude-haiku-4.5gpt-5.6-lunafact_f1-13.3%-16.3% to -10.1%6006000120
All providersclaude-haiku-4.5gpt-5.6-lunaexact_world-19.0%-22.8% to -15.0%6006000120
All providersclaude-haiku-4.5gpt-5.6-lunatask_success-18.0%-21.8% to -14.2%6006000120
All providersclaude-haiku-4.5gpt-5.6-lunadecision_correct-1.7%-3.7% to 0.3%6006000120
All providersclaude-haiku-4.5gpt-5.6-solfact_f1-23.0%-25.8% to -20.1%6006000120
All providersclaude-haiku-4.5gpt-5.6-solexact_world-44.8%-49.7% to -39.5%6006000120
All providersclaude-haiku-4.5gpt-5.6-soltask_success-44.8%-49.7% to -39.5%6006000120
All providersclaude-haiku-4.5gpt-5.6-soldecision_correct-4.5%-6.5% to -2.7%6006000120
All providersclaude-haiku-4.5gpt-5.6-terrafact_f1-13.7%-16.5% to -10.8%6006000120
All providersclaude-haiku-4.5gpt-5.6-terraexact_world-27.0%-30.7% to -23.0%6006000120
All providersclaude-haiku-4.5gpt-5.6-terratask_success-27.0%-30.7% to -23.0%6006000120
All providersclaude-haiku-4.5gpt-5.6-terradecision_correct-4.3%-6.2% to -2.7%6006000120
All providersclaude-haiku-4.5gpt-6-astrafact_f1-29.4%-32.3% to -26.4%60055050115
All providersclaude-haiku-4.5gpt-6-astraexact_world-62.9%-67.3% to -58.2%60055050115
All providersclaude-haiku-4.5gpt-6-astratask_success-62.9%-67.3% to -58.2%60055050115
All providersclaude-haiku-4.5gpt-6-astradecision_correct-4.4%-6.4% to -2.7%60055050115
All providersclaude-haiku-4.5gpt-6-lunafact_f1-13.4%-16.4% to -10.4%6006000120
All providersclaude-haiku-4.5gpt-6-lunaexact_world-18.8%-22.8% to -15.2%6006000120
All providersclaude-haiku-4.5gpt-6-lunatask_success-18.7%-22.7% to -15.0%6006000120
All providersclaude-haiku-4.5gpt-6-lunadecision_correct-2.8%-5.2% to -0.7%6006000120
All providersclaude-haiku-4.5gpt-6-solfact_f1-28.6%-31.7% to -25.4%6006000120
All providersclaude-haiku-4.5gpt-6-solexact_world-50.7%-54.8% to -46.0%6006000120
All providersclaude-haiku-4.5gpt-6-soltask_success-50.5%-54.7% to -45.8%6006000120
All providersclaude-haiku-4.5gpt-6-soldecision_correct-3.0%-4.8% to -1.2%6006000120
All providersclaude-haiku-4.5grok-4.6fact_f1-21.4%-24.5% to -18.4%6006000120
All providersclaude-haiku-4.5grok-4.6exact_world-13.3%-17.3% to -9.7%6006000120
All providersclaude-haiku-4.5grok-4.6task_success-13.3%-17.3% to -9.7%6006000120
All providersclaude-haiku-4.5grok-4.6decision_correct-1.2%-3.2% to 0.8%6006000120
All providersclaude-haiku-4.5kimi-k2.6fact_f1-22.5%-25.1% to -19.8%6005991120
All providersclaude-haiku-4.5kimi-k2.6exact_world-12.9%-16.2% to -9.7%6005991120
All providersclaude-haiku-4.5kimi-k2.6task_success-12.9%-16.2% to -9.7%6005991120
All providersclaude-haiku-4.5kimi-k2.6decision_correct-2.3%-4.5% to -0.3%6005991120
All providersclaude-haiku-4.5kimi-k3fact_f1-14.1%-17.1% to -11.1%60044315796
All providersclaude-haiku-4.5kimi-k3exact_world-17.2%-21.5% to -12.7%60044315796
All providersclaude-haiku-4.5kimi-k3task_success-17.2%-21.5% to -12.7%60044315796
All providersclaude-haiku-4.5kimi-k3decision_correct-4.7%-7.1% to -2.7%60044315796
All providersclaude-haiku-4.5mimo-v2.6-flashfact_f1-11.4%-14.1% to -8.6%6005946120
All providersclaude-haiku-4.5mimo-v2.6-flashexact_world-17.3%-20.7% to -14.2%6005946120
All providersclaude-haiku-4.5mimo-v2.6-flashtask_success-15.7%-19.0% to -12.5%6005946120
All providersclaude-haiku-4.5mimo-v2.6-flashdecision_correct5.6%2.5% to 8.8%6005946120
All providersclaude-haiku-4.5mimo-v2.6-profact_f1-8.6%-11.3% to -5.6%6006000120
All providersclaude-haiku-4.5mimo-v2.6-proexact_world-15.5%-18.7% to -12.3%6006000120
All providersclaude-haiku-4.5mimo-v2.6-protask_success-14.3%-17.7% to -10.8%6006000120
All providersclaude-haiku-4.5mimo-v2.6-prodecision_correct7.0%3.3% to 10.7%6006000120
All providersclaude-haiku-4.5minimax-m3fact_f1-0.4%-3.5% to 2.8%6006000120
All providersclaude-haiku-4.5minimax-m3exact_world-10.2%-13.5% to -6.8%6006000120
All providersclaude-haiku-4.5minimax-m3task_success-10.2%-13.5% to -6.8%6006000120
All providersclaude-haiku-4.5minimax-m3decision_correct-1.2%-3.0% to 0.7%6006000120
All providersclaude-haiku-4.5qwen3.8-27bfact_f1-15.6%-18.2% to -12.8%6006000120
All providersclaude-haiku-4.5qwen3.8-27bexact_world-10.0%-13.7% to -6.3%6006000120
All providersclaude-haiku-4.5qwen3.8-27btask_success-10.0%-13.7% to -6.3%6006000120
All providersclaude-haiku-4.5qwen3.8-27bdecision_correct-1.5%-3.5% to 0.5%6006000120
All providersclaude-opus-5claude-opus-5.5fact_f1-10.5%-13.8% to -7.2%600416184119
All providersclaude-opus-5claude-opus-5.5exact_world27.2%20.8% to 33.2%600416184119
All providersclaude-opus-5claude-opus-5.5task_success27.4%21.0% to 33.5%600416184119
All providersclaude-opus-5claude-opus-5.5decision_correct-2.6%-6.2% to 0.8%600416184119
All providersclaude-opus-5claude-sonnet-5fact_f1-6.6%-11.0% to -2.4%600314286106
All providersclaude-opus-5claude-sonnet-5exact_world11.5%3.4% to 19.4%600314286106
All providersclaude-opus-5claude-sonnet-5task_success11.5%3.4% to 19.4%600314286106
All providersclaude-opus-5claude-sonnet-5decision_correct-4.8%-8.8% to -0.9%600314286106
All providersclaude-opus-5deepseek-4.1-flashfact_f15.4%1.7% to 9.2%600419181119
All providersclaude-opus-5deepseek-4.1-flashexact_world14.1%7.1% to 21.2%600419181119
All providersclaude-opus-5deepseek-4.1-flashtask_success14.1%7.1% to 21.2%600419181119
All providersclaude-opus-5deepseek-4.1-flashdecision_correct-8.4%-11.1% to -5.7%600419181119
All providersclaude-opus-5deepseek-v4-profact_f1-9.0%-12.4% to -5.7%600424176119
All providersclaude-opus-5deepseek-v4-proexact_world22.2%15.3% to 28.8%600424176119
All providersclaude-opus-5deepseek-v4-protask_success22.2%15.3% to 28.8%600424176119
All providersclaude-opus-5deepseek-v4-prodecision_correct-3.5%-6.7% to -0.2%600424176119
All providersclaude-opus-5gemini-3.6-flashfact_f16.3%2.2% to 10.6%600424176119
All providersclaude-opus-5gemini-3.6-flashexact_world21.0%13.5% to 28.3%600424176119
All providersclaude-opus-5gemini-3.6-flashtask_success21.0%13.5% to 28.3%600424176119
All providersclaude-opus-5gemini-3.6-flashdecision_correct-7.3%-10.3% to -4.1%600424176119
All providersclaude-opus-5gemini-3.7-flashfact_f1-8.8%-12.2% to -5.2%600424176119
All providersclaude-opus-5gemini-3.7-flashexact_world-9.0%-15.9% to -2.1%600424176119
All providersclaude-opus-5gemini-3.7-flashtask_success-9.0%-15.9% to -2.1%600424176119
All providersclaude-opus-5gemini-3.7-flashdecision_correct-7.8%-10.7% to -4.8%600424176119
All providersclaude-opus-5gemini-3.8-flashfact_f1-3.6%-6.9% to -0.2%600422178119
All providersclaude-opus-5gemini-3.8-flashexact_world1.4%-5.8% to 8.7%600422178119
All providersclaude-opus-5gemini-3.8-flashtask_success1.4%-5.8% to 8.7%600422178119
All providersclaude-opus-5gemini-3.8-flashdecision_correct-8.1%-11.0% to -5.2%600422178119
All providersclaude-opus-5glm-4.7-flashfact_f119.6%15.2% to 24.2%600393207118
All providersclaude-opus-5glm-4.7-flashexact_world47.3%41.4% to 53.3%600393207118
All providersclaude-opus-5glm-4.7-flashtask_success47.3%41.4% to 53.3%600393207118
All providersclaude-opus-5glm-4.7-flashdecision_correct11.2%6.0% to 16.4%600393207118
All providersclaude-opus-5glm-5.3fact_f1-1.2%-5.5% to 3.0%600390210118
All providersclaude-opus-5glm-5.3exact_world6.4%-1.3% to 13.9%600390210118
All providersclaude-opus-5glm-5.3task_success6.7%-1.0% to 14.0%600390210118
All providersclaude-opus-5glm-5.3decision_correct-4.1%-7.6% to -0.5%600390210118
All providersclaude-opus-5glm-5.3-flashfact_f120.9%16.0% to 25.9%600420180119
All providersclaude-opus-5glm-5.3-flashexact_world40.0%33.5% to 46.5%600420180119
All providersclaude-opus-5glm-5.3-flashtask_success40.2%33.6% to 46.7%600420180119
All providersclaude-opus-5glm-5.3-flashdecision_correct-6.4%-9.6% to -3.3%600420180119
All providersclaude-opus-5gpt-5.6-lunafact_f12.4%-1.0% to 5.8%600424176119
All providersclaude-opus-5gpt-5.6-lunaexact_world22.6%16.1% to 29.0%600424176119
All providersclaude-opus-5gpt-5.6-lunatask_success23.6%17.2% to 30.3%600424176119
All providersclaude-opus-5gpt-5.6-lunadecision_correct-5.7%-8.9% to -2.3%600424176119
All providersclaude-opus-5gpt-5.6-solfact_f1-8.4%-11.6% to -5.3%600424176119
All providersclaude-opus-5gpt-5.6-solexact_world-8.7%-15.8% to -1.7%600424176119
All providersclaude-opus-5gpt-5.6-soltask_success-8.7%-15.8% to -1.7%600424176119
All providersclaude-opus-5gpt-5.6-soldecision_correct-8.5%-11.4% to -5.9%600424176119
All providersclaude-opus-5gpt-5.6-terrafact_f12.1%-1.5% to 5.9%600424176119
All providersclaude-opus-5gpt-5.6-terraexact_world12.7%6.5% to 19.1%600424176119
All providersclaude-opus-5gpt-5.6-terratask_success12.7%6.5% to 19.1%600424176119
All providersclaude-opus-5gpt-5.6-terradecision_correct-8.3%-11.1% to -5.5%600424176119
All providersclaude-opus-5gpt-6-astrafact_f1-16.7%-20.1% to -13.5%600386214111
All providersclaude-opus-5gpt-6-astraexact_world-32.1%-39.0% to -25.1%600386214111
All providersclaude-opus-5gpt-6-astratask_success-32.1%-39.0% to -25.1%600386214111
All providersclaude-opus-5gpt-6-astradecision_correct-7.8%-10.7% to -5.2%600386214111
All providersclaude-opus-5gpt-6-lunafact_f13.6%-0.4% to 7.5%600424176119
All providersclaude-opus-5gpt-6-lunaexact_world24.8%18.1% to 31.7%600424176119
All providersclaude-opus-5gpt-6-lunatask_success24.8%18.1% to 31.7%600424176119
All providersclaude-opus-5gpt-6-lunadecision_correct-6.4%-9.6% to -3.1%600424176119
All providersclaude-opus-5gpt-6-solfact_f1-15.1%-18.5% to -11.7%600424176119
All providersclaude-opus-5gpt-6-solexact_world-16.0%-22.9% to -8.9%600424176119
All providersclaude-opus-5gpt-6-soltask_success-15.8%-22.7% to -8.8%600424176119
All providersclaude-opus-5gpt-6-soldecision_correct-6.8%-9.9% to -3.9%600424176119
All providersclaude-opus-5grok-4.6fact_f1-6.2%-9.7% to -2.4%600424176119
All providersclaude-opus-5grok-4.6exact_world30.7%24.4% to 36.8%600424176119
All providersclaude-opus-5grok-4.6task_success30.7%24.4% to 36.8%600424176119
All providersclaude-opus-5grok-4.6decision_correct-4.7%-8.4% to -0.7%600424176119
All providersclaude-opus-5kimi-k2.6fact_f1-7.5%-10.8% to -4.4%600423177119
All providersclaude-opus-5kimi-k2.6exact_world30.7%24.0% to 37.7%600423177119
All providersclaude-opus-5kimi-k2.6task_success30.7%24.0% to 37.7%600423177119
All providersclaude-opus-5kimi-k2.6decision_correct-6.4%-9.5% to -3.5%600423177119
All providersclaude-opus-5kimi-k3fact_f1-0.1%-4.1% to 4.0%60031029094
All providersclaude-opus-5kimi-k3exact_world24.2%16.2% to 32.6%60031029094
All providersclaude-opus-5kimi-k3task_success24.2%16.2% to 32.6%60031029094
All providersclaude-opus-5kimi-k3decision_correct-7.1%-10.5% to -4.1%60031029094
All providersclaude-opus-5mimo-v2.6-flashfact_f14.3%0.4% to 8.1%600418182119
All providersclaude-opus-5mimo-v2.6-flashexact_world23.4%17.3% to 29.8%600418182119
All providersclaude-opus-5mimo-v2.6-flashtask_success24.9%18.4% to 31.3%600418182119
All providersclaude-opus-5mimo-v2.6-flashdecision_correct1.9%-2.0% to 6.0%600418182119
All providersclaude-opus-5mimo-v2.6-profact_f17.9%3.8% to 11.9%600424176119
All providersclaude-opus-5mimo-v2.6-proexact_world25.5%19.2% to 32.1%600424176119
All providersclaude-opus-5mimo-v2.6-protask_success26.7%20.2% to 33.4%600424176119
All providersclaude-opus-5mimo-v2.6-prodecision_correct5.9%1.7% to 10.3%600424176119
All providersclaude-opus-5minimax-m3fact_f119.3%14.4% to 24.0%600424176119
All providersclaude-opus-5minimax-m3exact_world34.0%27.4% to 40.5%600424176119
All providersclaude-opus-5minimax-m3task_success34.0%27.4% to 40.5%600424176119
All providersclaude-opus-5minimax-m3decision_correct-4.7%-8.3% to -1.1%600424176119
All providersclaude-opus-5qwen3.8-27bfact_f1-0.3%-4.3% to 3.7%600424176119
All providersclaude-opus-5qwen3.8-27bexact_world32.5%26.0% to 39.3%600424176119
All providersclaude-opus-5qwen3.8-27btask_success32.5%26.0% to 39.3%600424176119
All providersclaude-opus-5qwen3.8-27bdecision_correct-5.7%-8.9% to -2.2%600424176119
All providersclaude-opus-5.5claude-sonnet-5fact_f13.9%1.6% to 6.2%600441159120
All providersclaude-opus-5.5claude-sonnet-5exact_world-12.2%-17.8% to -5.9%600441159120
All providersclaude-opus-5.5claude-sonnet-5task_success-12.5%-17.9% to -6.3%600441159120
All providersclaude-opus-5.5claude-sonnet-5decision_correct-0.2%-2.9% to 2.3%600441159120
All providersclaude-opus-5.5deepseek-4.1-flashfact_f113.8%11.4% to 16.1%60058614120
All providersclaude-opus-5.5deepseek-4.1-flashexact_world-8.4%-13.6% to -3.1%60058614120
All providersclaude-opus-5.5deepseek-4.1-flashtask_success-8.5%-13.8% to -3.4%60058614120
All providersclaude-opus-5.5deepseek-4.1-flashdecision_correct-4.4%-6.5% to -2.7%60058614120
All providersclaude-opus-5.5deepseek-v4-profact_f11.8%0.3% to 3.3%6005919120
All providersclaude-opus-5.5deepseek-v4-proexact_world-2.2%-7.8% to 3.2%6005919120
All providersclaude-opus-5.5deepseek-v4-protask_success-2.4%-8.0% to 3.0%6005919120
All providersclaude-opus-5.5deepseek-v4-prodecision_correct-0.3%-2.5% to 1.8%6005919120
All providersclaude-opus-5.5gemini-3.6-flashfact_f113.8%11.0% to 16.6%6005919120
All providersclaude-opus-5.5gemini-3.6-flashexact_world-2.9%-8.9% to 3.1%6005919120
All providersclaude-opus-5.5gemini-3.6-flashtask_success-3.0%-9.1% to 2.9%6005919120
All providersclaude-opus-5.5gemini-3.6-flashdecision_correct-3.7%-5.9% to -1.7%6005919120
All providersclaude-opus-5.5gemini-3.7-flashfact_f11.9%0.1% to 3.8%6005919120
All providersclaude-opus-5.5gemini-3.7-flashexact_world-28.3%-33.3% to -23.3%6005919120
All providersclaude-opus-5.5gemini-3.7-flashtask_success-28.4%-33.4% to -23.6%6005919120
All providersclaude-opus-5.5gemini-3.7-flashdecision_correct-4.2%-6.3% to -2.4%6005919120
All providersclaude-opus-5.5gemini-3.8-flashfact_f16.6%4.4% to 8.7%60058911120
All providersclaude-opus-5.5gemini-3.8-flashexact_world-18.8%-24.0% to -13.7%60058911120
All providersclaude-opus-5.5gemini-3.8-flashtask_success-19.0%-24.1% to -13.9%60058911120
All providersclaude-opus-5.5gemini-3.8-flashdecision_correct-4.4%-6.5% to -2.6%60058911120
All providersclaude-opus-5.5glm-4.7-flashfact_f126.1%23.2% to 28.9%60055743120
All providersclaude-opus-5.5glm-4.7-flashexact_world20.5%15.8% to 25.2%60055743120
All providersclaude-opus-5.5glm-4.7-flashtask_success20.3%15.6% to 25.0%60055743120
All providersclaude-opus-5.5glm-4.7-flashdecision_correct13.3%9.5% to 17.0%60055743120
All providersclaude-opus-5.5glm-5.3fact_f17.9%4.9% to 11.1%60055644120
All providersclaude-opus-5.5glm-5.3exact_world-15.3%-21.8% to -9.2%60055644120
All providersclaude-opus-5.5glm-5.3task_success-15.3%-21.9% to -9.2%60055644120
All providersclaude-opus-5.5glm-5.3decision_correct-1.3%-4.0% to 1.4%60055644120
All providersclaude-opus-5.5glm-5.3-flashfact_f126.0%22.4% to 29.4%60058812120
All providersclaude-opus-5.5glm-5.3-flashexact_world14.5%9.5% to 19.3%60058812120
All providersclaude-opus-5.5glm-5.3-flashtask_success14.5%9.6% to 19.2%60058812120
All providersclaude-opus-5.5glm-5.3-flashdecision_correct-3.1%-5.4% to -0.8%60058812120
All providersclaude-opus-5.5gpt-5.6-lunafact_f111.7%9.6% to 13.8%6005919120
All providersclaude-opus-5.5gpt-5.6-lunaexact_world-2.2%-7.1% to 2.9%6005919120
All providersclaude-opus-5.5gpt-5.6-lunatask_success-1.4%-6.1% to 3.9%6005919120
All providersclaude-opus-5.5gpt-5.6-lunadecision_correct-2.0%-4.3% to 0.2%6005919120
All providersclaude-opus-5.5gpt-5.6-solfact_f12.1%0.2% to 4.1%6005919120
All providersclaude-opus-5.5gpt-5.6-solexact_world-27.9%-33.6% to -22.5%6005919120
All providersclaude-opus-5.5gpt-5.6-soltask_success-28.1%-33.7% to -22.7%6005919120
All providersclaude-opus-5.5gpt-5.6-soldecision_correct-4.7%-6.9% to -2.9%6005919120
All providersclaude-opus-5.5gpt-5.6-terrafact_f111.6%9.3% to 13.8%6005919120
All providersclaude-opus-5.5gpt-5.6-terraexact_world-10.0%-14.9% to -5.4%6005919120
All providersclaude-opus-5.5gpt-5.6-terratask_success-10.2%-15.0% to -5.6%6005919120
All providersclaude-opus-5.5gpt-5.6-terradecision_correct-4.6%-6.6% to -2.7%6005919120
All providersclaude-opus-5.5gpt-6-astrafact_f1-5.3%-6.1% to -4.5%60054258115
All providersclaude-opus-5.5gpt-6-astraexact_world-46.7%-51.1% to -41.8%60054258115
All providersclaude-opus-5.5gpt-6-astratask_success-46.9%-51.3% to -42.1%60054258115
All providersclaude-opus-5.5gpt-6-astradecision_correct-4.8%-7.0% to -2.9%60054258115
All providersclaude-opus-5.5gpt-6-lunafact_f111.7%9.4% to 14.0%6005919120
All providersclaude-opus-5.5gpt-6-lunaexact_world-2.5%-7.5% to 2.0%6005919120
All providersclaude-opus-5.5gpt-6-lunatask_success-2.5%-7.6% to 2.0%6005919120
All providersclaude-opus-5.5gpt-6-lunadecision_correct-3.2%-5.4% to -1.2%6005919120
All providersclaude-opus-5.5gpt-6-solfact_f1-3.4%-4.5% to -2.3%6005919120
All providersclaude-opus-5.5gpt-6-solexact_world-33.8%-38.7% to -29.1%6005919120
All providersclaude-opus-5.5gpt-6-soltask_success-33.8%-38.7% to -29.1%6005919120
All providersclaude-opus-5.5gpt-6-soldecision_correct-3.2%-5.2% to -1.4%6005919120
All providersclaude-opus-5.5grok-4.6fact_f13.8%2.6% to 5.0%6005919120
All providersclaude-opus-5.5grok-4.6exact_world3.7%-0.3% to 7.8%6005919120
All providersclaude-opus-5.5grok-4.6task_success3.6%-0.5% to 7.6%6005919120
All providersclaude-opus-5.5grok-4.6decision_correct-1.4%-3.7% to 1.0%6005919120
All providersclaude-opus-5.5kimi-k2.6fact_f12.7%1.4% to 4.1%6005919120
All providersclaude-opus-5.5kimi-k2.6exact_world3.7%-1.4% to 8.6%6005919120
All providersclaude-opus-5.5kimi-k2.6task_success3.6%-1.7% to 8.4%6005919120
All providersclaude-opus-5.5kimi-k2.6decision_correct-2.7%-5.1% to -0.5%6005919120
All providersclaude-opus-5.5kimi-k3fact_f18.3%5.3% to 11.2%60043816296
All providersclaude-opus-5.5kimi-k3exact_world-2.1%-8.1% to 4.0%60043816296
All providersclaude-opus-5.5kimi-k3task_success-2.3%-8.3% to 3.6%60043816296
All providersclaude-opus-5.5kimi-k3decision_correct-4.6%-6.9% to -2.5%60043816296
All providersclaude-opus-5.5mimo-v2.6-flashfact_f114.1%11.6% to 16.6%60058515120
All providersclaude-opus-5.5mimo-v2.6-flashexact_world-0.7%-5.6% to 4.0%60058515120
All providersclaude-opus-5.5mimo-v2.6-flashtask_success0.9%-4.1% to 5.3%60058515120
All providersclaude-opus-5.5mimo-v2.6-flashdecision_correct5.6%2.2% to 9.0%60058515120
All providersclaude-opus-5.5mimo-v2.6-profact_f116.5%14.0% to 19.2%6005919120
All providersclaude-opus-5.5mimo-v2.6-proexact_world1.2%-3.7% to 6.0%6005919120
All providersclaude-opus-5.5mimo-v2.6-protask_success2.2%-2.9% to 7.1%6005919120
All providersclaude-opus-5.5mimo-v2.6-prodecision_correct6.9%3.4% to 10.6%6005919120
All providersclaude-opus-5.5minimax-m3fact_f124.7%21.4% to 28.0%6005919120
All providersclaude-opus-5.5minimax-m3exact_world6.6%1.7% to 11.7%6005919120
All providersclaude-opus-5.5minimax-m3task_success6.4%1.5% to 11.5%6005919120
All providersclaude-opus-5.5minimax-m3decision_correct-1.4%-3.7% to 0.8%6005919120
All providersclaude-opus-5.5qwen3.8-27bfact_f19.5%7.4% to 11.8%6005919120
All providersclaude-opus-5.5qwen3.8-27bexact_world6.8%1.3% to 12.3%6005919120
All providersclaude-opus-5.5qwen3.8-27btask_success6.6%1.0% to 12.2%6005919120
All providersclaude-opus-5.5qwen3.8-27bdecision_correct-1.7%-3.9% to 0.5%6005919120
All providersclaude-sonnet-5deepseek-4.1-flashfact_f15.0%2.1% to 7.7%600440160120
All providersclaude-sonnet-5deepseek-4.1-flashexact_world-0.7%-5.8% to 4.5%600440160120
All providersclaude-sonnet-5deepseek-4.1-flashtask_success-0.7%-5.8% to 4.5%600440160120
All providersclaude-sonnet-5deepseek-4.1-flashdecision_correct-4.1%-6.0% to -2.3%600440160120
All providersclaude-sonnet-5deepseek-v4-profact_f1-1.9%-4.4% to 0.5%600445155120
All providersclaude-sonnet-5deepseek-v4-proexact_world7.9%2.4% to 13.2%600445155120
All providersclaude-sonnet-5deepseek-v4-protask_success7.9%2.4% to 13.2%600445155120
All providersclaude-sonnet-5deepseek-v4-prodecision_correct0.7%-1.8% to 3.4%600445155120
All providersclaude-sonnet-5gemini-3.6-flashfact_f17.9%5.0% to 10.8%600445155120
All providersclaude-sonnet-5gemini-3.6-flashexact_world4.3%-1.6% to 9.7%600445155120
All providersclaude-sonnet-5gemini-3.6-flashtask_success4.3%-1.6% to 9.7%600445155120
All providersclaude-sonnet-5gemini-3.6-flashdecision_correct-3.1%-4.9% to -1.6%600445155120
All providersclaude-sonnet-5gemini-3.7-flashfact_f1-3.4%-5.6% to -1.2%600445155120
All providersclaude-sonnet-5gemini-3.7-flashexact_world-16.9%-22.0% to -12.1%600445155120
All providersclaude-sonnet-5gemini-3.7-flashtask_success-16.9%-22.0% to -12.1%600445155120
All providersclaude-sonnet-5gemini-3.7-flashdecision_correct-3.4%-5.0% to -1.9%600445155120
All providersclaude-sonnet-5gemini-3.8-flashfact_f10.7%-1.7% to 3.0%600443157120
All providersclaude-sonnet-5gemini-3.8-flashexact_world-9.3%-14.4% to -4.6%600443157120
All providersclaude-sonnet-5gemini-3.8-flashtask_success-9.3%-14.4% to -4.6%600443157120
All providersclaude-sonnet-5gemini-3.8-flashdecision_correct-3.6%-5.3% to -2.0%600443157120
All providersclaude-sonnet-5glm-4.7-flashfact_f122.8%19.2% to 26.2%600415185120
All providersclaude-sonnet-5glm-4.7-flashexact_world31.6%26.1% to 36.6%600415185120
All providersclaude-sonnet-5glm-4.7-flashtask_success31.6%26.1% to 36.6%600415185120
All providersclaude-sonnet-5glm-4.7-flashdecision_correct13.3%9.3% to 17.6%600415185120
All providersclaude-sonnet-5glm-5.3fact_f13.7%0.4% to 7.2%600421179120
All providersclaude-sonnet-5glm-5.3exact_world-3.8%-9.5% to 1.0%600421179120
All providersclaude-sonnet-5glm-5.3task_success-3.6%-9.3% to 1.4%600421179120
All providersclaude-sonnet-5glm-5.3decision_correct-1.0%-3.2% to 1.2%600421179120
All providersclaude-sonnet-5glm-5.3-flashfact_f118.5%14.9% to 21.9%600441159120
All providersclaude-sonnet-5glm-5.3-flashexact_world23.1%17.6% to 28.3%600441159120
All providersclaude-sonnet-5glm-5.3-flashtask_success23.4%18.0% to 28.5%600441159120
All providersclaude-sonnet-5glm-5.3-flashdecision_correct-2.5%-4.6% to -0.4%600441159120
All providersclaude-sonnet-5gpt-5.6-lunafact_f13.9%0.9% to 6.7%600445155120
All providersclaude-sonnet-5gpt-5.6-lunaexact_world5.6%0.0% to 10.8%600445155120
All providersclaude-sonnet-5gpt-5.6-lunatask_success7.0%1.4% to 12.0%600445155120
All providersclaude-sonnet-5gpt-5.6-lunadecision_correct-1.1%-3.3% to 0.9%600445155120
All providersclaude-sonnet-5gpt-5.6-solfact_f1-3.6%-6.2% to -1.2%600445155120
All providersclaude-sonnet-5gpt-5.6-solexact_world-16.0%-22.6% to -9.0%600445155120
All providersclaude-sonnet-5gpt-5.6-soltask_success-16.0%-22.6% to -9.0%600445155120
All providersclaude-sonnet-5gpt-5.6-soldecision_correct-4.0%-5.9% to -2.3%600445155120
All providersclaude-sonnet-5gpt-5.6-terrafact_f14.0%1.5% to 6.5%600445155120
All providersclaude-sonnet-5gpt-5.6-terraexact_world0.0%-5.6% to 5.2%600445155120
All providersclaude-sonnet-5gpt-5.6-terratask_success0.0%-5.6% to 5.2%600445155120
All providersclaude-sonnet-5gpt-5.6-terradecision_correct-3.8%-5.6% to -2.2%600445155120
All providersclaude-sonnet-5gpt-6-astrafact_f1-8.1%-10.4% to -5.9%600407193114
All providersclaude-sonnet-5gpt-6-astraexact_world-32.7%-38.9% to -26.0%600407193114
All providersclaude-sonnet-5gpt-6-astratask_success-32.7%-38.9% to -26.0%600407193114
All providersclaude-sonnet-5gpt-6-astradecision_correct-4.4%-6.4% to -2.6%600407193114
All providersclaude-sonnet-5gpt-6-lunafact_f15.5%3.0% to 8.0%600445155120
All providersclaude-sonnet-5gpt-6-lunaexact_world9.9%4.7% to 14.8%600445155120
All providersclaude-sonnet-5gpt-6-lunatask_success10.1%4.9% to 15.0%600445155120
All providersclaude-sonnet-5gpt-6-lunadecision_correct-2.2%-4.4% to 0.0%600445155120
All providersclaude-sonnet-5gpt-6-solfact_f1-6.8%-9.2% to -4.5%600445155120
All providersclaude-sonnet-5gpt-6-solexact_world-20.7%-27.7% to -13.8%600445155120
All providersclaude-sonnet-5gpt-6-soltask_success-20.4%-27.5% to -13.5%600445155120
All providersclaude-sonnet-5gpt-6-soldecision_correct-2.2%-4.3% to -0.2%600445155120
All providersclaude-sonnet-5grok-4.6fact_f1-1.0%-3.4% to 1.3%600445155120
All providersclaude-sonnet-5grok-4.6exact_world11.7%5.6% to 17.2%600445155120
All providersclaude-sonnet-5grok-4.6task_success11.7%5.6% to 17.2%600445155120
All providersclaude-sonnet-5grok-4.6decision_correct-0.7%-2.9% to 1.7%600445155120
All providersclaude-sonnet-5kimi-k2.6fact_f1-1.7%-4.0% to 0.5%600444156120
All providersclaude-sonnet-5kimi-k2.6exact_world13.7%8.1% to 18.6%600444156120
All providersclaude-sonnet-5kimi-k2.6task_success13.7%8.1% to 18.6%600444156120
All providersclaude-sonnet-5kimi-k2.6decision_correct-1.8%-4.2% to 0.7%600444156120
All providersclaude-sonnet-5kimi-k3fact_f12.6%-0.3% to 5.6%60032927195
All providersclaude-sonnet-5kimi-k3exact_world9.1%3.2% to 15.0%60032927195
All providersclaude-sonnet-5kimi-k3task_success9.1%3.2% to 15.0%60032927195
All providersclaude-sonnet-5kimi-k3decision_correct-4.3%-6.3% to -2.4%60032927195
All providersclaude-sonnet-5mimo-v2.6-flashfact_f17.8%5.0% to 10.6%600440160120
All providersclaude-sonnet-5mimo-v2.6-flashexact_world7.7%2.3% to 13.0%600440160120
All providersclaude-sonnet-5mimo-v2.6-flashtask_success9.5%4.2% to 14.4%600440160120
All providersclaude-sonnet-5mimo-v2.6-flashdecision_correct6.6%3.4% to 10.0%600440160120
All providersclaude-sonnet-5mimo-v2.6-profact_f19.9%6.7% to 13.0%600445155120
All providersclaude-sonnet-5mimo-v2.6-proexact_world11.0%5.3% to 16.4%600445155120
All providersclaude-sonnet-5mimo-v2.6-protask_success12.1%6.2% to 17.6%600445155120
All providersclaude-sonnet-5mimo-v2.6-prodecision_correct7.6%3.9% to 11.6%600445155120
All providersclaude-sonnet-5minimax-m3fact_f116.4%13.0% to 19.8%600445155120
All providersclaude-sonnet-5minimax-m3exact_world14.6%9.8% to 19.3%600445155120
All providersclaude-sonnet-5minimax-m3task_success14.6%9.8% to 19.3%600445155120
All providersclaude-sonnet-5minimax-m3decision_correct-1.1%-3.3% to 0.9%600445155120
All providersclaude-sonnet-5qwen3.8-27bfact_f14.6%1.6% to 7.4%600445155120
All providersclaude-sonnet-5qwen3.8-27bexact_world14.8%9.6% to 19.7%600445155120
All providersclaude-sonnet-5qwen3.8-27btask_success14.8%9.6% to 19.7%600445155120
All providersclaude-sonnet-5qwen3.8-27bdecision_correct-0.2%-2.5% to 2.2%600445155120
All providersdeepseek-4.1-flashdeepseek-v4-profact_f1-12.1%-14.6% to -9.7%6005955120
All providersdeepseek-4.1-flashdeepseek-v4-proexact_world6.4%2.0% to 10.7%6005955120
All providersdeepseek-4.1-flashdeepseek-v4-protask_success6.4%2.0% to 10.7%6005955120
All providersdeepseek-4.1-flashdeepseek-v4-prodecision_correct4.7%2.9% to 6.7%6005955120
All providersdeepseek-4.1-flashgemini-3.6-flashfact_f1-0.2%-2.6% to 2.0%6005955120
All providersdeepseek-4.1-flashgemini-3.6-flashexact_world5.4%0.7% to 10.0%6005955120
All providersdeepseek-4.1-flashgemini-3.6-flashtask_success5.4%0.7% to 10.0%6005955120
All providersdeepseek-4.1-flashgemini-3.6-flashdecision_correct0.8%0.2% to 1.7%6005955120
All providersdeepseek-4.1-flashgemini-3.7-flashfact_f1-12.3%-14.7% to -10.0%6005955120
All providersdeepseek-4.1-flashgemini-3.7-flashexact_world-20.0%-25.0% to -15.1%6005955120
All providersdeepseek-4.1-flashgemini-3.7-flashtask_success-20.0%-25.0% to -15.1%6005955120
All providersdeepseek-4.1-flashgemini-3.7-flashdecision_correct0.3%0.0% to 0.8%6005955120
All providersdeepseek-4.1-flashgemini-3.8-flashfact_f1-7.2%-9.2% to -5.2%6005937120
All providersdeepseek-4.1-flashgemini-3.8-flashexact_world-10.3%-15.1% to -5.6%6005937120
All providersdeepseek-4.1-flashgemini-3.8-flashtask_success-10.3%-15.1% to -5.6%6005937120
All providersdeepseek-4.1-flashgemini-3.8-flashdecision_correct0.2%0.0% to 0.5%6005937120
All providersdeepseek-4.1-flashglm-4.7-flashfact_f112.3%9.1% to 15.6%60056337120
All providersdeepseek-4.1-flashglm-4.7-flashexact_world29.7%25.0% to 34.2%60056337120
All providersdeepseek-4.1-flashglm-4.7-flashtask_success29.7%25.0% to 34.2%60056337120
All providersdeepseek-4.1-flashglm-4.7-flashdecision_correct17.6%14.2% to 21.0%60056337120
All providersdeepseek-4.1-flashglm-5.3fact_f1-6.0%-8.9% to -3.2%60055941120
All providersdeepseek-4.1-flashglm-5.3exact_world-7.5%-12.5% to -2.8%60055941120
All providersdeepseek-4.1-flashglm-5.3task_success-7.3%-12.3% to -2.6%60055941120
All providersdeepseek-4.1-flashglm-5.3decision_correct3.8%2.3% to 5.4%60055941120
All providersdeepseek-4.1-flashglm-5.3-flashfact_f112.0%9.2% to 14.7%6005919120
All providersdeepseek-4.1-flashglm-5.3-flashexact_world22.5%18.3% to 26.8%6005919120
All providersdeepseek-4.1-flashglm-5.3-flashtask_success22.7%18.4% to 26.9%6005919120
All providersdeepseek-4.1-flashglm-5.3-flashdecision_correct1.5%0.7% to 2.5%6005919120
All providersdeepseek-4.1-flashgpt-5.6-lunafact_f1-1.9%-4.7% to 0.9%6005955120
All providersdeepseek-4.1-flashgpt-5.6-lunaexact_world6.7%1.9% to 11.6%6005955120
All providersdeepseek-4.1-flashgpt-5.6-lunatask_success7.7%2.9% to 12.6%6005955120
All providersdeepseek-4.1-flashgpt-5.6-lunadecision_correct2.9%1.5% to 4.3%6005955120
All providersdeepseek-4.1-flashgpt-5.6-solfact_f1-11.6%-14.0% to -9.3%6005955120
All providersdeepseek-4.1-flashgpt-5.6-solexact_world-19.2%-25.0% to -13.2%6005955120
All providersdeepseek-4.1-flashgpt-5.6-soltask_success-19.2%-25.0% to -13.2%6005955120
All providersdeepseek-4.1-flashgpt-5.6-soldecision_correct0.0%0.0% to 0.0%6005955120
All providersdeepseek-4.1-flashgpt-5.6-terrafact_f1-2.4%-4.8% to 0.0%6005955120
All providersdeepseek-4.1-flashgpt-5.6-terraexact_world-1.5%-6.2% to 3.0%6005955120
All providersdeepseek-4.1-flashgpt-5.6-terratask_success-1.5%-6.2% to 3.0%6005955120
All providersdeepseek-4.1-flashgpt-5.6-terradecision_correct0.2%0.0% to 0.5%6005955120
All providersdeepseek-4.1-flashgpt-6-astrafact_f1-17.9%-20.4% to -15.5%60054555115
All providersdeepseek-4.1-flashgpt-6-astraexact_world-36.0%-41.5% to -30.1%60054555115
All providersdeepseek-4.1-flashgpt-6-astratask_success-36.0%-41.5% to -30.1%60054555115
All providersdeepseek-4.1-flashgpt-6-astradecision_correct0.0%0.0% to 0.0%60054555115
All providersdeepseek-4.1-flashgpt-6-lunafact_f1-2.1%-5.0% to 0.6%6005955120
All providersdeepseek-4.1-flashgpt-6-lunaexact_world6.6%1.3% to 11.4%6005955120
All providersdeepseek-4.1-flashgpt-6-lunatask_success6.7%1.5% to 11.5%6005955120
All providersdeepseek-4.1-flashgpt-6-lunadecision_correct1.7%0.7% to 2.7%6005955120
All providersdeepseek-4.1-flashgpt-6-solfact_f1-17.3%-19.8% to -14.7%6005955120
All providersdeepseek-4.1-flashgpt-6-solexact_world-25.4%-30.7% to -19.9%6005955120
All providersdeepseek-4.1-flashgpt-6-soltask_success-25.2%-30.6% to -19.7%6005955120
All providersdeepseek-4.1-flashgpt-6-soldecision_correct1.3%0.5% to 2.3%6005955120
All providersdeepseek-4.1-flashgrok-4.6fact_f1-10.2%-12.7% to -7.7%6005955120
All providersdeepseek-4.1-flashgrok-4.6exact_world11.9%7.1% to 16.7%6005955120
All providersdeepseek-4.1-flashgrok-4.6task_success11.9%7.1% to 16.7%6005955120
All providersdeepseek-4.1-flashgrok-4.6decision_correct3.2%1.3% to 5.2%6005955120
All providersdeepseek-4.1-flashkimi-k2.6fact_f1-11.2%-13.4% to -9.0%6005946120
All providersdeepseek-4.1-flashkimi-k2.6exact_world12.3%7.9% to 16.5%6005946120
All providersdeepseek-4.1-flashkimi-k2.6task_success12.3%7.9% to 16.5%6005946120
All providersdeepseek-4.1-flashkimi-k2.6decision_correct2.2%1.0% to 3.6%6005946120
All providersdeepseek-4.1-flashkimi-k3fact_f1-2.8%-5.9% to 0.2%60044016096
All providersdeepseek-4.1-flashkimi-k3exact_world9.5%4.0% to 14.7%60044016096
All providersdeepseek-4.1-flashkimi-k3task_success9.5%4.0% to 14.7%60044016096
All providersdeepseek-4.1-flashkimi-k3decision_correct0.2%0.0% to 0.7%60044016096
All providersdeepseek-4.1-flashmimo-v2.6-flashfact_f1-0.1%-2.7% to 2.3%60059010120
All providersdeepseek-4.1-flashmimo-v2.6-flashexact_world7.6%2.9% to 12.2%60059010120
All providersdeepseek-4.1-flashmimo-v2.6-flashtask_success9.3%4.6% to 13.8%60059010120
All providersdeepseek-4.1-flashmimo-v2.6-flashdecision_correct10.2%7.5% to 13.0%60059010120
All providersdeepseek-4.1-flashmimo-v2.6-profact_f12.8%0.4% to 5.2%6005955120
All providersdeepseek-4.1-flashmimo-v2.6-proexact_world10.1%6.2% to 14.0%6005955120
All providersdeepseek-4.1-flashmimo-v2.6-protask_success11.3%7.2% to 15.3%6005955120
All providersdeepseek-4.1-flashmimo-v2.6-prodecision_correct11.4%8.7% to 14.3%6005955120
All providersdeepseek-4.1-flashminimax-m3fact_f111.1%8.3% to 13.8%6005955120
All providersdeepseek-4.1-flashminimax-m3exact_world15.0%10.3% to 19.4%6005955120
All providersdeepseek-4.1-flashminimax-m3task_success15.0%10.3% to 19.4%6005955120
All providersdeepseek-4.1-flashminimax-m3decision_correct3.4%1.8% to 5.0%6005955120
All providersdeepseek-4.1-flashqwen3.8-27bfact_f1-4.5%-7.1% to -2.0%6005955120
All providersdeepseek-4.1-flashqwen3.8-27bexact_world15.1%10.4% to 19.9%6005955120
All providersdeepseek-4.1-flashqwen3.8-27btask_success15.1%10.4% to 19.9%6005955120
All providersdeepseek-4.1-flashqwen3.8-27bdecision_correct2.7%1.2% to 4.4%6005955120
All providersdeepseek-v4-progemini-3.6-flashfact_f112.0%9.4% to 14.8%6006000120
All providersdeepseek-v4-progemini-3.6-flashexact_world-1.0%-5.7% to 3.5%6006000120
All providersdeepseek-v4-progemini-3.6-flashtask_success-1.0%-5.7% to 3.5%6006000120
All providersdeepseek-v4-progemini-3.6-flashdecision_correct-3.7%-5.7% to -1.8%6006000120
All providersdeepseek-v4-progemini-3.7-flashfact_f10.2%-1.8% to 2.2%6006000120
All providersdeepseek-v4-progemini-3.7-flashexact_world-26.0%-31.0% to -21.0%6006000120
All providersdeepseek-v4-progemini-3.7-flashtask_success-26.0%-31.0% to -21.0%6006000120
All providersdeepseek-v4-progemini-3.7-flashdecision_correct-4.2%-6.2% to -2.5%6006000120
All providersdeepseek-v4-progemini-3.8-flashfact_f15.0%2.8% to 7.2%6005982120
All providersdeepseek-v4-progemini-3.8-flashexact_world-16.4%-21.3% to -11.7%6005982120
All providersdeepseek-v4-progemini-3.8-flashtask_success-16.4%-21.3% to -11.7%6005982120
All providersdeepseek-v4-progemini-3.8-flashdecision_correct-4.3%-6.2% to -2.7%6005982120
All providersdeepseek-v4-proglm-4.7-flashfact_f124.5%21.6% to 27.4%60056634120
All providersdeepseek-v4-proglm-4.7-flashexact_world22.6%18.4% to 27.1%60056634120
All providersdeepseek-v4-proglm-4.7-flashtask_success22.6%18.4% to 27.1%60056634120
All providersdeepseek-v4-proglm-4.7-flashdecision_correct13.1%9.3% to 16.8%60056634120
All providersdeepseek-v4-proglm-5.3fact_f16.4%3.3% to 9.4%60056436120
All providersdeepseek-v4-proglm-5.3exact_world-13.5%-18.2% to -9.0%60056436120
All providersdeepseek-v4-proglm-5.3task_success-13.3%-18.0% to -8.8%60056436120
All providersdeepseek-v4-proglm-5.3decision_correct-1.2%-3.6% to 1.1%60056436120
All providersdeepseek-v4-proglm-5.3-flashfact_f124.3%20.8% to 27.9%6005964120
All providersdeepseek-v4-proglm-5.3-flashexact_world16.6%12.6% to 20.7%6005964120
All providersdeepseek-v4-proglm-5.3-flashtask_success16.8%12.8% to 20.8%6005964120
All providersdeepseek-v4-proglm-5.3-flashdecision_correct-3.0%-5.4% to -0.8%6005964120
All providersdeepseek-v4-progpt-5.6-lunafact_f110.1%8.0% to 12.2%6006000120
All providersdeepseek-v4-progpt-5.6-lunaexact_world0.0%-4.0% to 4.3%6006000120
All providersdeepseek-v4-progpt-5.6-lunatask_success1.0%-3.2% to 5.3%6006000120
All providersdeepseek-v4-progpt-5.6-lunadecision_correct-1.8%-4.2% to 0.3%6006000120
All providersdeepseek-v4-progpt-5.6-solfact_f10.5%-1.7% to 2.6%6006000120
All providersdeepseek-v4-progpt-5.6-solexact_world-25.8%-31.3% to -20.2%6006000120
All providersdeepseek-v4-progpt-5.6-soltask_success-25.8%-31.3% to -20.2%6006000120
All providersdeepseek-v4-progpt-5.6-soldecision_correct-4.7%-6.7% to -2.8%6006000120
All providersdeepseek-v4-progpt-5.6-terrafact_f19.7%7.4% to 12.0%6006000120
All providersdeepseek-v4-progpt-5.6-terraexact_world-8.0%-12.5% to -3.5%6006000120
All providersdeepseek-v4-progpt-5.6-terratask_success-8.0%-12.5% to -3.5%6006000120
All providersdeepseek-v4-progpt-5.6-terradecision_correct-4.5%-6.5% to -2.8%6006000120
All providersdeepseek-v4-progpt-6-astrafact_f1-6.9%-8.3% to -5.6%60055050115
All providersdeepseek-v4-progpt-6-astraexact_world-43.5%-48.7% to -37.9%60055050115
All providersdeepseek-v4-progpt-6-astratask_success-43.5%-48.7% to -37.9%60055050115
All providersdeepseek-v4-progpt-6-astradecision_correct-4.4%-6.3% to -2.7%60055050115
All providersdeepseek-v4-progpt-6-lunafact_f110.0%7.5% to 12.5%6006000120
All providersdeepseek-v4-progpt-6-lunaexact_world0.2%-4.5% to 4.8%6006000120
All providersdeepseek-v4-progpt-6-lunatask_success0.3%-4.3% to 5.0%6006000120
All providersdeepseek-v4-progpt-6-lunadecision_correct-3.0%-5.0% to -1.0%6006000120
All providersdeepseek-v4-progpt-6-solfact_f1-5.2%-6.7% to -3.6%6006000120
All providersdeepseek-v4-progpt-6-solexact_world-31.7%-36.8% to -26.3%6006000120
All providersdeepseek-v4-progpt-6-soltask_success-31.5%-36.7% to -26.2%6006000120
All providersdeepseek-v4-progpt-6-soldecision_correct-3.2%-5.2% to -1.3%6006000120
All providersdeepseek-v4-progrok-4.6fact_f12.0%0.3% to 3.5%6006000120
All providersdeepseek-v4-progrok-4.6exact_world5.7%0.5% to 10.8%6006000120
All providersdeepseek-v4-progrok-4.6task_success5.7%0.5% to 10.8%6006000120
All providersdeepseek-v4-progrok-4.6decision_correct-1.3%-3.7% to 0.8%6006000120
All providersdeepseek-v4-prokimi-k2.6fact_f10.9%-0.6% to 2.5%6005991120
All providersdeepseek-v4-prokimi-k2.6exact_world6.0%2.0% to 10.2%6005991120
All providersdeepseek-v4-prokimi-k2.6task_success6.0%2.0% to 10.2%6005991120
All providersdeepseek-v4-prokimi-k2.6decision_correct-2.5%-4.2% to -1.0%6005991120
All providersdeepseek-v4-prokimi-k3fact_f16.9%3.9% to 10.0%60044315796
All providersdeepseek-v4-prokimi-k3exact_world2.7%-2.6% to 8.0%60044315796
All providersdeepseek-v4-prokimi-k3task_success2.7%-2.6% to 8.0%60044315796
All providersdeepseek-v4-prokimi-k3decision_correct-4.3%-6.5% to -2.3%60044315796
All providersdeepseek-v4-promimo-v2.6-flashfact_f112.1%9.7% to 14.6%6005946120
All providersdeepseek-v4-promimo-v2.6-flashexact_world1.9%-2.2% to 6.0%6005946120
All providersdeepseek-v4-promimo-v2.6-flashtask_success3.5%-0.5% to 7.8%6005946120
All providersdeepseek-v4-promimo-v2.6-flashdecision_correct5.4%2.2% to 8.7%6005946120
All providersdeepseek-v4-promimo-v2.6-profact_f114.9%12.3% to 17.6%6006000120
All providersdeepseek-v4-promimo-v2.6-proexact_world3.5%-0.2% to 7.5%6006000120
All providersdeepseek-v4-promimo-v2.6-protask_success4.7%0.7% to 9.0%6006000120
All providersdeepseek-v4-promimo-v2.6-prodecision_correct6.8%3.3% to 10.3%6006000120
All providersdeepseek-v4-prominimax-m3fact_f123.0%19.8% to 26.3%6006000120
All providersdeepseek-v4-prominimax-m3exact_world8.8%5.0% to 12.7%6006000120
All providersdeepseek-v4-prominimax-m3task_success8.8%5.0% to 12.7%6006000120
All providersdeepseek-v4-prominimax-m3decision_correct-1.3%-3.5% to 0.7%6006000120
All providersdeepseek-v4-proqwen3.8-27bfact_f17.8%5.4% to 10.4%6006000120
All providersdeepseek-v4-proqwen3.8-27bexact_world9.0%4.7% to 13.5%6006000120
All providersdeepseek-v4-proqwen3.8-27btask_success9.0%4.7% to 13.5%6006000120
All providersdeepseek-v4-proqwen3.8-27bdecision_correct-1.7%-4.0% to 0.5%6006000120
All providersgemini-3.6-flashgemini-3.7-flashfact_f1-11.8%-14.1% to -9.6%6006000120
All providersgemini-3.6-flashgemini-3.7-flashexact_world-25.0%-29.8% to -20.2%6006000120
All providersgemini-3.6-flashgemini-3.7-flashtask_success-25.0%-29.8% to -20.2%6006000120
All providersgemini-3.6-flashgemini-3.7-flashdecision_correct-0.5%-1.2% to 0.0%6006000120
All providersgemini-3.6-flashgemini-3.8-flashfact_f1-7.0%-9.0% to -5.1%6005982120
All providersgemini-3.6-flashgemini-3.8-flashexact_world-15.6%-20.0% to -10.9%6005982120
All providersgemini-3.6-flashgemini-3.8-flashtask_success-15.6%-20.0% to -10.9%6005982120
All providersgemini-3.6-flashgemini-3.8-flashdecision_correct-0.7%-1.5% to 0.0%6005982120
All providersgemini-3.6-flashglm-4.7-flashfact_f113.3%10.2% to 16.4%60056634120
All providersgemini-3.6-flashglm-4.7-flashexact_world24.7%20.7% to 29.0%60056634120
All providersgemini-3.6-flashglm-4.7-flashtask_success24.7%20.7% to 29.0%60056634120
All providersgemini-3.6-flashglm-4.7-flashdecision_correct17.0%13.6% to 20.3%60056634120
All providersgemini-3.6-flashglm-5.3fact_f1-5.3%-8.3% to -2.3%60056436120
All providersgemini-3.6-flashglm-5.3exact_world-11.9%-17.2% to -6.9%60056436120
All providersgemini-3.6-flashglm-5.3task_success-11.7%-17.0% to -6.8%60056436120
All providersgemini-3.6-flashglm-5.3decision_correct2.7%0.7% to 4.5%60056436120
All providersgemini-3.6-flashglm-5.3-flashfact_f112.2%10.0% to 14.5%6005964120
All providersgemini-3.6-flashglm-5.3-flashexact_world17.4%13.1% to 22.0%6005964120
All providersgemini-3.6-flashglm-5.3-flashtask_success17.6%13.3% to 22.1%6005964120
All providersgemini-3.6-flashglm-5.3-flashdecision_correct0.7%-0.8% to 2.0%6005964120
All providersgemini-3.6-flashgpt-5.6-lunafact_f1-1.9%-4.9% to 1.3%6006000120
All providersgemini-3.6-flashgpt-5.6-lunaexact_world1.0%-4.0% to 6.3%6006000120
All providersgemini-3.6-flashgpt-5.6-lunatask_success2.0%-3.0% to 7.2%6006000120
All providersgemini-3.6-flashgpt-5.6-lunadecision_correct1.8%0.3% to 3.2%6006000120
All providersgemini-3.6-flashgpt-5.6-solfact_f1-11.5%-14.1% to -8.9%6006000120
All providersgemini-3.6-flashgpt-5.6-solexact_world-24.8%-30.8% to -18.5%6006000120
All providersgemini-3.6-flashgpt-5.6-soltask_success-24.8%-30.8% to -18.5%6006000120
All providersgemini-3.6-flashgpt-5.6-soldecision_correct-1.0%-2.2% to -0.2%6006000120
All providersgemini-3.6-flashgpt-5.6-terrafact_f1-2.3%-4.8% to 0.3%6006000120
All providersgemini-3.6-flashgpt-5.6-terraexact_world-7.0%-12.0% to -2.0%6006000120
All providersgemini-3.6-flashgpt-5.6-terratask_success-7.0%-12.0% to -2.0%6006000120
All providersgemini-3.6-flashgpt-5.6-terradecision_correct-0.8%-1.7% to -0.2%6006000120
All providersgemini-3.6-flashgpt-6-astrafact_f1-17.1%-19.8% to -14.3%60055050115
All providersgemini-3.6-flashgpt-6-astraexact_world-41.3%-47.5% to -34.4%60055050115
All providersgemini-3.6-flashgpt-6-astratask_success-41.3%-47.5% to -34.4%60055050115
All providersgemini-3.6-flashgpt-6-astradecision_correct-0.9%-1.9% to -0.2%60055050115
All providersgemini-3.6-flashgpt-6-lunafact_f1-2.0%-4.8% to 0.8%6006000120
All providersgemini-3.6-flashgpt-6-lunaexact_world1.2%-3.8% to 6.3%6006000120
All providersgemini-3.6-flashgpt-6-lunatask_success1.3%-3.7% to 6.5%6006000120
All providersgemini-3.6-flashgpt-6-lunadecision_correct0.7%-0.8% to 2.0%6006000120
All providersgemini-3.6-flashgpt-6-solfact_f1-17.2%-20.0% to -14.4%6006000120
All providersgemini-3.6-flashgpt-6-solexact_world-30.7%-36.7% to -24.2%6006000120
All providersgemini-3.6-flashgpt-6-soltask_success-30.5%-36.5% to -24.0%6006000120
All providersgemini-3.6-flashgpt-6-soldecision_correct0.5%-0.7% to 1.5%6006000120
All providersgemini-3.6-flashgrok-4.6fact_f1-10.0%-12.8% to -7.2%6006000120
All providersgemini-3.6-flashgrok-4.6exact_world6.7%1.2% to 12.2%6006000120
All providersgemini-3.6-flashgrok-4.6task_success6.7%1.2% to 12.2%6006000120
All providersgemini-3.6-flashgrok-4.6decision_correct2.3%1.0% to 4.0%6006000120
All providersgemini-3.6-flashkimi-k2.6fact_f1-11.1%-13.7% to -8.6%6005991120
All providersgemini-3.6-flashkimi-k2.6exact_world7.0%3.0% to 11.3%6005991120
All providersgemini-3.6-flashkimi-k2.6task_success7.0%3.0% to 11.3%6005991120
All providersgemini-3.6-flashkimi-k2.6decision_correct1.2%-0.3% to 2.8%6005991120
All providersgemini-3.6-flashkimi-k3fact_f1-1.1%-3.6% to 1.2%60044315796
All providersgemini-3.6-flashkimi-k3exact_world5.0%-0.2% to 10.2%60044315796
All providersgemini-3.6-flashkimi-k3task_success5.0%-0.2% to 10.2%60044315796
All providersgemini-3.6-flashkimi-k3decision_correct-0.9%-2.1% to 0.0%60044315796
All providersgemini-3.6-flashmimo-v2.6-flashfact_f10.0%-2.4% to 2.3%6005946120
All providersgemini-3.6-flashmimo-v2.6-flashexact_world2.7%-1.3% to 6.7%6005946120
All providersgemini-3.6-flashmimo-v2.6-flashtask_success4.4%0.5% to 8.4%6005946120
All providersgemini-3.6-flashmimo-v2.6-flashdecision_correct9.1%6.4% to 12.1%6005946120
All providersgemini-3.6-flashmimo-v2.6-profact_f12.9%0.4% to 5.6%6006000120
All providersgemini-3.6-flashmimo-v2.6-proexact_world4.5%0.0% to 9.0%6006000120
All providersgemini-3.6-flashmimo-v2.6-protask_success5.7%1.3% to 10.3%6006000120
All providersgemini-3.6-flashmimo-v2.6-prodecision_correct10.5%7.5% to 13.7%6006000120
All providersgemini-3.6-flashminimax-m3fact_f111.0%7.9% to 14.2%6006000120
All providersgemini-3.6-flashminimax-m3exact_world9.8%5.0% to 14.7%6006000120
All providersgemini-3.6-flashminimax-m3task_success9.8%5.0% to 14.7%6006000120
All providersgemini-3.6-flashminimax-m3decision_correct2.3%0.8% to 3.8%6006000120
All providersgemini-3.6-flashqwen3.8-27bfact_f1-4.1%-6.6% to -1.7%6006000120
All providersgemini-3.6-flashqwen3.8-27bexact_world10.0%5.7% to 14.3%6006000120
All providersgemini-3.6-flashqwen3.8-27btask_success10.0%5.7% to 14.3%6006000120
All providersgemini-3.6-flashqwen3.8-27bdecision_correct2.0%0.7% to 3.7%6006000120
All providersgemini-3.7-flashgemini-3.8-flashfact_f14.8%3.3% to 6.4%6005982120
All providersgemini-3.7-flashgemini-3.8-flashexact_world9.7%5.7% to 13.5%6005982120
All providersgemini-3.7-flashgemini-3.8-flashtask_success9.7%5.7% to 13.5%6005982120
All providersgemini-3.7-flashgemini-3.8-flashdecision_correct-0.2%-0.5% to 0.0%6005982120
All providersgemini-3.7-flashglm-4.7-flashfact_f124.9%22.3% to 27.6%60056634120
All providersgemini-3.7-flashglm-4.7-flashexact_world49.5%45.1% to 53.9%60056634120
All providersgemini-3.7-flashglm-4.7-flashtask_success49.5%45.1% to 53.9%60056634120
All providersgemini-3.7-flashglm-4.7-flashdecision_correct17.3%14.0% to 20.6%60056634120
All providersgemini-3.7-flashglm-5.3fact_f16.1%3.4% to 8.9%60056436120
All providersgemini-3.7-flashglm-5.3exact_world11.7%6.0% to 16.9%60056436120
All providersgemini-3.7-flashglm-5.3task_success11.9%6.2% to 17.1%60056436120
All providersgemini-3.7-flashglm-5.3decision_correct3.2%1.6% to 5.0%60056436120
All providersgemini-3.7-flashglm-5.3-flashfact_f124.1%21.2% to 27.1%6005964120
All providersgemini-3.7-flashglm-5.3-flashexact_world42.6%38.3% to 47.2%6005964120
All providersgemini-3.7-flashglm-5.3-flashtask_success42.8%38.4% to 47.3%6005964120
All providersgemini-3.7-flashglm-5.3-flashdecision_correct1.2%-0.2% to 2.5%6005964120
All providersgemini-3.7-flashgpt-5.6-lunafact_f19.9%7.4% to 12.6%6006000120
All providersgemini-3.7-flashgpt-5.6-lunaexact_world26.0%20.8% to 31.3%6006000120
All providersgemini-3.7-flashgpt-5.6-lunatask_success27.0%21.8% to 32.3%6006000120
All providersgemini-3.7-flashgpt-5.6-lunadecision_correct2.3%1.2% to 3.7%6006000120
All providersgemini-3.7-flashgpt-5.6-solfact_f10.3%-1.7% to 2.3%6006000120
All providersgemini-3.7-flashgpt-5.6-solexact_world0.2%-5.7% to 6.5%6006000120
All providersgemini-3.7-flashgpt-5.6-soltask_success0.2%-5.7% to 6.5%6006000120
All providersgemini-3.7-flashgpt-5.6-soldecision_correct-0.5%-1.3% to 0.0%6006000120
All providersgemini-3.7-flashgpt-5.6-terrafact_f19.6%7.5% to 11.8%6006000120
All providersgemini-3.7-flashgpt-5.6-terraexact_world18.0%13.3% to 22.7%6006000120
All providersgemini-3.7-flashgpt-5.6-terratask_success18.0%13.3% to 22.7%6006000120
All providersgemini-3.7-flashgpt-5.6-terradecision_correct-0.3%-0.8% to 0.0%6006000120
All providersgemini-3.7-flashgpt-6-astrafact_f1-6.6%-8.3% to -4.8%60055050115
All providersgemini-3.7-flashgpt-6-astraexact_world-18.0%-23.7% to -12.0%60055050115
All providersgemini-3.7-flashgpt-6-astratask_success-18.0%-23.7% to -12.0%60055050115
All providersgemini-3.7-flashgpt-6-astradecision_correct-0.4%-0.9% to 0.0%60055050115
All providersgemini-3.7-flashgpt-6-lunafact_f19.8%7.5% to 12.2%6006000120
All providersgemini-3.7-flashgpt-6-lunaexact_world26.2%21.2% to 31.2%6006000120
All providersgemini-3.7-flashgpt-6-lunatask_success26.3%21.3% to 31.3%6006000120
All providersgemini-3.7-flashgpt-6-lunadecision_correct1.2%0.0% to 2.3%6006000120
All providersgemini-3.7-flashgpt-6-solfact_f1-5.3%-7.3% to -3.3%6006000120
All providersgemini-3.7-flashgpt-6-solexact_world-5.7%-11.5% to 0.0%6006000120
All providersgemini-3.7-flashgpt-6-soltask_success-5.5%-11.3% to 0.2%6006000120
All providersgemini-3.7-flashgpt-6-soldecision_correct1.0%0.2% to 2.0%6006000120
All providersgemini-3.7-flashgrok-4.6fact_f11.8%0.0% to 3.7%6006000120
All providersgemini-3.7-flashgrok-4.6exact_world31.7%27.0% to 36.3%6006000120
All providersgemini-3.7-flashgrok-4.6task_success31.7%27.0% to 36.3%6006000120
All providersgemini-3.7-flashgrok-4.6decision_correct2.8%1.2% to 4.7%6006000120
All providersgemini-3.7-flashkimi-k2.6fact_f10.7%-1.1% to 2.6%6005991120
All providersgemini-3.7-flashkimi-k2.6exact_world32.1%27.7% to 36.6%6005991120
All providersgemini-3.7-flashkimi-k2.6task_success32.1%27.7% to 36.6%6005991120
All providersgemini-3.7-flashkimi-k2.6decision_correct1.7%0.3% to 3.2%6005991120
All providersgemini-3.7-flashkimi-k3fact_f18.3%5.9% to 10.7%60044315796
All providersgemini-3.7-flashkimi-k3exact_world29.1%23.7% to 34.5%60044315796
All providersgemini-3.7-flashkimi-k3task_success29.1%23.7% to 34.5%60044315796
All providersgemini-3.7-flashkimi-k3decision_correct-0.5%-1.1% to 0.0%60044315796
All providersgemini-3.7-flashmimo-v2.6-flashfact_f111.9%9.8% to 14.0%6005946120
All providersgemini-3.7-flashmimo-v2.6-flashexact_world27.6%22.7% to 32.5%6005946120
All providersgemini-3.7-flashmimo-v2.6-flashtask_success29.3%24.6% to 34.0%6005946120
All providersgemini-3.7-flashmimo-v2.6-flashdecision_correct9.6%7.0% to 12.5%6005946120
All providersgemini-3.7-flashmimo-v2.6-profact_f114.7%12.4% to 17.1%6006000120
All providersgemini-3.7-flashmimo-v2.6-proexact_world29.5%24.8% to 34.5%6006000120
All providersgemini-3.7-flashmimo-v2.6-protask_success30.7%25.8% to 35.8%6006000120
All providersgemini-3.7-flashmimo-v2.6-prodecision_correct11.0%8.0% to 14.0%6006000120
All providersgemini-3.7-flashminimax-m3fact_f122.9%19.9% to 25.8%6006000120
All providersgemini-3.7-flashminimax-m3exact_world34.8%30.7% to 39.2%6006000120
All providersgemini-3.7-flashminimax-m3task_success34.8%30.7% to 39.2%6006000120
All providersgemini-3.7-flashminimax-m3decision_correct2.8%1.5% to 4.3%6006000120
All providersgemini-3.7-flashqwen3.8-27bfact_f17.7%5.8% to 9.7%6006000120
All providersgemini-3.7-flashqwen3.8-27bexact_world35.0%30.7% to 39.3%6006000120
All providersgemini-3.7-flashqwen3.8-27btask_success35.0%30.7% to 39.3%6006000120
All providersgemini-3.7-flashqwen3.8-27bdecision_correct2.5%1.2% to 4.0%6006000120
All providersgemini-3.8-flashglm-4.7-flashfact_f120.5%17.7% to 23.5%60056436120
All providersgemini-3.8-flashglm-4.7-flashexact_world40.2%35.6% to 45.1%60056436120
All providersgemini-3.8-flashglm-4.7-flashtask_success40.2%35.6% to 45.1%60056436120
All providersgemini-3.8-flashglm-4.7-flashdecision_correct17.4%14.1% to 20.7%60056436120
All providersgemini-3.8-flashglm-5.3fact_f11.3%-1.4% to 3.9%60056238120
All providersgemini-3.8-flashglm-5.3exact_world2.7%-3.0% to 8.3%60056238120
All providersgemini-3.8-flashglm-5.3task_success2.8%-2.9% to 8.6%60056238120
All providersgemini-3.8-flashglm-5.3decision_correct3.4%1.8% to 5.0%60056238120
All providersgemini-3.8-flashglm-5.3-flashfact_f119.2%16.7% to 21.8%6005946120
All providersgemini-3.8-flashglm-5.3-flashexact_world33.0%28.3% to 37.8%6005946120
All providersgemini-3.8-flashglm-5.3-flashtask_success33.2%28.6% to 37.9%6005946120
All providersgemini-3.8-flashglm-5.3-flashdecision_correct1.3%0.3% to 2.5%6005946120
All providersgemini-3.8-flashgpt-5.6-lunafact_f15.1%2.7% to 7.6%6005982120
All providersgemini-3.8-flashgpt-5.6-lunaexact_world16.6%11.4% to 21.9%6005982120
All providersgemini-3.8-flashgpt-5.6-lunatask_success17.6%12.5% to 22.9%6005982120
All providersgemini-3.8-flashgpt-5.6-lunadecision_correct2.5%1.3% to 3.8%6005982120
All providersgemini-3.8-flashgpt-5.6-solfact_f1-4.6%-6.5% to -2.5%6005982120
All providersgemini-3.8-flashgpt-5.6-solexact_world-9.4%-15.2% to -2.8%6005982120
All providersgemini-3.8-flashgpt-5.6-soltask_success-9.4%-15.2% to -2.8%6005982120
All providersgemini-3.8-flashgpt-5.6-soldecision_correct-0.3%-0.8% to 0.0%6005982120
All providersgemini-3.8-flashgpt-5.6-terrafact_f14.7%2.5% to 6.8%6005982120
All providersgemini-3.8-flashgpt-5.6-terraexact_world8.5%3.7% to 13.4%6005982120
All providersgemini-3.8-flashgpt-5.6-terratask_success8.5%3.7% to 13.4%6005982120
All providersgemini-3.8-flashgpt-5.6-terradecision_correct-0.2%-0.5% to 0.0%6005982120
All providersgemini-3.8-flashgpt-6-astrafact_f1-11.2%-13.3% to -9.0%60054852115
All providersgemini-3.8-flashgpt-6-astraexact_world-26.5%-32.2% to -20.6%60054852115
All providersgemini-3.8-flashgpt-6-astratask_success-26.5%-32.2% to -20.6%60054852115
All providersgemini-3.8-flashgpt-6-astradecision_correct-0.4%-0.9% to 0.0%60054852115
All providersgemini-3.8-flashgpt-6-lunafact_f15.0%2.6% to 7.3%6005982120
All providersgemini-3.8-flashgpt-6-lunaexact_world16.6%11.5% to 21.8%6005982120
All providersgemini-3.8-flashgpt-6-lunatask_success16.7%11.7% to 21.9%6005982120
All providersgemini-3.8-flashgpt-6-lunadecision_correct1.3%0.3% to 2.3%6005982120
All providersgemini-3.8-flashgpt-6-solfact_f1-10.1%-12.4% to -7.8%6005982120
All providersgemini-3.8-flashgpt-6-solexact_world-15.2%-21.0% to -9.4%6005982120
All providersgemini-3.8-flashgpt-6-soltask_success-15.1%-20.7% to -9.2%6005982120
All providersgemini-3.8-flashgpt-6-soldecision_correct1.2%0.3% to 2.2%6005982120
All providersgemini-3.8-flashgrok-4.6fact_f1-2.9%-5.2% to -0.7%6005982120
All providersgemini-3.8-flashgrok-4.6exact_world22.1%16.7% to 27.4%6005982120
All providersgemini-3.8-flashgrok-4.6task_success22.1%16.7% to 27.4%6005982120
All providersgemini-3.8-flashgrok-4.6decision_correct3.0%1.3% to 5.0%6005982120
All providersgemini-3.8-flashkimi-k2.6fact_f1-4.1%-6.1% to -2.1%6005973120
All providersgemini-3.8-flashkimi-k2.6exact_world22.6%18.2% to 27.1%6005973120
All providersgemini-3.8-flashkimi-k2.6task_success22.6%18.2% to 27.1%6005973120
All providersgemini-3.8-flashkimi-k2.6decision_correct1.8%0.7% to 3.3%6005973120
All providersgemini-3.8-flashkimi-k3fact_f14.3%2.2% to 6.7%60044115996
All providersgemini-3.8-flashkimi-k3exact_world19.7%14.3% to 25.1%60044115996
All providersgemini-3.8-flashkimi-k3task_success19.7%14.3% to 25.1%60044115996
All providersgemini-3.8-flashkimi-k3decision_correct-0.2%-0.7% to 0.0%60044115996
All providersgemini-3.8-flashmimo-v2.6-flashfact_f17.0%5.2% to 8.8%6005928120
All providersgemini-3.8-flashmimo-v2.6-flashexact_world18.2%13.8% to 22.7%6005928120
All providersgemini-3.8-flashmimo-v2.6-flashtask_success19.9%15.5% to 24.4%6005928120
All providersgemini-3.8-flashmimo-v2.6-flashdecision_correct9.8%7.2% to 12.6%6005928120
All providersgemini-3.8-flashmimo-v2.6-profact_f110.0%7.6% to 12.4%6005982120
All providersgemini-3.8-flashmimo-v2.6-proexact_world20.2%15.7% to 24.9%6005982120
All providersgemini-3.8-flashmimo-v2.6-protask_success21.4%16.8% to 26.1%6005982120
All providersgemini-3.8-flashmimo-v2.6-prodecision_correct11.2%8.4% to 14.2%6005982120
All providersgemini-3.8-flashminimax-m3fact_f118.1%15.3% to 20.9%6005982120
All providersgemini-3.8-flashminimax-m3exact_world25.4%21.2% to 29.9%6005982120
All providersgemini-3.8-flashminimax-m3task_success25.4%21.2% to 29.9%6005982120
All providersgemini-3.8-flashminimax-m3decision_correct3.0%1.7% to 4.5%6005982120
All providersgemini-3.8-flashqwen3.8-27bfact_f12.9%1.0% to 5.0%6005982120
All providersgemini-3.8-flashqwen3.8-27bexact_world25.4%20.7% to 30.4%6005982120
All providersgemini-3.8-flashqwen3.8-27btask_success25.4%20.7% to 30.4%6005982120
All providersgemini-3.8-flashqwen3.8-27bdecision_correct2.7%1.3% to 4.3%6005982120
All providersglm-4.7-flashglm-5.3fact_f1-17.8%-20.9% to -14.4%60053169120
All providersglm-4.7-flashglm-5.3exact_world-36.0%-40.5% to -31.6%60053169120
All providersglm-4.7-flashglm-5.3task_success-35.8%-40.3% to -31.4%60053169120
All providersglm-4.7-flashglm-5.3decision_correct-13.4%-17.3% to -9.4%60053169120
All providersglm-4.7-flashglm-5.3-flashfact_f1-0.5%-4.1% to 2.9%60056238120
All providersglm-4.7-flashglm-5.3-flashexact_world-6.8%-10.1% to -3.6%60056238120
All providersglm-4.7-flashglm-5.3-flashtask_success-6.6%-9.9% to -3.4%60056238120
All providersglm-4.7-flashglm-5.3-flashdecision_correct-15.7%-19.1% to -12.1%60056238120
All providersglm-4.7-flashgpt-5.6-lunafact_f1-14.3%-17.6% to -10.9%60056634120
All providersglm-4.7-flashgpt-5.6-lunaexact_world-23.3%-27.3% to -19.4%60056634120
All providersglm-4.7-flashgpt-5.6-lunatask_success-22.3%-26.2% to -18.4%60056634120
All providersglm-4.7-flashgpt-5.6-lunadecision_correct-15.2%-18.7% to -11.9%60056634120
All providersglm-4.7-flashgpt-5.6-solfact_f1-24.1%-27.2% to -21.1%60056634120
All providersglm-4.7-flashgpt-5.6-solexact_world-47.9%-52.8% to -42.6%60056634120
All providersglm-4.7-flashgpt-5.6-soltask_success-47.9%-52.8% to -42.6%60056634120
All providersglm-4.7-flashgpt-5.6-soldecision_correct-17.5%-20.9% to -14.2%60056634120
All providersglm-4.7-flashgpt-5.6-terrafact_f1-15.1%-18.4% to -11.9%60056634120
All providersglm-4.7-flashgpt-5.6-terraexact_world-31.6%-36.1% to -27.3%60056634120
All providersglm-4.7-flashgpt-5.6-terratask_success-31.6%-36.1% to -27.3%60056634120
All providersglm-4.7-flashgpt-5.6-terradecision_correct-17.5%-20.9% to -14.2%60056634120
All providersglm-4.7-flashgpt-6-astrafact_f1-30.2%-33.0% to -27.4%60052080115
All providersglm-4.7-flashgpt-6-astraexact_world-65.6%-70.4% to -60.3%60052080115
All providersglm-4.7-flashgpt-6-astratask_success-65.6%-70.4% to -60.3%60052080115
All providersglm-4.7-flashgpt-6-astradecision_correct-17.9%-21.6% to -14.5%60052080115
All providersglm-4.7-flashgpt-6-lunafact_f1-15.2%-18.5% to -11.9%60056634120
All providersglm-4.7-flashgpt-6-lunaexact_world-23.1%-27.2% to -19.2%60056634120
All providersglm-4.7-flashgpt-6-lunatask_success-23.0%-27.0% to -19.2%60056634120
All providersglm-4.7-flashgpt-6-lunadecision_correct-15.9%-19.4% to -12.5%60056634120
All providersglm-4.7-flashgpt-6-solfact_f1-29.5%-32.4% to -26.5%60056634120
All providersglm-4.7-flashgpt-6-solexact_world-53.5%-58.6% to -48.3%60056634120
All providersglm-4.7-flashgpt-6-soltask_success-53.5%-58.6% to -48.3%60056634120
All providersglm-4.7-flashgpt-6-soldecision_correct-16.3%-19.5% to -13.0%60056634120
All providersglm-4.7-flashgrok-4.6fact_f1-22.6%-25.4% to -19.7%60056634120
All providersglm-4.7-flashgrok-4.6exact_world-17.5%-22.1% to -13.0%60056634120
All providersglm-4.7-flashgrok-4.6task_success-17.5%-22.1% to -13.0%60056634120
All providersglm-4.7-flashgrok-4.6decision_correct-14.5%-18.0% to -10.7%60056634120
All providersglm-4.7-flashkimi-k2.6fact_f1-23.8%-26.6% to -20.9%60056535120
All providersglm-4.7-flashkimi-k2.6exact_world-17.2%-21.1% to -13.4%60056535120
All providersglm-4.7-flashkimi-k2.6task_success-17.2%-21.1% to -13.4%60056535120
All providersglm-4.7-flashkimi-k2.6decision_correct-15.4%-18.9% to -12.1%60056535120
All providersglm-4.7-flashkimi-k3fact_f1-16.0%-20.3% to -12.0%60041718396
All providersglm-4.7-flashkimi-k3exact_world-21.6%-26.5% to -16.5%60041718396
All providersglm-4.7-flashkimi-k3task_success-21.6%-26.5% to -16.5%60041718396
All providersglm-4.7-flashkimi-k3decision_correct-18.0%-22.2% to -14.0%60041718396
All providersglm-4.7-flashmimo-v2.6-flashfact_f1-12.9%-16.0% to -9.8%60056139120
All providersglm-4.7-flashmimo-v2.6-flashexact_world-21.2%-25.4% to -17.5%60056139120
All providersglm-4.7-flashmimo-v2.6-flashtask_success-19.4%-23.5% to -15.8%60056139120
All providersglm-4.7-flashmimo-v2.6-flashdecision_correct-8.4%-12.4% to -4.5%60056139120
All providersglm-4.7-flashmimo-v2.6-profact_f1-10.0%-13.3% to -6.8%60056634120
All providersglm-4.7-flashmimo-v2.6-proexact_world-19.6%-23.7% to -15.7%60056634120
All providersglm-4.7-flashmimo-v2.6-protask_success-18.4%-22.6% to -14.2%60056634120
All providersglm-4.7-flashmimo-v2.6-prodecision_correct-6.4%-11.1% to -1.7%60056634120
All providersglm-4.7-flashminimax-m3fact_f1-2.2%-6.1% to 1.5%60056634120
All providersglm-4.7-flashminimax-m3exact_world-14.3%-18.1% to -10.6%60056634120
All providersglm-4.7-flashminimax-m3task_success-14.3%-18.1% to -10.6%60056634120
All providersglm-4.7-flashminimax-m3decision_correct-14.8%-18.3% to -11.4%60056634120
All providersglm-4.7-flashqwen3.8-27bfact_f1-16.8%-19.6% to -13.9%60056634120
All providersglm-4.7-flashqwen3.8-27bexact_world-14.1%-18.3% to -10.2%60056634120
All providersglm-4.7-flashqwen3.8-27btask_success-14.1%-18.3% to -10.2%60056634120
All providersglm-4.7-flashqwen3.8-27bdecision_correct-15.0%-18.5% to -11.5%60056634120
All providersglm-5.3glm-5.3-flashfact_f117.3%14.4% to 20.3%60056040120
All providersglm-5.3glm-5.3-flashexact_world29.1%24.6% to 34.2%60056040120
All providersglm-5.3glm-5.3-flashtask_success29.1%24.6% to 34.1%60056040120
All providersglm-5.3glm-5.3-flashdecision_correct-2.0%-4.1% to 0.0%60056040120
All providersglm-5.3gpt-5.6-lunafact_f13.5%0.3% to 7.0%60056436120
All providersglm-5.3gpt-5.6-lunaexact_world13.1%7.8% to 18.5%60056436120
All providersglm-5.3gpt-5.6-lunatask_success14.0%8.8% to 19.4%60056436120
All providersglm-5.3gpt-5.6-lunadecision_correct-0.7%-2.7% to 1.2%60056436120
All providersglm-5.3gpt-5.6-solfact_f1-5.9%-8.7% to -3.2%60056436120
All providersglm-5.3gpt-5.6-solexact_world-11.7%-17.4% to -5.2%60056436120
All providersglm-5.3gpt-5.6-soltask_success-11.9%-17.6% to -5.3%60056436120
All providersglm-5.3gpt-5.6-soldecision_correct-3.7%-5.4% to -2.3%60056436120
All providersglm-5.3gpt-5.6-terrafact_f13.4%0.3% to 6.4%60056436120
All providersglm-5.3gpt-5.6-terraexact_world5.3%0.4% to 10.5%60056436120
All providersglm-5.3gpt-5.6-terratask_success5.1%0.2% to 10.4%60056436120
All providersglm-5.3gpt-5.6-terradecision_correct-3.5%-5.2% to -2.0%60056436120
All providersglm-5.3gpt-6-astrafact_f1-12.0%-15.0% to -9.0%60051783115
All providersglm-5.3gpt-6-astraexact_world-28.8%-35.1% to -21.9%60051783115
All providersglm-5.3gpt-6-astratask_success-29.0%-35.3% to -22.1%60051783115
All providersglm-5.3gpt-6-astradecision_correct-3.7%-5.4% to -2.1%60051783115
All providersglm-5.3gpt-6-lunafact_f13.5%0.1% to 6.7%60056436120
All providersglm-5.3gpt-6-lunaexact_world14.0%8.7% to 19.5%60056436120
All providersglm-5.3gpt-6-lunatask_success14.0%8.7% to 19.7%60056436120
All providersglm-5.3gpt-6-lunadecision_correct-2.3%-4.0% to -0.7%60056436120
All providersglm-5.3gpt-6-solfact_f1-11.5%-14.6% to -8.5%60056436120
All providersglm-5.3gpt-6-solexact_world-18.4%-24.0% to -12.5%60056436120
All providersglm-5.3gpt-6-soltask_success-18.4%-23.9% to -12.5%60056436120
All providersglm-5.3gpt-6-soldecision_correct-2.3%-4.0% to -0.7%60056436120
All providersglm-5.3grok-4.6fact_f1-4.4%-7.5% to -1.5%60056436120
All providersglm-5.3grok-4.6exact_world18.8%12.9% to 24.9%60056436120
All providersglm-5.3grok-4.6task_success18.6%12.8% to 24.6%60056436120
All providersglm-5.3grok-4.6decision_correct-0.4%-2.7% to 2.1%60056436120
All providersglm-5.3kimi-k2.6fact_f1-5.5%-8.3% to -2.8%60056337120
All providersglm-5.3kimi-k2.6exact_world18.7%13.4% to 24.2%60056337120
All providersglm-5.3kimi-k2.6task_success18.5%13.1% to 24.1%60056337120
All providersglm-5.3kimi-k2.6decision_correct-1.6%-3.6% to 0.2%60056337120
All providersglm-5.3kimi-k3fact_f14.0%1.6% to 6.7%60041918194
All providersglm-5.3kimi-k3exact_world17.2%12.0% to 23.0%60041918194
All providersglm-5.3kimi-k3task_success16.9%11.7% to 22.7%60041918194
All providersglm-5.3kimi-k3decision_correct-3.3%-5.4% to -1.7%60041918194
All providersglm-5.3mimo-v2.6-flashfact_f15.8%2.7% to 8.9%60055941120
All providersglm-5.3mimo-v2.6-flashexact_world15.0%10.1% to 20.0%60055941120
All providersglm-5.3mimo-v2.6-flashtask_success16.6%11.7% to 21.6%60055941120
All providersglm-5.3mimo-v2.6-flashdecision_correct6.4%3.5% to 9.6%60055941120
All providersglm-5.3mimo-v2.6-profact_f17.9%5.1% to 10.9%60056436120
All providersglm-5.3mimo-v2.6-proexact_world16.3%11.7% to 21.5%60056436120
All providersglm-5.3mimo-v2.6-protask_success17.0%12.2% to 22.3%60056436120
All providersglm-5.3mimo-v2.6-prodecision_correct7.4%4.4% to 10.6%60056436120
All providersglm-5.3minimax-m3fact_f116.6%12.9% to 20.6%60056436120
All providersglm-5.3minimax-m3exact_world22.7%18.1% to 27.7%60056436120
All providersglm-5.3minimax-m3task_success22.5%17.9% to 27.5%60056436120
All providersglm-5.3minimax-m3decision_correct-0.5%-2.5% to 1.4%60056436120
All providersglm-5.3qwen3.8-27bfact_f11.2%-1.9% to 4.3%60056436120
All providersglm-5.3qwen3.8-27bexact_world21.5%16.6% to 26.6%60056436120
All providersglm-5.3qwen3.8-27btask_success21.3%16.4% to 26.5%60056436120
All providersglm-5.3qwen3.8-27bdecision_correct-0.5%-2.9% to 1.9%60056436120
All providersglm-5.3-flashgpt-5.6-lunafact_f1-14.2%-17.6% to -10.4%6005964120
All providersglm-5.3-flashgpt-5.6-lunaexact_world-16.6%-20.9% to -12.4%6005964120
All providersglm-5.3-flashgpt-5.6-lunatask_success-15.8%-20.1% to -11.5%6005964120
All providersglm-5.3-flashgpt-5.6-lunadecision_correct1.2%-0.5% to 2.9%6005964120
All providersglm-5.3-flashgpt-5.6-solfact_f1-23.9%-27.0% to -20.9%6005964120
All providersglm-5.3-flashgpt-5.6-solexact_world-42.6%-47.8% to -37.4%6005964120
All providersglm-5.3-flashgpt-5.6-soltask_success-42.8%-48.0% to -37.6%6005964120
All providersglm-5.3-flashgpt-5.6-soldecision_correct-1.7%-2.7% to -0.8%6005964120
All providersglm-5.3-flashgpt-5.6-terrafact_f1-14.5%-17.7% to -11.5%6005964120
All providersglm-5.3-flashgpt-5.6-terraexact_world-24.3%-28.7% to -19.9%6005964120
All providersglm-5.3-flashgpt-5.6-terratask_success-24.5%-28.9% to -20.1%6005964120
All providersglm-5.3-flashgpt-5.6-terradecision_correct-1.5%-2.7% to -0.5%6005964120
All providersglm-5.3-flashgpt-6-astrafact_f1-29.3%-32.7% to -25.8%60054654115
All providersglm-5.3-flashgpt-6-astraexact_world-60.3%-65.2% to -55.0%60054654115
All providersglm-5.3-flashgpt-6-astratask_success-60.3%-65.2% to -55.0%60054654115
All providersglm-5.3-flashgpt-6-astradecision_correct-1.6%-2.8% to -0.7%60054654115
All providersglm-5.3-flashgpt-6-lunafact_f1-14.2%-17.5% to -10.9%6005964120
All providersglm-5.3-flashgpt-6-lunaexact_world-16.4%-20.8% to -12.4%6005964120
All providersglm-5.3-flashgpt-6-lunatask_success-16.4%-20.6% to -12.4%6005964120
All providersglm-5.3-flashgpt-6-lunadecision_correct0.0%-1.3% to 1.3%6005964120
All providersglm-5.3-flashgpt-6-solfact_f1-29.5%-33.0% to -25.9%6005964120
All providersglm-5.3-flashgpt-6-solexact_world-48.3%-53.4% to -43.0%6005964120
All providersglm-5.3-flashgpt-6-soltask_success-48.3%-53.4% to -43.0%6005964120
All providersglm-5.3-flashgpt-6-soldecision_correct-0.2%-1.7% to 1.3%6005964120
All providersglm-5.3-flashgrok-4.6fact_f1-22.3%-25.7% to -19.0%6005964120
All providersglm-5.3-flashgrok-4.6exact_world-10.9%-15.5% to -6.7%6005964120
All providersglm-5.3-flashgrok-4.6task_success-11.1%-15.7% to -6.9%6005964120
All providersglm-5.3-flashgrok-4.6decision_correct1.7%-0.7% to 4.2%6005964120
All providersglm-5.3-flashkimi-k2.6fact_f1-23.3%-26.5% to -20.2%6005955120
All providersglm-5.3-flashkimi-k2.6exact_world-10.6%-14.8% to -6.4%6005955120
All providersglm-5.3-flashkimi-k2.6task_success-10.8%-15.0% to -6.5%6005955120
All providersglm-5.3-flashkimi-k2.6decision_correct0.5%-1.2% to 2.2%6005955120
All providersglm-5.3-flashkimi-k3fact_f1-11.5%-14.5% to -8.6%60043916196
All providersglm-5.3-flashkimi-k3exact_world-13.7%-18.0% to -9.2%60043916196
All providersglm-5.3-flashkimi-k3task_success-13.7%-18.0% to -9.2%60043916196
All providersglm-5.3-flashkimi-k3decision_correct-1.1%-2.4% to 0.0%60043916196
All providersglm-5.3-flashmimo-v2.6-flashfact_f1-12.3%-15.2% to -9.5%60059010120
All providersglm-5.3-flashmimo-v2.6-flashexact_world-15.1%-18.8% to -11.7%60059010120
All providersglm-5.3-flashmimo-v2.6-flashtask_success-13.6%-17.2% to -10.3%60059010120
All providersglm-5.3-flashmimo-v2.6-flashdecision_correct8.3%5.6% to 11.2%60059010120
All providersglm-5.3-flashmimo-v2.6-profact_f1-9.3%-11.8% to -6.8%6005964120
All providersglm-5.3-flashmimo-v2.6-proexact_world-12.8%-16.1% to -9.4%6005964120
All providersglm-5.3-flashmimo-v2.6-protask_success-11.7%-15.2% to -8.1%6005964120
All providersglm-5.3-flashmimo-v2.6-prodecision_correct9.9%7.0% to 13.1%6005964120
All providersglm-5.3-flashminimax-m3fact_f1-1.2%-4.3% to 2.1%6005964120
All providersglm-5.3-flashminimax-m3exact_world-7.9%-11.4% to -4.4%6005964120
All providersglm-5.3-flashminimax-m3task_success-8.1%-11.7% to -4.5%6005964120
All providersglm-5.3-flashminimax-m3decision_correct1.7%-0.2% to 3.7%6005964120
All providersglm-5.3-flashqwen3.8-27bfact_f1-16.5%-19.5% to -13.4%6005964120
All providersglm-5.3-flashqwen3.8-27bexact_world-7.7%-11.6% to -4.0%6005964120
All providersglm-5.3-flashqwen3.8-27btask_success-7.9%-11.9% to -4.2%6005964120
All providersglm-5.3-flashqwen3.8-27bdecision_correct1.3%-0.7% to 3.5%6005964120
All providersgpt-5.6-lunagpt-5.6-solfact_f1-9.6%-12.0% to -7.4%6006000120
All providersgpt-5.6-lunagpt-5.6-solexact_world-25.8%-30.3% to -21.3%6006000120
All providersgpt-5.6-lunagpt-5.6-soltask_success-26.8%-31.3% to -22.2%6006000120
All providersgpt-5.6-lunagpt-5.6-soldecision_correct-2.8%-4.3% to -1.5%6006000120
All providersgpt-5.6-lunagpt-5.6-terrafact_f1-0.4%-3.1% to 2.1%6006000120
All providersgpt-5.6-lunagpt-5.6-terraexact_world-8.0%-12.5% to -3.8%6006000120
All providersgpt-5.6-lunagpt-5.6-terratask_success-9.0%-13.3% to -5.0%6006000120
All providersgpt-5.6-lunagpt-5.6-terradecision_correct-2.7%-4.2% to -1.5%6006000120
All providersgpt-5.6-lunagpt-6-astrafact_f1-17.0%-19.1% to -14.9%60055050115
All providersgpt-5.6-lunagpt-6-astraexact_world-44.0%-48.8% to -39.1%60055050115
All providersgpt-5.6-lunagpt-6-astratask_success-44.7%-49.6% to -39.8%60055050115
All providersgpt-5.6-lunagpt-6-astradecision_correct-2.4%-3.7% to -1.1%60055050115
All providersgpt-5.6-lunagpt-6-lunafact_f1-0.1%-2.8% to 2.5%6006000120
All providersgpt-5.6-lunagpt-6-lunaexact_world0.2%-4.0% to 4.3%6006000120
All providersgpt-5.6-lunagpt-6-lunatask_success-0.7%-4.8% to 3.5%6006000120
All providersgpt-5.6-lunagpt-6-lunadecision_correct-1.2%-2.7% to 0.3%6006000120
All providersgpt-5.6-lunagpt-6-solfact_f1-15.3%-17.5% to -13.1%6006000120
All providersgpt-5.6-lunagpt-6-solexact_world-31.7%-36.5% to -26.7%6006000120
All providersgpt-5.6-lunagpt-6-soltask_success-32.5%-37.5% to -27.3%6006000120
All providersgpt-5.6-lunagpt-6-soldecision_correct-1.3%-2.7% to -0.2%6006000120
All providersgpt-5.6-lunagrok-4.6fact_f1-8.1%-10.4% to -5.8%6006000120
All providersgpt-5.6-lunagrok-4.6exact_world5.7%0.7% to 10.7%6006000120
All providersgpt-5.6-lunagrok-4.6task_success4.7%-0.5% to 9.5%6006000120
All providersgpt-5.6-lunagrok-4.6decision_correct0.5%-1.5% to 2.5%6006000120
All providersgpt-5.6-lunakimi-k2.6fact_f1-9.2%-11.3% to -7.1%6005991120
All providersgpt-5.6-lunakimi-k2.6exact_world6.2%1.5% to 10.7%6005991120
All providersgpt-5.6-lunakimi-k2.6task_success5.2%0.7% to 9.7%6005991120
All providersgpt-5.6-lunakimi-k2.6decision_correct-0.7%-2.5% to 1.0%6005991120
All providersgpt-5.6-lunakimi-k3fact_f1-2.3%-6.1% to 1.4%60044315796
All providersgpt-5.6-lunakimi-k3exact_world2.0%-3.9% to 7.9%60044315796
All providersgpt-5.6-lunakimi-k3task_success1.4%-4.6% to 7.3%60044315796
All providersgpt-5.6-lunakimi-k3decision_correct-2.5%-4.1% to -1.1%60044315796
All providersgpt-5.6-lunamimo-v2.6-flashfact_f12.0%-0.9% to 4.7%6005946120
All providersgpt-5.6-lunamimo-v2.6-flashexact_world2.0%-2.7% to 6.4%6005946120
All providersgpt-5.6-lunamimo-v2.6-flashtask_success2.7%-2.0% to 7.0%6005946120
All providersgpt-5.6-lunamimo-v2.6-flashdecision_correct7.2%4.7% to 9.9%6005946120
All providersgpt-5.6-lunamimo-v2.6-profact_f14.8%1.9% to 7.7%6006000120
All providersgpt-5.6-lunamimo-v2.6-proexact_world3.5%-1.2% to 8.2%6006000120
All providersgpt-5.6-lunamimo-v2.6-protask_success3.7%-1.0% to 8.7%6006000120
All providersgpt-5.6-lunamimo-v2.6-prodecision_correct8.7%5.8% to 11.8%6006000120
All providersgpt-5.6-lunaminimax-m3fact_f112.9%9.5% to 16.0%6006000120
All providersgpt-5.6-lunaminimax-m3exact_world8.8%4.5% to 13.2%6006000120
All providersgpt-5.6-lunaminimax-m3task_success7.8%3.7% to 12.2%6006000120
All providersgpt-5.6-lunaminimax-m3decision_correct0.5%-1.5% to 2.5%6006000120
All providersgpt-5.6-lunaqwen3.8-27bfact_f1-2.3%-5.1% to 0.6%6006000120
All providersgpt-5.6-lunaqwen3.8-27bexact_world9.0%4.3% to 13.7%6006000120
All providersgpt-5.6-lunaqwen3.8-27btask_success8.0%3.2% to 12.5%6006000120
All providersgpt-5.6-lunaqwen3.8-27bdecision_correct0.2%-1.7% to 2.2%6006000120
All providersgpt-5.6-solgpt-5.6-terrafact_f19.3%7.2% to 11.3%6006000120
All providersgpt-5.6-solgpt-5.6-terraexact_world17.8%13.3% to 22.2%6006000120
All providersgpt-5.6-solgpt-5.6-terratask_success17.8%13.3% to 22.2%6006000120
All providersgpt-5.6-solgpt-5.6-terradecision_correct0.2%0.0% to 0.5%6006000120
All providersgpt-5.6-solgpt-6-astrafact_f1-6.9%-8.7% to -5.1%60055050115
All providersgpt-5.6-solgpt-6-astraexact_world-18.0%-23.1% to -12.9%60055050115
All providersgpt-5.6-solgpt-6-astratask_success-18.0%-23.1% to -12.9%60055050115
All providersgpt-5.6-solgpt-6-astradecision_correct0.0%0.0% to 0.0%60055050115
All providersgpt-5.6-solgpt-6-lunafact_f19.5%7.0% to 11.9%6006000120
All providersgpt-5.6-solgpt-6-lunaexact_world26.0%21.0% to 30.8%6006000120
All providersgpt-5.6-solgpt-6-lunatask_success26.2%21.3% to 31.0%6006000120
All providersgpt-5.6-solgpt-6-lunadecision_correct1.7%0.7% to 2.7%6006000120
All providersgpt-5.6-solgpt-6-solfact_f1-5.6%-7.5% to -3.8%6006000120
All providersgpt-5.6-solgpt-6-solexact_world-5.8%-10.3% to -1.2%6006000120
All providersgpt-5.6-solgpt-6-soltask_success-5.7%-10.3% to -1.0%6006000120
All providersgpt-5.6-solgpt-6-soldecision_correct1.5%0.7% to 2.5%6006000120
All providersgpt-5.6-solgrok-4.6fact_f11.5%-0.4% to 3.5%6006000120
All providersgpt-5.6-solgrok-4.6exact_world31.5%25.7% to 36.8%6006000120
All providersgpt-5.6-solgrok-4.6task_success31.5%25.7% to 36.8%6006000120
All providersgpt-5.6-solgrok-4.6decision_correct3.3%1.3% to 5.5%6006000120
All providersgpt-5.6-solkimi-k2.6fact_f10.4%-1.3% to 2.1%6005991120
All providersgpt-5.6-solkimi-k2.6exact_world31.9%25.5% to 37.7%6005991120
All providersgpt-5.6-solkimi-k2.6task_success31.9%25.5% to 37.7%6005991120
All providersgpt-5.6-solkimi-k2.6decision_correct2.2%1.0% to 3.5%6005991120
All providersgpt-5.6-solkimi-k3fact_f17.6%4.6% to 10.4%60044315796
All providersgpt-5.6-solkimi-k3exact_world25.5%18.7% to 32.0%60044315796
All providersgpt-5.6-solkimi-k3task_success25.5%18.7% to 32.0%60044315796
All providersgpt-5.6-solkimi-k3decision_correct0.2%0.0% to 0.7%60044315796
All providersgpt-5.6-solmimo-v2.6-flashfact_f111.6%9.3% to 14.0%6005946120
All providersgpt-5.6-solmimo-v2.6-flashexact_world27.3%21.4% to 32.4%6005946120
All providersgpt-5.6-solmimo-v2.6-flashtask_success29.0%22.9% to 34.2%6005946120
All providersgpt-5.6-solmimo-v2.6-flashdecision_correct10.1%7.5% to 12.9%6005946120
All providersgpt-5.6-solmimo-v2.6-profact_f114.4%11.8% to 17.2%6006000120
All providersgpt-5.6-solmimo-v2.6-proexact_world29.3%24.2% to 34.3%6006000120
All providersgpt-5.6-solmimo-v2.6-protask_success30.5%25.3% to 35.7%6006000120
All providersgpt-5.6-solmimo-v2.6-prodecision_correct11.5%8.8% to 14.3%6006000120
All providersgpt-5.6-solminimax-m3fact_f122.6%19.5% to 25.6%6006000120
All providersgpt-5.6-solminimax-m3exact_world34.7%28.8% to 40.3%6006000120
All providersgpt-5.6-solminimax-m3task_success34.7%28.8% to 40.3%6006000120
All providersgpt-5.6-solminimax-m3decision_correct3.3%1.8% to 5.0%6006000120
All providersgpt-5.6-solqwen3.8-27bfact_f17.4%5.1% to 9.7%6006000120
All providersgpt-5.6-solqwen3.8-27bexact_world34.8%28.3% to 40.8%6006000120
All providersgpt-5.6-solqwen3.8-27btask_success34.8%28.3% to 40.8%6006000120
All providersgpt-5.6-solqwen3.8-27bdecision_correct3.0%1.5% to 4.8%6006000120
All providersgpt-5.6-terragpt-6-astrafact_f1-15.6%-17.9% to -13.4%60055050115
All providersgpt-5.6-terragpt-6-astraexact_world-35.1%-40.0% to -29.8%60055050115
All providersgpt-5.6-terragpt-6-astratask_success-35.1%-40.0% to -29.8%60055050115
All providersgpt-5.6-terragpt-6-astradecision_correct0.0%0.0% to 0.0%60055050115
All providersgpt-5.6-terragpt-6-lunafact_f10.3%-2.1% to 2.6%6006000120
All providersgpt-5.6-terragpt-6-lunaexact_world8.2%3.7% to 12.7%6006000120
All providersgpt-5.6-terragpt-6-lunatask_success8.3%3.8% to 12.7%6006000120
All providersgpt-5.6-terragpt-6-lunadecision_correct1.5%0.5% to 2.5%6006000120
All providersgpt-5.6-terragpt-6-solfact_f1-14.9%-17.2% to -12.5%6006000120
All providersgpt-5.6-terragpt-6-solexact_world-23.7%-28.5% to -18.5%6006000120
All providersgpt-5.6-terragpt-6-soltask_success-23.5%-28.3% to -18.5%6006000120
All providersgpt-5.6-terragpt-6-soldecision_correct1.3%0.5% to 2.3%6006000120
All providersgpt-5.6-terragrok-4.6fact_f1-7.7%-9.9% to -5.4%6006000120
All providersgpt-5.6-terragrok-4.6exact_world13.7%8.7% to 18.7%6006000120
All providersgpt-5.6-terragrok-4.6task_success13.7%8.7% to 18.7%6006000120
All providersgpt-5.6-terragrok-4.6decision_correct3.2%1.3% to 5.2%6006000120
All providersgpt-5.6-terrakimi-k2.6fact_f1-8.8%-10.9% to -6.8%6005991120
All providersgpt-5.6-terrakimi-k2.6exact_world14.0%9.2% to 19.0%6005991120
All providersgpt-5.6-terrakimi-k2.6task_success14.0%9.2% to 19.0%6005991120
All providersgpt-5.6-terrakimi-k2.6decision_correct2.0%0.7% to 3.5%6005991120
All providersgpt-5.6-terrakimi-k3fact_f1-0.9%-3.6% to 2.0%60044315796
All providersgpt-5.6-terrakimi-k3exact_world9.3%4.0% to 14.8%60044315796
All providersgpt-5.6-terrakimi-k3task_success9.3%4.0% to 14.8%60044315796
All providersgpt-5.6-terrakimi-k3decision_correct0.0%0.0% to 0.0%60044315796
All providersgpt-5.6-terramimo-v2.6-flashfact_f12.3%-0.2% to 4.7%6005946120
All providersgpt-5.6-terramimo-v2.6-flashexact_world9.6%5.4% to 13.5%6005946120
All providersgpt-5.6-terramimo-v2.6-flashtask_success11.3%7.1% to 15.2%6005946120
All providersgpt-5.6-terramimo-v2.6-flashdecision_correct9.9%7.4% to 12.8%6005946120
All providersgpt-5.6-terramimo-v2.6-profact_f15.2%2.6% to 7.7%6006000120
All providersgpt-5.6-terramimo-v2.6-proexact_world11.5%7.3% to 15.8%6006000120
All providersgpt-5.6-terramimo-v2.6-protask_success12.7%8.3% to 17.3%6006000120
All providersgpt-5.6-terramimo-v2.6-prodecision_correct11.3%8.5% to 14.3%6006000120
All providersgpt-5.6-terraminimax-m3fact_f113.3%10.3% to 16.5%6006000120
All providersgpt-5.6-terraminimax-m3exact_world16.8%12.0% to 21.5%6006000120
All providersgpt-5.6-terraminimax-m3task_success16.8%12.0% to 21.5%6006000120
All providersgpt-5.6-terraminimax-m3decision_correct3.2%1.8% to 4.7%6006000120
All providersgpt-5.6-terraqwen3.8-27bfact_f1-1.9%-4.2% to 0.5%6006000120
All providersgpt-5.6-terraqwen3.8-27bexact_world17.0%12.3% to 21.3%6006000120
All providersgpt-5.6-terraqwen3.8-27btask_success17.0%12.3% to 21.3%6006000120
All providersgpt-5.6-terraqwen3.8-27bdecision_correct2.8%1.3% to 4.5%6006000120
All providersgpt-6-astragpt-6-lunafact_f116.3%14.0% to 18.7%60055050115
All providersgpt-6-astragpt-6-lunaexact_world44.0%38.7% to 48.8%60055050115
All providersgpt-6-astragpt-6-lunatask_success44.2%39.0% to 49.0%60055050115
All providersgpt-6-astragpt-6-lunadecision_correct1.5%0.5% to 2.5%60055050115
All providersgpt-6-astragpt-6-solfact_f12.0%1.3% to 2.7%60055050115
All providersgpt-6-astragpt-6-solexact_world13.8%9.5% to 18.3%60055050115
All providersgpt-6-astragpt-6-soltask_success14.0%9.6% to 18.5%60055050115
All providersgpt-6-astragpt-6-soldecision_correct1.5%0.6% to 2.5%60055050115
All providersgpt-6-astragrok-4.6fact_f18.8%7.6% to 10.1%60055050115
All providersgpt-6-astragrok-4.6exact_world49.8%44.6% to 54.8%60055050115
All providersgpt-6-astragrok-4.6task_success49.8%44.6% to 54.8%60055050115
All providersgpt-6-astragrok-4.6decision_correct3.5%1.5% to 5.8%60055050115
All providersgpt-6-astrakimi-k2.6fact_f17.9%6.7% to 9.2%60054951115
All providersgpt-6-astrakimi-k2.6exact_world49.5%43.8% to 55.2%60054951115
All providersgpt-6-astrakimi-k2.6task_success49.5%43.8% to 55.2%60054951115
All providersgpt-6-astrakimi-k2.6decision_correct2.2%0.9% to 3.7%60054951115
All providersgpt-6-astrakimi-k3fact_f113.4%10.7% to 16.3%60043616495
All providersgpt-6-astrakimi-k3exact_world42.9%36.0% to 49.2%60043616495
All providersgpt-6-astrakimi-k3task_success42.9%36.0% to 49.2%60043616495
All providersgpt-6-astrakimi-k3decision_correct0.2%0.0% to 0.7%60043616495
All providersgpt-6-astramimo-v2.6-flashfact_f118.2%15.7% to 20.6%60054456115
All providersgpt-6-astramimo-v2.6-flashexact_world45.0%39.4% to 50.0%60054456115
All providersgpt-6-astramimo-v2.6-flashtask_success46.9%41.2% to 52.0%60054456115
All providersgpt-6-astramimo-v2.6-flashdecision_correct9.7%7.1% to 12.7%60054456115
All providersgpt-6-astramimo-v2.6-profact_f120.5%17.9% to 23.1%60055050115
All providersgpt-6-astramimo-v2.6-proexact_world46.2%40.4% to 51.2%60055050115
All providersgpt-6-astramimo-v2.6-protask_success47.3%41.2% to 52.5%60055050115
All providersgpt-6-astramimo-v2.6-prodecision_correct10.7%7.8% to 13.8%60055050115
All providersgpt-6-astraminimax-m3fact_f128.2%24.9% to 31.7%60055050115
All providersgpt-6-astraminimax-m3exact_world52.4%46.6% to 57.7%60055050115
All providersgpt-6-astraminimax-m3task_success52.4%46.6% to 57.7%60055050115
All providersgpt-6-astraminimax-m3decision_correct3.3%1.8% to 4.9%60055050115
All providersgpt-6-astraqwen3.8-27bfact_f113.8%11.6% to 16.1%60055050115
All providersgpt-6-astraqwen3.8-27bexact_world52.7%46.3% to 58.9%60055050115
All providersgpt-6-astraqwen3.8-27btask_success52.7%46.3% to 58.9%60055050115
All providersgpt-6-astraqwen3.8-27bdecision_correct3.1%1.5% to 4.9%60055050115
All providersgpt-6-lunagpt-6-solfact_f1-15.2%-17.5% to -12.9%6006000120
All providersgpt-6-lunagpt-6-solexact_world-31.8%-36.5% to -27.2%6006000120
All providersgpt-6-lunagpt-6-soltask_success-31.8%-36.5% to -27.2%6006000120
All providersgpt-6-lunagpt-6-soldecision_correct-0.2%-1.5% to 1.2%6006000120
All providersgpt-6-lunagrok-4.6fact_f1-8.0%-10.3% to -5.7%6006000120
All providersgpt-6-lunagrok-4.6exact_world5.5%0.7% to 10.7%6006000120
All providersgpt-6-lunagrok-4.6task_success5.3%0.5% to 10.3%6006000120
All providersgpt-6-lunagrok-4.6decision_correct1.7%-0.5% to 4.0%6006000120
All providersgpt-6-lunakimi-k2.6fact_f1-9.1%-11.5% to -6.7%6005991120
All providersgpt-6-lunakimi-k2.6exact_world6.0%1.2% to 10.5%6005991120
All providersgpt-6-lunakimi-k2.6task_success5.8%1.0% to 10.4%6005991120
All providersgpt-6-lunakimi-k2.6decision_correct0.5%-1.2% to 2.2%6005991120
All providersgpt-6-lunakimi-k3fact_f1-1.1%-4.5% to 2.1%60044315796
All providersgpt-6-lunakimi-k3exact_world2.0%-4.2% to 8.3%60044315796
All providersgpt-6-lunakimi-k3task_success2.0%-4.2% to 8.3%60044315796
All providersgpt-6-lunakimi-k3decision_correct-0.5%-1.4% to 0.4%60044315796
All providersgpt-6-lunamimo-v2.6-flashfact_f12.0%-0.8% to 4.7%6005946120
All providersgpt-6-lunamimo-v2.6-flashexact_world1.5%-3.0% to 5.7%6005946120
All providersgpt-6-lunamimo-v2.6-flashtask_success3.0%-1.4% to 7.3%6005946120
All providersgpt-6-lunamimo-v2.6-flashdecision_correct8.4%5.7% to 11.4%6005946120
All providersgpt-6-lunamimo-v2.6-profact_f14.9%2.0% to 7.7%6006000120
All providersgpt-6-lunamimo-v2.6-proexact_world3.3%-1.0% to 7.8%6006000120
All providersgpt-6-lunamimo-v2.6-protask_success4.3%-0.2% to 9.0%6006000120
All providersgpt-6-lunamimo-v2.6-prodecision_correct9.8%7.2% to 12.8%6006000120
All providersgpt-6-lunaminimax-m3fact_f113.0%9.8% to 16.4%6006000120
All providersgpt-6-lunaminimax-m3exact_world8.7%4.2% to 13.3%6006000120
All providersgpt-6-lunaminimax-m3task_success8.5%3.8% to 13.0%6006000120
All providersgpt-6-lunaminimax-m3decision_correct1.7%-0.2% to 3.5%6006000120
All providersgpt-6-lunaqwen3.8-27bfact_f1-2.2%-4.8% to 0.5%6006000120
All providersgpt-6-lunaqwen3.8-27bexact_world8.8%4.0% to 13.5%6006000120
All providersgpt-6-lunaqwen3.8-27btask_success8.7%3.8% to 13.5%6006000120
All providersgpt-6-lunaqwen3.8-27bdecision_correct1.3%-0.5% to 3.3%6006000120
All providersgpt-6-solgrok-4.6fact_f17.2%5.9% to 8.4%6006000120
All providersgpt-6-solgrok-4.6exact_world37.3%32.7% to 41.8%6006000120
All providersgpt-6-solgrok-4.6task_success37.2%32.3% to 41.7%6006000120
All providersgpt-6-solgrok-4.6decision_correct1.8%0.0% to 3.8%6006000120
All providersgpt-6-solkimi-k2.6fact_f16.1%4.8% to 7.4%6005991120
All providersgpt-6-solkimi-k2.6exact_world37.7%32.4% to 43.1%6005991120
All providersgpt-6-solkimi-k2.6task_success37.6%32.2% to 42.9%6005991120
All providersgpt-6-solkimi-k2.6decision_correct0.7%-0.8% to 2.3%6005991120
All providersgpt-6-solkimi-k3fact_f111.3%8.4% to 14.2%60044315796
All providersgpt-6-solkimi-k3exact_world28.7%22.6% to 34.9%60044315796
All providersgpt-6-solkimi-k3task_success28.4%22.4% to 34.7%60044315796
All providersgpt-6-solkimi-k3decision_correct-1.6%-2.8% to -0.7%60044315796
All providersgpt-6-solmimo-v2.6-flashfact_f117.3%14.8% to 19.9%6005946120
All providersgpt-6-solmimo-v2.6-flashexact_world33.2%27.7% to 38.3%6005946120
All providersgpt-6-solmimo-v2.6-flashtask_success34.7%29.0% to 40.1%6005946120
All providersgpt-6-solmimo-v2.6-flashdecision_correct8.6%6.0% to 11.4%6005946120
All providersgpt-6-solmimo-v2.6-profact_f120.0%17.3% to 22.8%6006000120
All providersgpt-6-solmimo-v2.6-proexact_world35.2%30.0% to 39.8%6006000120
All providersgpt-6-solmimo-v2.6-protask_success36.2%31.0% to 41.0%6006000120
All providersgpt-6-solmimo-v2.6-prodecision_correct10.0%7.0% to 13.2%6006000120
All providersgpt-6-solminimax-m3fact_f128.2%24.6% to 31.5%6006000120
All providersgpt-6-solminimax-m3exact_world40.5%34.8% to 45.8%6006000120
All providersgpt-6-solminimax-m3task_success40.3%34.7% to 45.8%6006000120
All providersgpt-6-solminimax-m3decision_correct1.8%0.3% to 3.3%6006000120
All providersgpt-6-solqwen3.8-27bfact_f113.0%10.8% to 15.5%6006000120
All providersgpt-6-solqwen3.8-27bexact_world40.7%34.7% to 46.5%6006000120
All providersgpt-6-solqwen3.8-27btask_success40.5%34.3% to 46.2%6006000120
All providersgpt-6-solqwen3.8-27bdecision_correct1.5%0.0% to 3.3%6006000120
All providersgrok-4.6kimi-k2.6fact_f1-1.1%-2.5% to 0.3%6005991120
All providersgrok-4.6kimi-k2.6exact_world0.3%-3.7% to 4.3%6005991120
All providersgrok-4.6kimi-k2.6task_success0.3%-3.7% to 4.3%6005991120
All providersgrok-4.6kimi-k2.6decision_correct-1.2%-3.5% to 1.0%6005991120
All providersgrok-4.6kimi-k3fact_f15.1%2.1% to 8.2%60044315796
All providersgrok-4.6kimi-k3exact_world-5.6%-11.3% to 0.0%60044315796
All providersgrok-4.6kimi-k3task_success-5.6%-11.3% to 0.0%60044315796
All providersgrok-4.6kimi-k3decision_correct-3.8%-6.7% to -1.4%60044315796
All providersgrok-4.6mimo-v2.6-flashfact_f110.3%7.8% to 12.7%6005946120
All providersgrok-4.6mimo-v2.6-flashexact_world-3.7%-8.8% to 1.2%6005946120
All providersgrok-4.6mimo-v2.6-flashtask_success-2.0%-6.9% to 3.0%6005946120
All providersgrok-4.6mimo-v2.6-flashdecision_correct6.9%3.7% to 10.4%6005946120
All providersgrok-4.6mimo-v2.6-profact_f112.9%10.4% to 15.5%6006000120
All providersgrok-4.6mimo-v2.6-proexact_world-2.2%-6.5% to 2.7%6006000120
All providersgrok-4.6mimo-v2.6-protask_success-1.0%-5.5% to 3.8%6006000120
All providersgrok-4.6mimo-v2.6-prodecision_correct8.2%4.7% to 11.8%6006000120
All providersgrok-4.6minimax-m3fact_f121.0%17.8% to 24.2%6006000120
All providersgrok-4.6minimax-m3exact_world3.2%-1.3% to 7.7%6006000120
All providersgrok-4.6minimax-m3task_success3.2%-1.3% to 7.7%6006000120
All providersgrok-4.6minimax-m3decision_correct0.0%-2.3% to 2.2%6006000120
All providersgrok-4.6qwen3.8-27bfact_f15.8%3.6% to 8.4%6006000120
All providersgrok-4.6qwen3.8-27bexact_world3.3%-1.3% to 8.0%6006000120
All providersgrok-4.6qwen3.8-27btask_success3.3%-1.3% to 8.0%6006000120
All providersgrok-4.6qwen3.8-27bdecision_correct-0.3%-2.5% to 1.5%6006000120
All providerskimi-k2.6kimi-k3fact_f16.2%3.9% to 8.6%60044315796
All providerskimi-k2.6kimi-k3exact_world-2.7%-7.8% to 2.6%60044315796
All providerskimi-k2.6kimi-k3task_success-2.7%-7.8% to 2.6%60044315796
All providerskimi-k2.6kimi-k3decision_correct-2.5%-4.4% to -0.9%60044315796
All providerskimi-k2.6mimo-v2.6-flashfact_f111.3%9.0% to 13.4%6005937120
All providerskimi-k2.6mimo-v2.6-flashexact_world-3.9%-7.7% to 0.0%6005937120
All providerskimi-k2.6mimo-v2.6-flashtask_success-2.2%-6.1% to 1.8%6005937120
All providerskimi-k2.6mimo-v2.6-flashdecision_correct7.9%4.9% to 11.1%6005937120
All providerskimi-k2.6mimo-v2.6-profact_f114.0%11.6% to 16.6%6005991120
All providerskimi-k2.6mimo-v2.6-proexact_world-2.5%-6.2% to 1.3%6005991120
All providerskimi-k2.6mimo-v2.6-protask_success-1.3%-5.2% to 2.7%6005991120
All providerskimi-k2.6mimo-v2.6-prodecision_correct9.3%6.2% to 12.8%6005991120
All providerskimi-k2.6minimax-m3fact_f122.1%19.0% to 25.2%6005991120
All providerskimi-k2.6minimax-m3exact_world2.7%-1.3% to 6.5%6005991120
All providerskimi-k2.6minimax-m3task_success2.7%-1.3% to 6.5%6005991120
All providerskimi-k2.6minimax-m3decision_correct1.2%-0.8% to 3.2%6005991120
All providerskimi-k2.6qwen3.8-27bfact_f17.0%4.9% to 9.1%6005991120
All providerskimi-k2.6qwen3.8-27bexact_world3.0%-1.0% to 7.2%6005991120
All providerskimi-k2.6qwen3.8-27btask_success3.0%-1.0% to 7.2%6005991120
All providerskimi-k2.6qwen3.8-27bdecision_correct0.8%-1.2% to 3.2%6005991120
All providerskimi-k3mimo-v2.6-flashfact_f12.6%-0.3% to 5.3%60043716396
All providerskimi-k3mimo-v2.6-flashexact_world-1.8%-6.7% to 2.8%60043716396
All providerskimi-k3mimo-v2.6-flashtask_success-0.2%-5.1% to 4.4%60043716396
All providerskimi-k3mimo-v2.6-flashdecision_correct8.5%6.0% to 11.2%60043716396
All providerskimi-k3mimo-v2.6-profact_f13.9%1.2% to 6.8%60044315796
All providerskimi-k3mimo-v2.6-proexact_world-1.6%-6.2% to 2.9%60044315796
All providerskimi-k3mimo-v2.6-protask_success-0.7%-5.3% to 3.9%60044315796
All providerskimi-k3mimo-v2.6-prodecision_correct7.9%5.1% to 10.9%60044315796
All providerskimi-k3minimax-m3fact_f112.6%8.8% to 16.7%60044315796
All providerskimi-k3minimax-m3exact_world5.6%0.9% to 10.2%60044315796
All providerskimi-k3minimax-m3task_success5.6%0.9% to 10.2%60044315796
All providerskimi-k3minimax-m3decision_correct3.6%1.9% to 5.5%60044315796
All providerskimi-k3qwen3.8-27bfact_f1-1.0%-4.0% to 2.1%60044315796
All providerskimi-k3qwen3.8-27bexact_world6.1%1.4% to 11.0%60044315796
All providerskimi-k3qwen3.8-27btask_success6.1%1.4% to 11.0%60044315796
All providerskimi-k3qwen3.8-27bdecision_correct3.4%1.6% to 5.6%60044315796
All providersmimo-v2.6-flashmimo-v2.6-profact_f12.9%0.5% to 5.5%6005946120
All providersmimo-v2.6-flashmimo-v2.6-proexact_world2.0%-1.7% to 5.9%6005946120
All providersmimo-v2.6-flashmimo-v2.6-protask_success1.5%-2.2% to 5.4%6005946120
All providersmimo-v2.6-flashmimo-v2.6-prodecision_correct1.5%-1.8% to 5.0%6005946120
All providersmimo-v2.6-flashminimax-m3fact_f110.9%7.9% to 14.0%6005946120
All providersmimo-v2.6-flashminimax-m3exact_world7.1%3.4% to 11.0%6005946120
All providersmimo-v2.6-flashminimax-m3task_success5.4%1.5% to 9.4%6005946120
All providersmimo-v2.6-flashminimax-m3decision_correct-6.9%-9.8% to -4.2%6005946120
All providersmimo-v2.6-flashqwen3.8-27bfact_f1-4.2%-6.7% to -1.6%6005946120
All providersmimo-v2.6-flashqwen3.8-27bexact_world7.2%3.4% to 11.3%6005946120
All providersmimo-v2.6-flashqwen3.8-27btask_success5.6%1.7% to 9.8%6005946120
All providersmimo-v2.6-flashqwen3.8-27bdecision_correct-7.1%-10.1% to -4.0%6005946120
All providersmimo-v2.6-prominimax-m3fact_f18.1%5.0% to 11.4%6006000120
All providersmimo-v2.6-prominimax-m3exact_world5.3%1.2% to 9.2%6006000120
All providersmimo-v2.6-prominimax-m3task_success4.2%-0.2% to 8.2%6006000120
All providersmimo-v2.6-prominimax-m3decision_correct-8.2%-11.7% to -4.8%6006000120
All providersmimo-v2.6-proqwen3.8-27bfact_f1-7.0%-9.9% to -4.2%6006000120
All providersmimo-v2.6-proqwen3.8-27bexact_world5.5%1.2% to 9.8%6006000120
All providersmimo-v2.6-proqwen3.8-27btask_success4.3%-0.2% to 8.8%6006000120
All providersmimo-v2.6-proqwen3.8-27bdecision_correct-8.5%-12.0% to -5.0%6006000120
All providersminimax-m3qwen3.8-27bfact_f1-15.2%-18.3% to -12.1%6006000120
All providersminimax-m3qwen3.8-27bexact_world0.2%-3.7% to 4.0%6006000120
All providersminimax-m3qwen3.8-27btask_success0.2%-3.7% to 4.0%6006000120
All providersminimax-m3qwen3.8-27bdecision_correct-0.3%-2.0% to 1.3%6006000120
conditions
ProviderLeftRightMetricDifference (pp)95% CI (pp)Expected pairsComplete pairsMissing pairsFamilies
baseline:constraint-solverexplicitformalfact_f10.0%0.0% to 0.0%1201200120
baseline:constraint-solverexplicitformalexact_world0.0%0.0% to 0.0%1201200120
baseline:constraint-solverexplicitformaltask_success0.0%0.0% to 0.0%1201200120
baseline:constraint-solverexplicitformaldecision_correct0.0%0.0% to 0.0%1201200120
baseline:constraint-solverexplicitimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:constraint-solverexplicitimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:constraint-solverexplicitimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:constraint-solverexplicitimplicitdecision_correct0.0%0.0% to 0.0%1201200120
baseline:constraint-solverformalimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:constraint-solverformalimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:constraint-solverformalimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:constraint-solverformalimplicitdecision_correct0.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitformalfact_f10.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitformalexact_world0.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitformaltask_success0.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitformaldecision_correct0.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:direct-factsexplicitimplicitdecision_correct0.0%0.0% to 0.0%1201200120
baseline:direct-factsformalimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:direct-factsformalimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:direct-factsformalimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:direct-factsformalimplicitdecision_correct0.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitformalfact_f10.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitformalexact_world0.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitformaltask_success0.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitformaldecision_correct0.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:forward-chainexplicitimplicitdecision_correct0.0%0.0% to 0.0%1201200120
baseline:forward-chainformalimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:forward-chainformalimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:forward-chainformalimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:forward-chainformalimplicitdecision_correct0.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitformalfact_f10.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitformalexact_world0.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitformaltask_success0.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitformaldecision_correct0.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:story-copyexplicitimplicitdecision_correct0.0%0.0% to 0.0%1201200120
baseline:story-copyformalimplicitfact_f10.0%0.0% to 0.0%1201200120
baseline:story-copyformalimplicitexact_world0.0%0.0% to 0.0%1201200120
baseline:story-copyformalimplicittask_success0.0%0.0% to 0.0%1201200120
baseline:story-copyformalimplicitdecision_correct0.0%0.0% to 0.0%1201200120
claude-fable-5explicitformalfact_f1-7.5%-10.5% to -4.9%120447644
claude-fable-5explicitformalexact_world-52.3%-63.6% to -40.9%120447644
claude-fable-5explicitformaltask_success-52.3%-63.6% to -40.9%120447644
claude-fable-5explicitformaldecision_correct-3.4%-8.0% to 0.0%120447644
claude-fable-5explicitimplicitfact_f1-0.9%-3.1% to 1.2%120328832
claude-fable-5explicitimplicitexact_world0.0%-10.9% to 10.9%120328832
claude-fable-5explicitimplicittask_success0.0%-10.9% to 10.9%120328832
claude-fable-5explicitimplicitdecision_correct-1.6%-4.7% to 0.0%120328832
claude-fable-5formalimplicitfact_f16.7%4.6% to 8.9%120328832
claude-fable-5formalimplicitexact_world56.2%43.8% to 68.8%120328832
claude-fable-5formalimplicittask_success56.2%43.8% to 68.8%120328832
claude-fable-5formalimplicitdecision_correct3.1%0.0% to 7.8%120328832
claude-fable-5.1explicitformalfact_f1——12001200
claude-fable-5.1explicitformalexact_world——12001200
claude-fable-5.1explicitformaltask_success——12001200
claude-fable-5.1explicitformaldecision_correct——12001200
claude-fable-5.1explicitimplicitfact_f1——12001200
claude-fable-5.1explicitimplicitexact_world——12001200
claude-fable-5.1explicitimplicittask_success——12001200
claude-fable-5.1explicitimplicitdecision_correct——12001200
claude-fable-5.1formalimplicitfact_f1——12001200
claude-fable-5.1formalimplicitexact_world——12001200
claude-fable-5.1formalimplicittask_success——12001200
claude-fable-5.1formalimplicitdecision_correct——12001200
claude-haiku-4.5explicitformalfact_f1-30.4%-34.8% to -26.0%1201200120
claude-haiku-4.5explicitformalexact_world-92.5%-96.2% to -88.3%1201200120
claude-haiku-4.5explicitformaltask_success-92.5%-96.2% to -88.3%1201200120
claude-haiku-4.5explicitformaldecision_correct-2.9%-6.7% to 0.8%1201200120
claude-haiku-4.5explicitimplicitfact_f115.0%11.3% to 18.6%1201200120
claude-haiku-4.5explicitimplicitexact_world1.7%-2.1% to 5.4%1201200120
claude-haiku-4.5explicitimplicittask_success1.7%-2.1% to 5.4%1201200120
claude-haiku-4.5explicitimplicitdecision_correct1.2%-2.5% to 5.0%1201200120
claude-haiku-4.5formalimplicitfact_f145.4%40.3% to 50.1%1201200120
claude-haiku-4.5formalimplicitexact_world94.2%90.4% to 97.1%1201200120
claude-haiku-4.5formalimplicittask_success94.2%90.4% to 97.1%1201200120
claude-haiku-4.5formalimplicitdecision_correct4.2%0.4% to 7.9%1201200120
claude-opus-5explicitformalfact_f1——12001200
claude-opus-5explicitformalexact_world——12001200
claude-opus-5explicitformaltask_success——12001200
claude-opus-5explicitformaldecision_correct——12001200
claude-opus-5explicitimplicitfact_f110.1%3.9% to 16.8%120853585
claude-opus-5explicitimplicitexact_world18.2%8.8% to 27.1%120853585
claude-opus-5explicitimplicittask_success18.2%8.8% to 27.1%120853585
claude-opus-5explicitimplicitdecision_correct0.0%-5.9% to 6.5%120853585
claude-opus-5formalimplicitfact_f1——12001200
claude-opus-5formalimplicitexact_world——12001200
claude-opus-5formalimplicittask_success——12001200
claude-opus-5formalimplicitdecision_correct——12001200
claude-opus-5.5explicitformalfact_f1-7.2%-8.3% to -6.1%1201155115
claude-opus-5.5explicitformalexact_world-71.3%-77.0% to -65.6%1201155115
claude-opus-5.5explicitformaltask_success-71.7%-77.4% to -65.7%1201155115
claude-opus-5.5explicitformaldecision_correct-4.8%-7.8% to -2.2%1201155115
claude-opus-5.5explicitimplicitfact_f12.5%0.8% to 4.3%1201137113
claude-opus-5.5explicitimplicitexact_world7.5%0.9% to 14.2%1201137113
claude-opus-5.5explicitimplicittask_success7.1%0.0% to 13.7%1201137113
claude-opus-5.5explicitimplicitdecision_correct2.2%-0.9% to 5.3%1201137113
claude-opus-5.5formalimplicitfact_f19.6%8.1% to 11.2%1201164116
claude-opus-5.5formalimplicitexact_world78.0%72.4% to 83.6%1201164116
claude-opus-5.5formalimplicittask_success78.0%72.4% to 83.6%1201164116
claude-opus-5.5formalimplicitdecision_correct6.5%3.9% to 9.5%1201164116
claude-sonnet-5explicitformalfact_f1-0.4%-6.2% to 6.0%120863486
claude-sonnet-5explicitformalexact_world-51.7%-59.9% to -42.4%120863486
claude-sonnet-5explicitformaltask_success-51.7%-59.9% to -42.4%120863486
claude-sonnet-5explicitformaldecision_correct4.1%-1.7% to 10.5%120863486
claude-sonnet-5explicitimplicitfact_f19.4%3.1% to 15.5%120526852
claude-sonnet-5explicitimplicitexact_world-1.0%-11.5% to 9.6%120526852
claude-sonnet-5explicitimplicittask_success-1.0%-11.5% to 9.6%120526852
claude-sonnet-5explicitimplicitdecision_correct-1.0%-5.8% to 3.8%120526852
claude-sonnet-5formalimplicitfact_f17.6%-1.8% to 16.5%120526852
claude-sonnet-5formalimplicitexact_world50.0%38.5% to 61.5%120526852
claude-sonnet-5formalimplicittask_success50.0%38.5% to 61.5%120526852
claude-sonnet-5formalimplicitdecision_correct-5.8%-15.4% to 2.9%120526852
deepseek-4.1-flashexplicitformalfact_f1-4.5%-5.9% to -3.3%1201164116
deepseek-4.1-flashexplicitformalexact_world-44.8%-52.2% to -37.5%1201164116
deepseek-4.1-flashexplicitformaltask_success-44.8%-52.2% to -37.5%1201164116
deepseek-4.1-flashexplicitformaldecision_correct0.0%0.0% to 0.0%1201164116
deepseek-4.1-flashexplicitimplicitfact_f141.9%36.4% to 47.2%1201155115
deepseek-4.1-flashexplicitimplicitexact_world37.0%29.6% to 45.2%1201155115
deepseek-4.1-flashexplicitimplicittask_success37.0%29.6% to 45.2%1201155115
deepseek-4.1-flashexplicitimplicitdecision_correct0.0%0.0% to 0.0%1201155115
deepseek-4.1-flashformalimplicitfact_f146.6%41.4% to 52.1%1201191119
deepseek-4.1-flashformalimplicitexact_world81.9%76.5% to 87.8%1201191119
deepseek-4.1-flashformalimplicittask_success81.9%76.5% to 87.8%1201191119
deepseek-4.1-flashformalimplicitdecision_correct0.0%0.0% to 0.0%1201191119
deepseek-v4-proexplicitformalfact_f1-4.8%-7.9% to -1.3%1201200120
deepseek-v4-proexplicitformalexact_world-58.8%-65.4% to -52.1%1201200120
deepseek-v4-proexplicitformaltask_success-58.8%-65.4% to -52.1%1201200120
deepseek-v4-proexplicitformaldecision_correct-2.9%-6.7% to 1.2%1201200120
deepseek-v4-proexplicitimplicitfact_f15.4%2.3% to 8.4%1201200120
deepseek-v4-proexplicitimplicitexact_world19.6%12.1% to 26.7%1201200120
deepseek-v4-proexplicitimplicittask_success19.6%12.1% to 26.7%1201200120
deepseek-v4-proexplicitimplicitdecision_correct-0.4%-3.3% to 2.5%1201200120
deepseek-v4-proformalimplicitfact_f110.2%6.5% to 13.4%1201200120
deepseek-v4-proformalimplicitexact_world78.3%71.7% to 84.2%1201200120
deepseek-v4-proformalimplicittask_success78.3%71.7% to 84.2%1201200120
deepseek-v4-proformalimplicitdecision_correct2.5%-1.7% to 6.2%1201200120
gemini-3.6-flashexplicitformalfact_f1-16.3%-19.7% to -12.9%1201200120
gemini-3.6-flashexplicitformalexact_world-57.1%-63.7% to -50.0%1201200120
gemini-3.6-flashexplicitformaltask_success-57.1%-63.7% to -50.0%1201200120
gemini-3.6-flashexplicitformaldecision_correct-1.7%-3.3% to -0.4%1201200120
gemini-3.6-flashexplicitimplicitfact_f118.8%14.9% to 22.4%1201200120
gemini-3.6-flashexplicitimplicitexact_world26.7%20.4% to 32.9%1201200120
gemini-3.6-flashexplicitimplicittask_success26.7%20.4% to 32.9%1201200120
gemini-3.6-flashexplicitimplicitdecision_correct-0.8%-2.5% to 0.8%1201200120
gemini-3.6-flashformalimplicitfact_f135.0%30.9% to 39.2%1201200120
gemini-3.6-flashformalimplicitexact_world83.8%77.9% to 88.8%1201200120
gemini-3.6-flashformalimplicittask_success83.8%77.9% to 88.8%1201200120
gemini-3.6-flashformalimplicitdecision_correct0.8%0.0% to 2.5%1201200120
gemini-3.7-flashexplicitformalfact_f1-3.1%-4.5% to -2.0%1201200120
gemini-3.7-flashexplicitformalexact_world-31.2%-37.5% to -25.4%1201200120
gemini-3.7-flashexplicitformaltask_success-31.2%-37.5% to -25.4%1201200120
gemini-3.7-flashexplicitformaldecision_correct-0.8%-2.1% to 0.0%1201200120
gemini-3.7-flashexplicitimplicitfact_f115.5%11.6% to 19.2%1201200120
gemini-3.7-flashexplicitimplicitexact_world15.8%7.5% to 23.3%1201200120
gemini-3.7-flashexplicitimplicittask_success15.8%7.5% to 23.3%1201200120
gemini-3.7-flashexplicitimplicitdecision_correct-0.4%-1.2% to 0.0%1201200120
gemini-3.7-flashformalimplicitfact_f118.6%14.8% to 22.6%1201200120
gemini-3.7-flashformalimplicitexact_world47.1%40.4% to 53.3%1201200120
gemini-3.7-flashformalimplicittask_success47.1%40.4% to 53.3%1201200120
gemini-3.7-flashformalimplicitdecision_correct0.4%0.0% to 1.2%1201200120
gemini-3.8-flashexplicitformalfact_f1-4.6%-6.4% to -3.3%1201191119
gemini-3.8-flashexplicitformalexact_world-41.2%-48.3% to -34.0%1201191119
gemini-3.8-flashexplicitformaltask_success-41.2%-48.3% to -34.0%1201191119
gemini-3.8-flashexplicitformaldecision_correct-0.8%-2.1% to 0.0%1201191119
gemini-3.8-flashexplicitimplicitfact_f124.5%19.5% to 29.4%1201182118
gemini-3.8-flashexplicitimplicitexact_world19.1%8.9% to 28.0%1201182118
gemini-3.8-flashexplicitimplicittask_success19.1%8.9% to 28.0%1201182118
gemini-3.8-flashexplicitimplicitdecision_correct-0.8%-2.1% to 0.0%1201182118
gemini-3.8-flashformalimplicitfact_f129.2%24.6% to 33.8%1201191119
gemini-3.8-flashformalimplicitexact_world60.9%53.4% to 68.1%1201191119
gemini-3.8-flashformalimplicittask_success60.9%53.4% to 68.1%1201191119
gemini-3.8-flashformalimplicitdecision_correct0.0%0.0% to 0.0%1201191119
glm-4.7-flashexplicitformalfact_f1-26.3%-33.2% to -19.0%12010416104
glm-4.7-flashexplicitformalexact_world-74.0%-81.7% to -65.9%12010416104
glm-4.7-flashexplicitformaltask_success-74.0%-81.7% to -65.9%12010416104
glm-4.7-flashexplicitformaldecision_correct-9.6%-16.8% to -2.9%12010416104
glm-4.7-flashexplicitimplicitfact_f16.3%0.9% to 11.9%120972397
glm-4.7-flashexplicitimplicitexact_world4.6%0.5% to 8.8%120972397
glm-4.7-flashexplicitimplicittask_success4.6%0.5% to 8.8%120972397
glm-4.7-flashexplicitimplicitdecision_correct3.6%-2.6% to 10.8%120972397
glm-4.7-flashformalimplicitfact_f133.9%27.4% to 39.8%12010713107
glm-4.7-flashformalimplicitexact_world78.0%70.1% to 85.5%12010713107
glm-4.7-flashformalimplicittask_success78.0%70.1% to 85.5%12010713107
glm-4.7-flashformalimplicitdecision_correct14.5%6.5% to 22.4%12010713107
glm-5.3explicitformalfact_f1-14.0%-18.8% to -9.5%120972397
glm-5.3explicitformalexact_world-46.4%-54.6% to -38.1%120972397
glm-5.3explicitformaltask_success-46.4%-54.6% to -38.1%120972397
glm-5.3explicitformaldecision_correct-2.6%-5.7% to 0.0%120972397
glm-5.3explicitimplicitfact_f16.2%1.4% to 11.1%120912991
glm-5.3explicitimplicitexact_world16.5%8.2% to 24.7%120912991
glm-5.3explicitimplicittask_success16.5%8.2% to 24.7%120912991
glm-5.3explicitimplicitdecision_correct1.1%-3.3% to 5.5%120912991
glm-5.3formalimplicitfact_f119.9%14.4% to 25.1%12010911109
glm-5.3formalimplicitexact_world60.1%52.3% to 67.0%12010911109
glm-5.3formalimplicittask_success60.1%52.3% to 67.0%12010911109
glm-5.3formalimplicitdecision_correct2.8%-0.9% to 6.4%12010911109
glm-5.3-flashexplicitformalfact_f1-34.3%-39.3% to -29.4%1201164116
glm-5.3-flashexplicitformalexact_world-66.4%-74.6% to -58.2%1201164116
glm-5.3-flashexplicitformaltask_success-66.8%-75.0% to -58.6%1201164116
glm-5.3-flashexplicitformaldecision_correct-2.2%-4.3% to -0.4%1201164116
glm-5.3-flashexplicitimplicitfact_f112.7%7.9% to 17.6%1201164116
glm-5.3-flashexplicitimplicitexact_world14.2%9.1% to 19.8%1201164116
glm-5.3-flashexplicitimplicittask_success13.8%8.6% to 19.4%1201164116
glm-5.3-flashexplicitimplicitdecision_correct0.0%-2.6% to 2.6%1201164116
glm-5.3-flashformalimplicitfact_f145.8%41.1% to 50.6%1201200120
glm-5.3-flashformalimplicitexact_world78.3%71.2% to 85.0%1201200120
glm-5.3-flashformalimplicittask_success78.3%71.2% to 85.0%1201200120
glm-5.3-flashformalimplicitdecision_correct2.1%0.4% to 4.2%1201200120
gpt-5.6-lunaexplicitformalfact_f1-5.5%-6.5% to -4.6%1201200120
gpt-5.6-lunaexplicitformalexact_world-60.0%-66.2% to -53.8%1201200120
gpt-5.6-lunaexplicitformaltask_success-60.0%-66.3% to -53.3%1201200120
gpt-5.6-lunaexplicitformaldecision_correct-1.7%-4.6% to 2.1%1201200120
gpt-5.6-lunaexplicitimplicitfact_f135.5%30.3% to 40.8%1201200120
gpt-5.6-lunaexplicitimplicitexact_world23.3%16.7% to 30.4%1201200120
gpt-5.6-lunaexplicitimplicittask_success21.7%15.0% to 28.3%1201200120
gpt-5.6-lunaexplicitimplicitdecision_correct-0.4%-3.3% to 2.5%1201200120
gpt-5.6-lunaformalimplicitfact_f141.1%36.0% to 46.1%1201200120
gpt-5.6-lunaformalimplicitexact_world83.3%78.8% to 87.5%1201200120
gpt-5.6-lunaformalimplicittask_success81.7%75.8% to 86.7%1201200120
gpt-5.6-lunaformalimplicitdecision_correct1.2%-2.1% to 4.2%1201200120
gpt-5.6-solexplicitformalfact_f1-2.8%-3.6% to -2.1%1201200120
gpt-5.6-solexplicitformalexact_world-32.9%-40.0% to -26.2%1201200120
gpt-5.6-solexplicitformaltask_success-32.9%-40.0% to -26.2%1201200120
gpt-5.6-solexplicitformaldecision_correct0.0%0.0% to 0.0%1201200120
gpt-5.6-solexplicitimplicitfact_f116.8%12.6% to 21.2%1201200120
gpt-5.6-solexplicitimplicitexact_world12.9%5.0% to 20.8%1201200120
gpt-5.6-solexplicitimplicittask_success12.9%5.0% to 20.8%1201200120
gpt-5.6-solexplicitimplicitdecision_correct0.0%0.0% to 0.0%1201200120
gpt-5.6-solformalimplicitfact_f119.6%15.3% to 23.8%1201200120
gpt-5.6-solformalimplicitexact_world45.8%38.8% to 52.9%1201200120
gpt-5.6-solformalimplicittask_success45.8%38.8% to 52.9%1201200120
gpt-5.6-solformalimplicitdecision_correct0.0%0.0% to 0.0%1201200120
gpt-5.6-terraexplicitformalfact_f1-3.7%-4.5% to -3.0%1201200120
gpt-5.6-terraexplicitformalexact_world-47.5%-54.2% to -41.2%1201200120
gpt-5.6-terraexplicitformaltask_success-47.5%-54.2% to -41.2%1201200120
gpt-5.6-terraexplicitformaldecision_correct0.0%0.0% to 0.0%1201200120
gpt-5.6-terraexplicitimplicitfact_f138.1%32.7% to 43.5%1201200120
gpt-5.6-terraexplicitimplicitexact_world28.3%20.0% to 36.7%1201200120
gpt-5.6-terraexplicitimplicittask_success28.3%20.0% to 36.7%1201200120
gpt-5.6-terraexplicitimplicitdecision_correct0.4%0.0% to 1.2%1201200120
gpt-5.6-terraformalimplicitfact_f141.9%36.6% to 47.1%1201200120
gpt-5.6-terraformalimplicitexact_world75.8%70.0% to 81.2%1201200120
gpt-5.6-terraformalimplicittask_success75.8%70.0% to 81.2%1201200120
gpt-5.6-terraformalimplicitdecision_correct0.4%0.0% to 1.2%1201200120
gpt-6-astraexplicitformalfact_f1-0.9%-1.4% to -0.5%12010812108
gpt-6-astraexplicitformalexact_world-11.6%-16.7% to -7.4%12010812108
gpt-6-astraexplicitformaltask_success-11.6%-16.7% to -7.4%12010812108
gpt-6-astraexplicitformaldecision_correct0.0%0.0% to 0.0%12010812108
gpt-6-astraexplicitimplicitfact_f11.3%0.6% to 2.3%12010119101
gpt-6-astraexplicitimplicitexact_world8.9%4.5% to 13.9%12010119101
gpt-6-astraexplicitimplicittask_success8.9%4.5% to 13.9%12010119101
gpt-6-astraexplicitimplicitdecision_correct0.0%0.0% to 0.0%12010119101
gpt-6-astraformalimplicitfact_f12.3%1.4% to 3.3%12010416104
gpt-6-astraformalimplicitexact_world20.7%14.4% to 26.9%12010416104
gpt-6-astraformalimplicittask_success20.7%14.4% to 26.9%12010416104
gpt-6-astraformalimplicitdecision_correct0.0%0.0% to 0.0%12010416104
gpt-6-lunaexplicitformalfact_f1-7.8%-9.5% to -6.4%1201200120
gpt-6-lunaexplicitformalexact_world-66.7%-72.1% to -60.8%1201200120
gpt-6-lunaexplicitformaltask_success-65.8%-71.7% to -59.6%1201200120
gpt-6-lunaexplicitformaldecision_correct-2.1%-4.6% to 0.8%1201200120
gpt-6-lunaexplicitimplicitfact_f130.7%25.1% to 36.4%1201200120
gpt-6-lunaexplicitimplicitexact_world10.4%2.9% to 17.5%1201200120
gpt-6-lunaexplicitimplicittask_success10.4%2.9% to 17.5%1201200120
gpt-6-lunaexplicitimplicitdecision_correct-2.1%-4.6% to 0.0%1201200120
gpt-6-lunaformalimplicitfact_f138.5%33.1% to 43.9%1201200120
gpt-6-lunaformalimplicitexact_world77.1%71.2% to 82.5%1201200120
gpt-6-lunaformalimplicittask_success76.2%69.6% to 82.5%1201200120
gpt-6-lunaformalimplicitdecision_correct0.0%-2.1% to 1.7%1201200120
gpt-6-solexplicitformalfact_f1-4.2%-6.2% to -1.8%1201200120
gpt-6-solexplicitformalexact_world-37.9%-45.0% to -31.2%1201200120
gpt-6-solexplicitformaltask_success-38.3%-45.4% to -31.7%1201200120
gpt-6-solexplicitformaldecision_correct-2.5%-5.4% to 0.4%1201200120
gpt-6-solexplicitimplicitfact_f1-2.1%-3.5% to -0.7%1201200120
gpt-6-solexplicitimplicitexact_world-13.8%-20.0% to -7.1%1201200120
gpt-6-solexplicitimplicittask_success-14.2%-20.4% to -7.5%1201200120
gpt-6-solexplicitimplicitdecision_correct-3.3%-5.8% to -1.2%1201200120
gpt-6-solformalimplicitfact_f12.1%-0.2% to 3.9%1201200120
gpt-6-solformalimplicitexact_world24.2%17.9% to 30.4%1201200120
gpt-6-solformalimplicittask_success24.2%17.9% to 30.4%1201200120
gpt-6-solformalimplicitdecision_correct-0.8%-2.5% to 0.0%1201200120
grok-4.6explicitformalfact_f1-12.0%-13.6% to -10.3%1201200120
grok-4.6explicitformalexact_world-78.8%-84.2% to -72.9%1201200120
grok-4.6explicitformaltask_success-78.8%-84.2% to -72.9%1201200120
grok-4.6explicitformaldecision_correct-4.2%-7.5% to -1.2%1201200120
grok-4.6explicitimplicitfact_f12.4%0.1% to 4.6%1201200120
grok-4.6explicitimplicitexact_world0.0%-6.2% to 5.8%1201200120
grok-4.6explicitimplicittask_success0.0%-6.2% to 5.8%1201200120
grok-4.6explicitimplicitdecision_correct0.0%-2.1% to 2.1%1201200120
grok-4.6formalimplicitfact_f114.3%12.2% to 16.4%1201200120
grok-4.6formalimplicitexact_world78.8%72.9% to 84.2%1201200120
grok-4.6formalimplicittask_success78.8%72.9% to 84.2%1201200120
grok-4.6formalimplicitdecision_correct4.2%1.7% to 7.1%1201200120
kimi-k2.6explicitformalfact_f1-7.6%-8.6% to -6.5%1201191119
kimi-k2.6explicitformalexact_world-76.1%-81.5% to -70.2%1201191119
kimi-k2.6explicitformaltask_success-76.1%-81.5% to -70.2%1201191119
kimi-k2.6explicitformaldecision_correct-2.1%-4.2% to -0.4%1201191119
kimi-k2.6explicitimplicitfact_f18.2%5.7% to 10.8%1201191119
kimi-k2.6explicitimplicitexact_world6.3%0.0% to 12.6%1201191119
kimi-k2.6explicitimplicittask_success6.3%0.0% to 12.6%1201191119
kimi-k2.6explicitimplicitdecision_correct1.3%-1.3% to 3.8%1201191119
kimi-k2.6formalimplicitfact_f116.0%13.5% to 18.6%1201200120
kimi-k2.6formalimplicitexact_world82.5%77.1% to 87.5%1201200120
kimi-k2.6formalimplicittask_success82.5%77.1% to 87.5%1201200120
kimi-k2.6formalimplicitdecision_correct3.3%1.2% to 5.8%1201200120
kimi-k3explicitformalfact_f1-15.2%-18.7% to -11.6%120813981
kimi-k3explicitformalexact_world-73.5%-80.2% to -66.7%120813981
kimi-k3explicitformaltask_success-73.5%-80.2% to -66.7%120813981
kimi-k3explicitformaldecision_correct-0.6%-1.9% to 0.0%120813981
kimi-k3explicitimplicitfact_f19.1%4.9% to 13.4%120794179
kimi-k3explicitimplicitexact_world2.5%-5.7% to 11.4%120794179
kimi-k3explicitimplicittask_success2.5%-5.7% to 11.4%120794179
kimi-k3explicitimplicitdecision_correct-0.6%-1.9% to 0.0%120794179
kimi-k3formalimplicitfact_f122.7%17.8% to 27.6%120863486
kimi-k3formalimplicitexact_world72.7%64.5% to 80.2%120863486
kimi-k3formalimplicittask_success72.7%64.5% to 80.2%120863486
kimi-k3formalimplicitdecision_correct0.0%0.0% to 0.0%120863486
mimo-v2.6-flashexplicitformalfact_f1-6.0%-10.0% to -1.6%1201173117
mimo-v2.6-flashexplicitformalexact_world-54.7%-62.0% to -47.0%1201173117
mimo-v2.6-flashexplicitformaltask_success-53.0%-60.7% to -44.4%1201173117
mimo-v2.6-flashexplicitformaldecision_correct-2.1%-7.7% to 3.8%1201173117
mimo-v2.6-flashexplicitimplicitfact_f130.6%24.8% to 36.1%1201155115
mimo-v2.6-flashexplicitimplicitexact_world26.5%19.6% to 33.0%1201155115
mimo-v2.6-flashexplicitimplicittask_success25.7%18.7% to 32.2%1201155115
mimo-v2.6-flashexplicitimplicitdecision_correct4.3%-0.9% to 10.0%1201155115
mimo-v2.6-flashformalimplicitfact_f136.6%30.8% to 42.0%1201173117
mimo-v2.6-flashformalimplicitexact_world81.2%74.8% to 86.8%1201173117
mimo-v2.6-flashformalimplicittask_success78.6%71.8% to 85.0%1201173117
mimo-v2.6-flashformalimplicitdecision_correct6.4%0.0% to 12.8%1201173117
mimo-v2.6-proexplicitformalfact_f1-12.8%-17.1% to -8.0%1201200120
mimo-v2.6-proexplicitformalexact_world-55.4%-62.5% to -47.9%1201200120
mimo-v2.6-proexplicitformaltask_success-55.8%-63.3% to -47.9%1201200120
mimo-v2.6-proexplicitformaldecision_correct-9.2%-14.6% to -3.3%1201200120
mimo-v2.6-proexplicitimplicitfact_f126.3%20.9% to 31.1%1201200120
mimo-v2.6-proexplicitimplicitexact_world26.7%19.6% to 33.8%1201200120
mimo-v2.6-proexplicitimplicittask_success24.6%17.5% to 32.1%1201200120
mimo-v2.6-proexplicitimplicitdecision_correct0.0%-5.8% to 6.2%1201200120
mimo-v2.6-proformalimplicitfact_f139.1%34.4% to 43.6%1201200120
mimo-v2.6-proformalimplicitexact_world82.1%75.8% to 87.9%1201200120
mimo-v2.6-proformalimplicittask_success80.4%73.8% to 86.7%1201200120
mimo-v2.6-proformalimplicitdecision_correct9.2%3.3% to 15.0%1201200120
minimax-m3explicitformalfact_f1-28.0%-33.7% to -22.7%1201200120
minimax-m3explicitformalexact_world-72.9%-79.6% to -66.2%1201200120
minimax-m3explicitformaltask_success-72.9%-79.6% to -66.2%1201200120
minimax-m3explicitformaldecision_correct-0.8%-4.6% to 2.9%1201200120
minimax-m3explicitimplicitfact_f116.6%9.9% to 23.2%1201200120
minimax-m3explicitimplicitexact_world13.3%6.2% to 20.8%1201200120
minimax-m3explicitimplicittask_success13.3%6.2% to 20.8%1201200120
minimax-m3explicitimplicitdecision_correct0.4%-2.5% to 3.3%1201200120
minimax-m3formalimplicitfact_f144.6%38.5% to 50.6%1201200120
minimax-m3formalimplicitexact_world86.2%80.8% to 91.2%1201200120
minimax-m3formalimplicittask_success86.2%80.8% to 91.2%1201200120
minimax-m3formalimplicitdecision_correct1.2%-2.5% to 4.6%1201200120
qwen3.8-27bexplicitformalfact_f1-9.3%-13.8% to -4.3%1201200120
qwen3.8-27bexplicitformalexact_world-71.7%-78.8% to -64.6%1201200120
qwen3.8-27bexplicitformaltask_success-71.7%-78.8% to -64.6%1201200120
qwen3.8-27bexplicitformaldecision_correct1.2%-2.9% to 5.8%1201200120
qwen3.8-27bexplicitimplicitfact_f111.9%7.9% to 15.9%1201200120
qwen3.8-27bexplicitimplicitexact_world12.1%5.8% to 18.3%1201200120
qwen3.8-27bexplicitimplicittask_success12.1%5.8% to 18.3%1201200120
qwen3.8-27bexplicitimplicitdecision_correct-0.4%-2.5% to 1.2%1201200120
qwen3.8-27bformalimplicitfact_f121.2%15.7% to 26.2%1201200120
qwen3.8-27bformalimplicitexact_world83.8%77.9% to 89.2%1201200120
qwen3.8-27bformalimplicittask_success83.8%77.9% to 89.2%1201200120
qwen3.8-27bformalimplicitdecision_correct-1.7%-6.2% to 2.5%1201200120
Structural depth by configured level00 · forward-chain rounds (mean): 1.10 · direct facts (% of vars): 68.811 · forward-chain rounds (mean): 1.91 · direct facts (% of vars): 58.822 · forward-chain rounds (mean): 1.82 · direct facts (% of vars): 63.433 · forward-chain rounds (mean): 2.63 · direct facts (% of vars): 55.844 · forward-chain rounds (mean): 2.54 · direct facts (% of vars): 56.755 · forward-chain rounds (mean): 35 · direct facts (% of vars): 53forward-chain rounds (mean)direct facts (% of vars)
{
  "by_family": {
    "inst-strata-L00-000-theater": {
      "constraint_kinds": {
        "eq": 8
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.875,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-001-maritime": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 6,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-002-hotel": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 5,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-003-manor": {
      "constraint_kinds": {
        "eq": 5,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 5,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-004-manor": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 6,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-005-theater": {
      "constraint_kinds": {
        "eq": 4,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 4,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-006-theater": {
      "constraint_kinds": {
        "eq": 8
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.875,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-007-hotel": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 1
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.875,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-008-maritime": {
      "constraint_kinds": {
        "eq": 5,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 4,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-009-maritime": {
      "constraint_kinds": {
        "eq": 8
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 1.0,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 0,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-010-theater": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 1
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 5,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-011-hotel": {
      "constraint_kinds": {
        "eq": 4,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 4,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-012-manor": {
      "constraint_kinds": {
        "eq": 5,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 2,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 4,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 2,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-013-hotel": {
      "constraint_kinds": {
        "eq": 5,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 5,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-014-theater": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 1,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 2
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 4,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 2,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-015-maritime": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 5,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-016-maritime": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 1
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 5,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 2,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-017-manor": {
      "constraint_kinds": {
        "eq": 8
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 6,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-018-theater": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 6,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L00-019-theater": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 1
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 0
      },
      "direct_assignment_fraction": 0.875,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 8,
      "forward_chain_rounds": 1,
      "n_constraints": 8,
      "n_variables": 8,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-000-hotel": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 1,
        "neq": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V11": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V8": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 9,
      "forward_chain_complete": false,
      "forward_chain_fraction": 0.75,
      "forward_chain_recovered": 9,
      "forward_chain_rounds": 0,
      "n_constraints": 15,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": [
        "V7",
        "V9",
        "V10"
      ]
    },
    "inst-strata-L01-001-manor": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 2,
        "V11": 3,
        "V2": 1,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 3,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-002-observatory": {
      "constraint_kinds": {
        "eq": 8,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 2,
        "V2": 1,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-003-observatory": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 1,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 2,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 6,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-004-observatory": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 2,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 6,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-005-maritime": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 0,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 9,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 1,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-006-theater": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 2,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 2,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-007-hotel": {
      "constraint_kinds": {
        "eq": 8,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 0,
        "V2": 1,
        "V3": 0,
        "V4": 1,
        "V5": 2,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-008-manor": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 1,
        "V2": 0,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 1,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-009-theater": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 2,
        "V11": 3,
        "V2": 3,
        "V3": 2,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 2,
        "V8": 3,
        "V9": 0
      },
      "direct_assignment_fraction": 0.25,
      "direct_assignments": 3,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 3,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-010-manor": {
      "constraint_kinds": {
        "eq": 6,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V2": 2,
        "V3": 0,
        "V4": 1,
        "V5": 1,
        "V6": 0,
        "V7": 1,
        "V8": 2,
        "V9": 1
      },
      "direct_assignment_fraction": 0.3333333333333333,
      "direct_assignments": 4,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-011-theater": {
      "constraint_kinds": {
        "eq": 8,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V2": 0,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 2,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-012-manor": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.8333333333333334,
      "direct_assignments": 10,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 1,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-013-observatory": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 2,
        "V11": 3,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 3,
        "V6": 0,
        "V7": 0,
        "V8": 3,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 3,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-014-theater": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 1,
        "V2": 2,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-015-manor": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 1,
        "V11": 0,
        "V2": 2,
        "V3": 0,
        "V4": 1,
        "V5": 2,
        "V6": 1,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.4166666666666667,
      "direct_assignments": 5,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-016-maritime": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V2": 1,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 1,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-017-observatory": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V2": 2,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-018-manor": {
      "constraint_kinds": {
        "eq": 8,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 2,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L01-019-theater": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 1,
        "V11": 0,
        "V2": 0,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 12,
      "forward_chain_rounds": 2,
      "n_constraints": 12,
      "n_variables": 12,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-000-observatory": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 2,
        "V15": 0,
        "V2": 2,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-001-hotel": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 2,
        "V15": 0,
        "V2": 3,
        "V3": 0,
        "V4": 1,
        "V5": 2,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 3,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-002-maritime": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 1,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-003-hotel": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 1,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 2,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 10,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-004-hotel": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 1,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-005-theater": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 1,
        "V5": 2,
        "V6": 0,
        "V7": 1,
        "V8": 2,
        "V9": 0
      },
      "direct_assignment_fraction": 0.4375,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-006-observatory": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.8125,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-007-observatory": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V2": 2,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-008-hotel": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5625,
      "direct_assignments": 9,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-009-observatory": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 2,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-010-observatory": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 1,
        "V5": 1,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 1,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-011-observatory": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 2,
        "V11": 1,
        "V12": 1,
        "V13": 0,
        "V14": 0,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 12,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-012-theater": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 2,
        "V15": 0,
        "V2": 1,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 1,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-013-manor": {
      "constraint_kinds": {
        "eq": 7,
        "implies": 9
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 2,
        "V6": 0,
        "V7": 1,
        "V8": 2,
        "V9": 0
      },
      "direct_assignment_fraction": 0.4375,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-014-hotel": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 3
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 1,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-015-theater": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 1,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-016-hotel": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 12,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-017-theater": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6875,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 2,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-018-manor": {
      "constraint_kinds": {
        "eq": 15,
        "implies": 1
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.8125,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 1,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L02-019-maritime": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 2,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 1,
        "V2": 2,
        "V3": 0,
        "V4": 2,
        "V5": 3,
        "V6": 0,
        "V7": 0,
        "V8": 3,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 16,
      "forward_chain_rounds": 3,
      "n_constraints": 16,
      "n_variables": 16,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-000-maritime": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 0,
        "V2": 1,
        "V3": 3,
        "V4": 0,
        "V5": 0,
        "V6": 2,
        "V7": 1,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.55,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-001-theater": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 11
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 2,
        "V11": 3,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 3,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 3,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.4,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-002-hotel": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 2
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 1,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 0,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 15,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 1,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-003-theater": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 2,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 0,
        "V2": 2,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 3,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6,
      "direct_assignments": 12,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-004-maritime": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 4,
        "V12": 0,
        "V13": 0,
        "V14": 3,
        "V15": 0,
        "V16": 0,
        "V17": 2,
        "V18": 2,
        "V19": 0,
        "V2": 2,
        "V3": 0,
        "V4": 1,
        "V5": 1,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.65,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 4,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-005-hotel": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 9
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 1,
        "V15": 2,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 2,
        "V2": 1,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 2,
        "V7": 2,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.45,
      "direct_assignments": 9,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 2,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-006-observatory": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 0,
        "V11": 4,
        "V12": 1,
        "V13": 2,
        "V14": 3,
        "V15": 1,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 0,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 2,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6,
      "direct_assignments": 12,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 4,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-007-observatory": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 1,
        "V11": 3,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 3,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 3,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.45,
      "direct_assignments": 9,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-008-theater": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V10": 0,
        "V11": 0,
        "V12": 1,
        "V13": 0,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 2,
        "V18": 1,
        "V19": 1,
        "V2": 0,
        "V3": 2,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.65,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 2,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-009-observatory": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 4,
        "V12": 0,
        "V13": 2,
        "V14": 3,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 0,
        "V2": 3,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.55,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 4,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-010-observatory": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 2,
        "V15": 3,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 0,
        "V2": 1,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 2,
        "V7": 3,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.45,
      "direct_assignments": 9,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-011-manor": {
      "constraint_kinds": {
        "eq": 15,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 1,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 1,
        "V2": 0,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 15,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 1,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-012-theater": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 1,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 1,
        "V2": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.7,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 1,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-013-hotel": {
      "constraint_kinds": {
        "eq": 15,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 2,
        "V16": 0,
        "V17": 2,
        "V18": 0,
        "V19": 4,
        "V2": 0,
        "V3": 1,
        "V4": 1,
        "V5": 0,
        "V6": 3,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.55,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 4,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-014-hotel": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 0,
        "V2": 0,
        "V3": 3,
        "V4": 1,
        "V5": 2,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.55,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-015-manor": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 2,
        "V15": 3,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 2,
        "V2": 1,
        "V3": 3,
        "V4": 0,
        "V5": 0,
        "V6": 2,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 10,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-016-theater": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 1,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 0,
        "V2": 1,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 1,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 10,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 1,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-017-theater": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 2,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 0,
        "V2": 2,
        "V3": 3,
        "V4": 0,
        "V5": 1,
        "V6": 1,
        "V7": 3,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.55,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-018-theater": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 9
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 2,
        "V11": 3,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 3,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 0,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 2,
        "V7": 1,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.45,
      "direct_assignments": 9,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 3,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L03-019-observatory": {
      "constraint_kinds": {
        "eq": 11,
        "implies": 9
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V10": 1,
        "V11": 1,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 2,
        "V2": 2,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 10,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 20,
      "forward_chain_rounds": 2,
      "n_constraints": 20,
      "n_variables": 20,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-000-observatory": {
      "constraint_kinds": {
        "eq": 19,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 2,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 1,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 2,
        "V7": 0,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-001-theater": {
      "constraint_kinds": {
        "eq": 9,
        "implies": 15
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 2,
        "V11": 3,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 3,
        "V2": 2,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 3,
        "V3": 3,
        "V4": 0,
        "V5": 1,
        "V6": 2,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.2916666666666667,
      "direct_assignments": 7,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-002-manor": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 1,
        "V13": 0,
        "V14": 0,
        "V15": 2,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 0,
        "V2": 2,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 1,
        "V3": 3,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-003-hotel": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 1,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 3,
        "V16": 0,
        "V17": 0,
        "V18": 2,
        "V19": 1,
        "V2": 0,
        "V20": 0,
        "V21": 0,
        "V22": 2,
        "V23": 2,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5416666666666666,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-004-maritime": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 0,
        "V2": 0,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 1,
        "V3": 1,
        "V4": 1,
        "V5": 1,
        "V6": 1,
        "V7": 2,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-005-hotel": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 10,
        "neq": 4
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 1,
        "V11": 0,
        "V13": 1,
        "V14": 1,
        "V15": 2,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 1,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 0,
        "V23": 1,
        "V3": 2,
        "V4": 0,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.4583333333333333,
      "direct_assignments": 11,
      "forward_chain_complete": false,
      "forward_chain_fraction": 0.9166666666666666,
      "forward_chain_recovered": 22,
      "forward_chain_rounds": 2,
      "n_constraints": 27,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": [
        "V5",
        "V12"
      ]
    },
    "inst-strata-L04-006-hotel": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 2,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 2,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 2,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 1,
        "V23": 0,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 1,
        "V7": 2,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-007-manor": {
      "constraint_kinds": {
        "eq": 19,
        "implies": 5
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 1,
        "V22": 1,
        "V23": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 2,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.75,
      "direct_assignments": 18,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-008-observatory": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 12
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 1,
        "V12": 1,
        "V13": 2,
        "V14": 1,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 2,
        "V19": 2,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 1,
        "V3": 3,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 3,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.4583333333333333,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-009-maritime": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 2,
        "V15": 3,
        "V16": 0,
        "V17": 0,
        "V18": 2,
        "V19": 0,
        "V2": 0,
        "V20": 0,
        "V21": 0,
        "V22": 2,
        "V23": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 3,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 15,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-010-observatory": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 2,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 1,
        "V2": 2,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 1,
        "V3": 1,
        "V4": 1,
        "V5": 0,
        "V6": 2,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5416666666666666,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-011-observatory": {
      "constraint_kinds": {
        "eq": 17,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 2,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 1,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 2,
        "V2": 2,
        "V20": 0,
        "V21": 1,
        "V22": 0,
        "V23": 0,
        "V3": 3,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 15,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-012-theater": {
      "constraint_kinds": {
        "eq": 17,
        "implies": 7
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 1,
        "V22": 0,
        "V23": 2,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 2,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.625,
      "direct_assignments": 15,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-013-theater": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 2,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 2,
        "V22": 1,
        "V23": 0,
        "V3": 2,
        "V4": 1,
        "V5": 1,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-014-manor": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 1,
        "V14": 1,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 1,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 0,
        "V23": 0,
        "V3": 3,
        "V4": 0,
        "V5": 0,
        "V6": 2,
        "V7": 3,
        "V8": 1,
        "V9": 1
      },
      "direct_assignment_fraction": 0.4583333333333333,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-015-observatory": {
      "constraint_kinds": {
        "eq": 15,
        "implies": 9
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 0,
        "V15": 3,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 0,
        "V2": 2,
        "V20": 0,
        "V21": 0,
        "V22": 2,
        "V23": 3,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 2,
        "V8": 1,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5833333333333334,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-016-observatory": {
      "constraint_kinds": {
        "eq": 13,
        "implies": 11
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 2,
        "V10": 1,
        "V11": 0,
        "V12": 0,
        "V13": 1,
        "V14": 3,
        "V15": 0,
        "V16": 1,
        "V17": 0,
        "V18": 3,
        "V19": 1,
        "V2": 0,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 1,
        "V3": 2,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 4,
        "V8": 0,
        "V9": 2
      },
      "direct_assignment_fraction": 0.4583333333333333,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 4,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-017-observatory": {
      "constraint_kinds": {
        "eq": 20,
        "implies": 4
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 3,
        "V11": 2,
        "V12": 0,
        "V13": 2,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6666666666666666,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 3,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-018-hotel": {
      "constraint_kinds": {
        "eq": 12,
        "implies": 12
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 1,
        "V14": 0,
        "V15": 1,
        "V16": 0,
        "V17": 0,
        "V18": 2,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 1,
        "V3": 1,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 2,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.4583333333333333,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L04-019-maritime": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 2,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 0,
        "V3": 1,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 2,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.7083333333333334,
      "direct_assignments": 17,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 24,
      "forward_chain_rounds": 2,
      "n_constraints": 24,
      "n_variables": 24,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-000-theater": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 14
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 2,
        "V12": 2,
        "V13": 0,
        "V14": 1,
        "V15": 3,
        "V16": 1,
        "V17": 2,
        "V18": 0,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 2,
        "V23": 0,
        "V24": 1,
        "V25": 0,
        "V26": 1,
        "V27": 1,
        "V3": 3,
        "V4": 1,
        "V5": 0,
        "V6": 1,
        "V7": 1,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.39285714285714285,
      "direct_assignments": 11,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-001-maritime": {
      "constraint_kinds": {
        "eq": 17,
        "implies": 11
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 2,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 1,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 1,
        "V22": 0,
        "V23": 2,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 0,
        "V3": 0,
        "V4": 3,
        "V5": 0,
        "V6": 1,
        "V7": 2,
        "V8": 1,
        "V9": 2
      },
      "direct_assignment_fraction": 0.5714285714285714,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-002-maritime": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 12
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 2,
        "V14": 1,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 1,
        "V19": 3,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 2,
        "V23": 0,
        "V24": 0,
        "V25": 0,
        "V26": 0,
        "V27": 2,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 1,
        "V7": 1,
        "V8": 2,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-003-manor": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 2,
        "V13": 0,
        "V14": 2,
        "V15": 0,
        "V16": 1,
        "V17": 0,
        "V18": 0,
        "V19": 1,
        "V2": 2,
        "V20": 0,
        "V21": 1,
        "V22": 0,
        "V23": 1,
        "V24": 1,
        "V25": 0,
        "V26": 1,
        "V27": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 2,
        "V8": 3,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5714285714285714,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-004-maritime": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V16": 1,
        "V17": 2,
        "V18": 0,
        "V19": 1,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 3,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 1,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5714285714285714,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-005-theater": {
      "constraint_kinds": {
        "eq": 19,
        "implies": 9
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 1,
        "V11": 2,
        "V12": 1,
        "V13": 4,
        "V14": 5,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 1,
        "V19": 0,
        "V2": 3,
        "V20": 0,
        "V21": 0,
        "V22": 3,
        "V23": 4,
        "V24": 2,
        "V25": 0,
        "V26": 0,
        "V27": 0,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 1,
        "V8": 4,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 5,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-006-hotel": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 1,
        "V12": 2,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V16": 1,
        "V17": 0,
        "V18": 0,
        "V19": 2,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 0,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 1,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.6071428571428571,
      "direct_assignments": 17,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 2,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-007-manor": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 1,
        "V13": 0,
        "V14": 2,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 0,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 0,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 0,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 2,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6428571428571429,
      "direct_assignments": 18,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 2,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-008-theater": {
      "constraint_kinds": {
        "eq": 20,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 1,
        "V13": 4,
        "V14": 0,
        "V15": 0,
        "V16": 2,
        "V17": 0,
        "V18": 0,
        "V19": 0,
        "V2": 0,
        "V20": 0,
        "V21": 2,
        "V22": 0,
        "V23": 1,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 3,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 0,
        "V9": 0
      },
      "direct_assignment_fraction": 0.6071428571428571,
      "direct_assignments": 17,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 4,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-009-theater": {
      "constraint_kinds": {
        "eq": 15,
        "implies": 13
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 2,
        "V12": 1,
        "V13": 0,
        "V14": 3,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 2,
        "V19": 0,
        "V2": 1,
        "V20": 0,
        "V21": 1,
        "V22": 3,
        "V23": 0,
        "V24": 0,
        "V25": 0,
        "V26": 0,
        "V27": 3,
        "V3": 2,
        "V4": 1,
        "V5": 1,
        "V6": 1,
        "V7": 1,
        "V8": 2,
        "V9": 0
      },
      "direct_assignment_fraction": 0.42857142857142855,
      "direct_assignments": 12,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-010-theater": {
      "constraint_kinds": {
        "eq": 19,
        "implies": 9
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 1,
        "V12": 1,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 3,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 2,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 1,
        "V3": 0,
        "V4": 0,
        "V5": 2,
        "V6": 1,
        "V7": 2,
        "V8": 0,
        "V9": 3
      },
      "direct_assignment_fraction": 0.5357142857142857,
      "direct_assignments": 15,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-011-hotel": {
      "constraint_kinds": {
        "eq": 17,
        "implies": 11
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 1,
        "V12": 1,
        "V13": 1,
        "V14": 3,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 2,
        "V19": 0,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 1,
        "V23": 2,
        "V24": 0,
        "V25": 0,
        "V26": 0,
        "V27": 0,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 1,
        "V8": 1,
        "V9": 2
      },
      "direct_assignment_fraction": 0.5357142857142857,
      "direct_assignments": 15,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-012-observatory": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 12
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 0,
        "V14": 3,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 2,
        "V19": 1,
        "V2": 1,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 1,
        "V24": 0,
        "V25": 0,
        "V26": 0,
        "V27": 2,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 1,
        "V9": 2
      },
      "direct_assignment_fraction": 0.5,
      "direct_assignments": 14,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-013-observatory": {
      "constraint_kinds": {
        "eq": 22,
        "implies": 6
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 0,
        "V13": 2,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 1,
        "V18": 0,
        "V19": 2,
        "V2": 0,
        "V20": 0,
        "V21": 1,
        "V22": 0,
        "V23": 0,
        "V24": 0,
        "V25": 0,
        "V26": 0,
        "V27": 1,
        "V3": 1,
        "V4": 0,
        "V5": 0,
        "V6": 1,
        "V7": 0,
        "V8": 0,
        "V9": 1
      },
      "direct_assignment_fraction": 0.7142857142857143,
      "direct_assignments": 20,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 2,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-014-theater": {
      "constraint_kinds": {
        "eq": 20,
        "implies": 8
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 1,
        "V12": 1,
        "V13": 2,
        "V14": 0,
        "V15": 0,
        "V16": 2,
        "V17": 1,
        "V18": 1,
        "V19": 0,
        "V2": 0,
        "V20": 0,
        "V21": 0,
        "V22": 1,
        "V23": 0,
        "V24": 1,
        "V25": 0,
        "V26": 0,
        "V27": 0,
        "V3": 0,
        "V4": 0,
        "V5": 0,
        "V6": 0,
        "V7": 1,
        "V8": 1,
        "V9": 0
      },
      "direct_assignment_fraction": 0.5714285714285714,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 2,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-015-maritime": {
      "constraint_kinds": {
        "eq": 16,
        "implies": 12
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 0,
        "V12": 2,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V16": 0,
        "V17": 2,
        "V18": 2,
        "V19": 3,
        "V2": 1,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 2,
        "V24": 1,
        "V25": 0,
        "V26": 1,
        "V27": 0,
        "V3": 0,
        "V4": 0,
        "V5": 1,
        "V6": 0,
        "V7": 1,
        "V8": 0,
        "V9": 3
      },
      "direct_assignment_fraction": 0.4642857142857143,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-016-manor": {
      "constraint_kinds": {
        "eq": 18,
        "implies": 10
      },
      "derivation_rounds": {
        "V0": 1,
        "V1": 0,
        "V10": 0,
        "V11": 0,
        "V12": 2,
        "V13": 0,
        "V14": 1,
        "V15": 0,
        "V16": 2,
        "V17": 0,
        "V18": 2,
        "V19": 3,
        "V2": 1,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 0,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 2,
        "V3": 0,
        "V4": 1,
        "V5": 0,
        "V6": 0,
        "V7": 0,
        "V8": 3,
        "V9": 1
      },
      "direct_assignment_fraction": 0.5714285714285714,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 3,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-017-theater": {
      "constraint_kinds": {
        "eq": 17,
        "implies": 11
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 2,
        "V13": 1,
        "V14": 0,
        "V15": 0,
        "V16": 1,
        "V17": 0,
        "V18": 0,
        "V19": 2,
        "V2": 2,
        "V20": 0,
        "V21": 0,
        "V22": 0,
        "V23": 0,
        "V24": 0,
        "V25": 0,
        "V26": 0,
        "V27": 0,
        "V3": 0,
        "V4": 2,
        "V5": 0,
        "V6": 1,
        "V7": 1,
        "V8": 1,
        "V9": 2
      },
      "direct_assignment_fraction": 0.5714285714285714,
      "direct_assignments": 16,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 2,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-018-manor": {
      "constraint_kinds": {
        "eq": 10,
        "implies": 18
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 1,
        "V11": 1,
        "V12": 2,
        "V13": 3,
        "V14": 4,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 2,
        "V19": 3,
        "V2": 2,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 2,
        "V24": 4,
        "V25": 1,
        "V26": 1,
        "V27": 1,
        "V3": 0,
        "V4": 3,
        "V5": 0,
        "V6": 0,
        "V7": 2,
        "V8": 3,
        "V9": 3
      },
      "direct_assignment_fraction": 0.2857142857142857,
      "direct_assignments": 8,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 4,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    },
    "inst-strata-L05-019-theater": {
      "constraint_kinds": {
        "eq": 14,
        "implies": 14
      },
      "derivation_rounds": {
        "V0": 0,
        "V1": 1,
        "V10": 0,
        "V11": 1,
        "V12": 0,
        "V13": 3,
        "V14": 0,
        "V15": 0,
        "V16": 0,
        "V17": 0,
        "V18": 0,
        "V19": 4,
        "V2": 2,
        "V20": 0,
        "V21": 1,
        "V22": 2,
        "V23": 1,
        "V24": 0,
        "V25": 0,
        "V26": 1,
        "V27": 2,
        "V3": 3,
        "V4": 1,
        "V5": 0,
        "V6": 1,
        "V7": 2,
        "V8": 0,
        "V9": 4
      },
      "direct_assignment_fraction": 0.4642857142857143,
      "direct_assignments": 13,
      "forward_chain_complete": true,
      "forward_chain_fraction": 1.0,
      "forward_chain_recovered": 28,
      "forward_chain_rounds": 4,
      "n_constraints": 28,
      "n_variables": 28,
      "note": "Depth measures this propagator, not minimum proof length or intrinsic difficulty.",
      "unresolved_by_forward_chain": []
    }
  },
  "families_measured": 120,
  "numeric_summary": {
    "direct_assignment_fraction": {
      "max": 1.0,
      "mean": 0.5939831349206349,
      "min": 0.25,
      "n": 120
    },
    "direct_assignments": {
      "max": 20,
      "mean": 10.383333333333333,
      "min": 3,
      "n": 120
    },
    "forward_chain_fraction": {
      "max": 1.0,
      "mean": 0.9972222222222222,
      "min": 0.75,
      "n": 120
    },
    "forward_chain_recovered": {
      "max": 28,
      "mean": 17.958333333333332,
      "min": 8,
      "n": 120
    },
    "forward_chain_rounds": {
      "max": 5,
      "mean": 2.158333333333333,
      "min": 0,
      "n": 120
    },
    "n_constraints": {
      "max": 28,
      "mean": 18.05,
      "min": 8,
      "n": 120
    },
    "n_variables": {
      "max": 28,
      "mean": 18.0,
      "min": 8,
      "n": 120
    }
  }
}

The full solver inputs (all realizations), hidden fact patterns, and per-record details are large, so they live in a companion file that loads separately:

Open stories & raw records

The companion file contains every solver input, the hidden fact pattern per world, decision policies with measured difficulty, and the full per-record JSON for all providers.

Earned decisions (/100) — correct actions on an exactly-right worldgpt-6-astragpt-6-astra · decision correct (/100): 87.6gpt-6-solgpt-6-sol · decision correct (/100): 75.7gemini-3.7-flashgemini-3.7-flash · decision correct (/100): 69.2gpt-5.6-solgpt-5.6-sol · decision correct (/100): 68.5gemini-3.8-flashgemini-3.8-flash · decision correct (/100): 59.5glm-5.3glm-5.3 · decision correct (/100): 60.3gpt-5.6-terragpt-5.6-terra · decision correct (/100): 50.8deepseek-4.1-flashdeepseek-4.1-flash · decision correct (/100): 49.1gemini-3.6-flashgemini-3.6-flash · decision correct (/100): 44.7deepseek-v4-prodeepseek-v4-pro · decision correct (/100): 47.3gpt-6-lunagpt-6-luna · decision correct (/100): 44claude-sonnet-5claude-sonnet-5 · decision correct (/100): 60.5gpt-5.6-lunagpt-5.6-luna · decision correct (/100): 44.5claude-opus-5.5claude-opus-5.5 · decision correct (/100): 45.2claude-fable-5claude-fable-5 · decision correct (/100): 61.6mimo-v2.6-flashmimo-v2.6-flash · decision correct (/100): 49.3mimo-v2.6-promimo-v2.6-pro · decision correct (/100): 49.5claude-opus-5claude-opus-5 · decision correct (/100): 61.1grok-4.6grok-4.6 · decision correct (/100): 40.3kimi-k2.6kimi-k2.6 · decision correct (/100): 38.7minimax-m3minimax-m3 · decision correct (/100): 37.2qwen3.8-27bqwen3.8-27b · decision correct (/100): 36.7kimi-k3kimi-k3 · decision correct (/100): 42.4glm-5.3-flashglm-5.3-flash · decision correct (/100): 27.7claude-haiku-4.5claude-haiku-4.5 · decision correct (/100): 28.2glm-4.7-flashglm-4.7-flash · decision correct (/100): 38.2claude-fable-5.1claude-fable-5.1 · decision correct (/100): 71.4decision correct (/100)
Configured level: 0
InstanceProviderStatusCorrectSubmitted action
inst-strata-L00-000-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1claude-sonnet-5invalid_response0.0%
null
inst-strata-L00-000-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L00-000-theater--explicit-r1mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L00-000-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "1"
}
inst-strata-L00-000-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-000-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-000-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-000-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-000-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-000-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-000-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-000-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L00-000-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "1"
}
inst-strata-L00-000-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-000-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-000-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "1"
}
inst-strata-L00-000-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-000-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": 1
}
inst-strata-L00-000-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-001-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L00-001-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L00-001-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-001-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-001-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-001-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-001-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-001-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-001-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-001-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-001-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-001-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-001-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L00-001-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1claude-opus-5.5answered0.0%
null
inst-strata-L00-001-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-001-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-001-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-001-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2glm-5.3answered0.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": "3"
}
inst-strata-L00-001-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L00-001-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 3
}
inst-strata-L00-001-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-001-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-001-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-002-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L00-002-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-002-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-002-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-002-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gpt-6-solanswered0.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": "1"
}
inst-strata-L00-002-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-002-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-002-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-002-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L00-002-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-002-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L00-002-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-002-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-002-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-002-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L00-002-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L00-002-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-002-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-002-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-002-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": "1"
}
inst-strata-L00-002-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": 1
}
inst-strata-L00-002-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-002-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-002-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-003-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L00-003-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-003-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-003-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2claude-opus-5content_filter—
null
inst-strata-L00-003-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-003-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-003-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0deepseek-v4-proinvalid_response0.0%
null
inst-strata-L00-003-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-003-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-003-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-003-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L00-003-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-003-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-003-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L00-003-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2claude-opus-5content_filter—
null
inst-strata-L00-003-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-003-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Juno"
}
inst-strata-L00-003-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-004-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-004-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-004-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-004-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2mimo-v2.6-flashtransport_error—
null
inst-strata-L00-004-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-004-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-004-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-004-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-004-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L00-004-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-004-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-004-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-004-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-004-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-004-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-004-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L00-004-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2claude-opus-5content_filter—
null
inst-strata-L00-004-manor--implicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "3"
}
inst-strata-L00-004-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": 3
}
inst-strata-L00-004-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-004-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-004-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-005-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1mimo-v2.6-flashtransport_error—
null
inst-strata-L00-005-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-005-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-005-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-005-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L00-005-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-005-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-005-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-005-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-005-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-005-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-005-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-005-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1mimo-v2.6-flashtransport_error—
null
inst-strata-L00-005-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-005-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-005-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-005-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2claude-sonnet-5invalid_response0.0%
null
inst-strata-L00-005-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L00-005-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-005-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-005-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-006-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L00-006-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-006-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-006-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L00-006-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2claude-haiku-4.5answered0.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "signed out under Galia"
}
inst-strata-L00-006-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-006-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-006-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-006-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-006-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-006-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1kimi-k2.6answered0.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia's mark"
}
inst-strata-L00-006-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "carried Galia's mark"
}
inst-strata-L00-006-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-006-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-006-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L00-006-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "signed out under Galia"
}
inst-strata-L00-006-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-006-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": "Galia"
}
inst-strata-L00-006-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-007-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-007-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-007-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-007-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--explicit-r2glm-4.7-flashinvalid_response0.0%
null
inst-strata-L00-007-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-007-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-007-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-007-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L00-007-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-007-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L00-007-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-007-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-007-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-007-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L00-007-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-007-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-007-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-007-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lift log",
  "value": "Iris"
}
inst-strata-L00-007-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-007-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-007-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-008-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-008-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-008-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-008-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2minimax-m3invalid_response0.0%
null
inst-strata-L00-008-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-008-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-008-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-008-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-008-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-008-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-008-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-008-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-008-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-008-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-008-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L00-008-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2claude-fable-5content_filter—
null
inst-strata-L00-008-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2claude-fable-5.1answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "Roan"
}
inst-strata-L00-008-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-008-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-009-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1claude-fable-5content_filter—
null
inst-strata-L00-009-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1glm-5.3-flashtransport_error—
null
inst-strata-L00-009-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-009-maritime--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-009-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2glm-5.3transport_error—
null
inst-strata-L00-009-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro's mark"
}
inst-strata-L00-009-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-009-maritime--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-009-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-009-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-009-maritime--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-009-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-009-maritime--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-009-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro's mark"
}
inst-strata-L00-009-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-009-maritime--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Ferro"
}
inst-strata-L00-009-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-010-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-010-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-010-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-010-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L00-010-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-010-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-010-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-010-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-010-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0claude-haiku-4.5invalid_response0.0%
null
inst-strata-L00-010-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-010-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-010-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-010-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L00-010-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-010-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-010-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-010-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": "Ansel"
}
inst-strata-L00-010-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-010-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-010-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-011-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L00-011-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-011-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-011-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-011-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2kimi-k3transport_error—
null
inst-strata-L00-011-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-011-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-011-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-011-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L00-011-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-011-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-011-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-011-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-011-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L00-011-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-011-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-011-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-011-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2claude-sonnet-5invalid_response0.0%
null
inst-strata-L00-011-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 2
}
inst-strata-L00-011-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-011-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-011-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-012-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1kimi-k3transport_error—
null
inst-strata-L00-012-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": "4"
}
inst-strata-L00-012-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-012-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-012-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-012-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2claude-fable-5content_filter—
null
inst-strata-L00-012-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2kimi-k3transport_error—
null
inst-strata-L00-012-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-012-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-012-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-012-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-012-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-012-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-012-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-012-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L00-012-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1claude-opus-5content_filter—
null
inst-strata-L00-012-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-012-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-012-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-012-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "register",
  "subject": "mill ledger",
  "value": 2
}
inst-strata-L00-012-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L00-012-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mill ledger",
  "value": 4
}
inst-strata-L00-012-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-012-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-012-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-013-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-013-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-013-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-013-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-013-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-013-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-013-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L00-013-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-013-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-013-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-013-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-013-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-013-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-013-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-013-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2mimo-v2.6-flashtransport_error—
null
inst-strata-L00-013-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "bar ledger",
  "value": "Galia"
}
inst-strata-L00-013-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-013-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-013-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-014-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L00-014-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L00-014-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-014-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-014-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-014-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L00-014-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L00-014-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-014-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-014-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-014-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-014-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-014-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-014-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-014-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L00-014-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-014-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-014-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-014-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "Cassia"
}
inst-strata-L00-014-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-014-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-014-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-015-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-015-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-015-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-015-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2deepseek-v4-proinvalid_response0.0%
null
inst-strata-L00-015-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L00-015-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-015-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-015-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-015-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-015-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-015-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-015-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-015-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1glm-5.3transport_error—
null
inst-strata-L00-015-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L00-015-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1mimo-v2.6-flashtransport_error—
null
inst-strata-L00-015-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L00-015-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": "1"
}
inst-strata-L00-015-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-015-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-015-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-015-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2glm-5.3answered0.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": "1"
}
inst-strata-L00-015-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L00-015-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2claude-fable-5content_filter—
null
inst-strata-L00-015-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": "1"
}
inst-strata-L00-015-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "broker's stamp",
  "value": 1
}
inst-strata-L00-015-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-015-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-015-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-016-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1claude-fable-5content_filter—
null
inst-strata-L00-016-maritime--explicit-r1mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L00-016-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-016-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-016-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-016-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gpt-6-solanswered0.0%
{
  "operation": "hold",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2claude-fable-5content_filter—
null
inst-strata-L00-016-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-016-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-016-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-016-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-016-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-016-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-016-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-016-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "3"
}
inst-strata-L00-016-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L00-016-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": "3"
}
inst-strata-L00-016-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-016-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-016-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-016-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "crate mark",
  "value": 3
}
inst-strata-L00-016-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-016-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-016-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-017-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gemini-3.8-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1claude-sonnet-5answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1minimax-m3answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": "4"
}
inst-strata-L00-017-manor--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-017-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-017-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-017-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gpt-6-solinvalid_response0.0%
null
inst-strata-L00-017-manor--explicit-r2gemini-3.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2glm-5.3answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gemini-3.6-flashinvalid_response0.0%
null
inst-strata-L00-017-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gpt-6-lunaanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L00-017-manor--explicit-r2claude-fable-5content_filter—
null
inst-strata-L00-017-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2qwen3.8-27binvalid_response0.0%
null
inst-strata-L00-017-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-017-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-017-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-017-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-017-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-017-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-017-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-017-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-017-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-017-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-017-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2grok-4.6answered0.0%
null
inst-strata-L00-017-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tenant roll",
  "value": 4
}
inst-strata-L00-017-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-017-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-017-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-018-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin's mark"
}
inst-strata-L00-018-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin's mark"
}
inst-strata-L00-018-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-018-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-018-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-018-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin's mark"
}
inst-strata-L00-018-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-018-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-018-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-018-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-018-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-018-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-018-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-018-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin's mark"
}
inst-strata-L00-018-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1claude-opus-5content_filter—
null
inst-strata-L00-018-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin's mark"
}
inst-strata-L00-018-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-018-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-018-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-018-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L00-018-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2claude-haiku-4.5invalid_response0.0%
null
inst-strata-L00-018-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "Corin"
}
inst-strata-L00-018-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-018-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-018-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-019-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L00-019-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-019-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-019-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-019-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--explicit-r2glm-4.7-flashanswered0.0%
null
inst-strata-L00-019-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-019-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-019-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-019-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L00-019-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L00-019-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L00-019-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-019-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L00-019-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L00-019-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L00-019-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L00-019-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": "Wren"
}
inst-strata-L00-019-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 2
}
inst-strata-L00-019-theater--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": "2"
}
inst-strata-L00-019-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L00-019-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L00-019-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
Configured level: 1
InstanceProviderStatusCorrectSubmitted action
inst-strata-L01-000-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1glm-5.3transport_error—
null
inst-strata-L01-000-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L01-000-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L01-000-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-000-hotel--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-000-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-000-hotel--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-000-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L01-000-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-000-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-000-hotel--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-000-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-000-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-000-hotel--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-000-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-000-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2claude-fable-5content_filter—
null
inst-strata-L01-000-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-000-hotel--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "patrol book",
  "value": "Silas"
}
inst-strata-L01-000-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-001-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1glm-5.3transport_error—
null
inst-strata-L01-001-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-001-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-001-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-001-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2glm-5.3transport_error—
null
inst-strata-L01-001-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2claude-fable-5content_filter—
null
inst-strata-L01-001-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-001-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-001-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-001-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-001-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-001-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-001-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-001-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1glm-5.3transport_error—
null
inst-strata-L01-001-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-001-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L01-001-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-001-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-001-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-001-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L01-001-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-001-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2claude-opus-5content_filter—
null
inst-strata-L01-001-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Lyra"
}
inst-strata-L01-001-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-001-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-001-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-002-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-002-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-002-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-002-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-002-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-002-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-002-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-002-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-002-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-002-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-002-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-002-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-002-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-002-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-002-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-002-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L01-002-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "Petra"
}
inst-strata-L01-002-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-002-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-002-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-003-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1deepseek-v4-proinvalid_response0.0%
null
inst-strata-L01-003-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L01-003-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-003-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-003-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-003-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gpt-6-solanswered0.0%
null
inst-strata-L01-003-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L01-003-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2qwen3.8-27binvalid_response0.0%
null
inst-strata-L01-003-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-003-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-003-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-003-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-003-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-003-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-003-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-003-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-003-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-003-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-003-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-003-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-003-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-003-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L01-003-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2minimax-m3invalid_response0.0%
null
inst-strata-L01-003-observatory--implicit-r2qwen3.8-27binvalid_response0.0%
null
inst-strata-L01-003-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "Wren"
}
inst-strata-L01-003-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-003-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-003-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-004-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-004-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-004-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-004-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2claude-sonnet-5answered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2claude-opus-5answered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2qwen3.8-27banswered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-004-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-004-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-004-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-004-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-004-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-004-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-004-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1claude-opus-5.5content_filter—
null
inst-strata-L01-004-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": "2"
}
inst-strata-L01-004-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-004-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-004-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-004-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2qwen3.8-27banswered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": 2
}
inst-strata-L01-004-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-004-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-004-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-005-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-005-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-005-maritime--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-005-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-005-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2claude-fable-5content_filter—
null
inst-strata-L01-005-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L01-005-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-005-maritime--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-005-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-005-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-005-maritime--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-005-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-005-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-005-maritime--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-005-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-005-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2claude-fable-5content_filter—
null
inst-strata-L01-005-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-005-maritime--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": 3
}
inst-strata-L01-005-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-006-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-006-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L01-006-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-006-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-006-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-006-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L01-006-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-006-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-006-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-006-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-006-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-006-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-006-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-006-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-006-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-006-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-006-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prompt book",
  "value": "Halden"
}
inst-strata-L01-006-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-006-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-006-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-007-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-007-hotel--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-007-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-007-hotel--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-007-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L01-007-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-007-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-007-hotel--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-007-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-007-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1glm-5.3-flashanswered0.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "3"
}
inst-strata-L01-007-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-007-hotel--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-007-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2claude-sonnet-5invalid_response0.0%
null
inst-strata-L01-007-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "3"
}
inst-strata-L01-007-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-007-hotel--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": 3
}
inst-strata-L01-007-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-008-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-008-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-008-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-008-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-008-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2claude-fable-5content_filter—
null
inst-strata-L01-008-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2claude-opus-5content_filter—
null
inst-strata-L01-008-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2kimi-k3transport_error—
null
inst-strata-L01-008-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2glm-4.7-flashinvalid_response0.0%
null
inst-strata-L01-008-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-008-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-008-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-008-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-008-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-008-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-008-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-008-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1claude-opus-5content_filter—
null
inst-strata-L01-008-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-008-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-008-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-008-manor--implicit-r2gpt-5.6-lunaanswered0.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": 4
}
inst-strata-L01-008-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L01-008-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2claude-opus-5content_filter—
null
inst-strata-L01-008-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-008-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Sable"
}
inst-strata-L01-008-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-009-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1deepseek-v4-proinvalid_response0.0%
null
inst-strata-L01-009-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1claude-opus-5.5answered0.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "2"
}
inst-strata-L01-009-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-009-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-009-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-009-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-009-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L01-009-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2glm-5.3-flashtransport_error—
null
inst-strata-L01-009-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "2"
}
inst-strata-L01-009-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-009-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-009-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-009-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-009-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-009-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-009-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-009-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-009-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "2"
}
inst-strata-L01-009-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-009-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-009-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-009-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L01-009-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2claude-opus-5content_filter—
null
inst-strata-L01-009-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": 2
}
inst-strata-L01-009-theater--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "costume plot",
  "value": "2"
}
inst-strata-L01-009-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-009-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-009-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-010-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-010-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-010-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-010-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2claude-haiku-4.5invalid_response0.0%
null
inst-strata-L01-010-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-010-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-010-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-010-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-010-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-010-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-010-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-010-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-010-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-010-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L01-010-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": "1"
}
inst-strata-L01-010-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-010-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "parish register",
  "value": 1
}
inst-strata-L01-010-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-011-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-011-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L01-011-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-011-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-011-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-011-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L01-011-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-011-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-011-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-011-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-011-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-011-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-011-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-011-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-011-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-011-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-011-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-011-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L01-011-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "costume plot",
  "value": "Silas"
}
inst-strata-L01-011-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-011-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-011-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-012-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1kimi-k3transport_error—
null
inst-strata-L01-012-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-012-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-012-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-012-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-012-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-012-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-012-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-012-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-012-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas's mark"
}
inst-strata-L01-012-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-012-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-012-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-012-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-012-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "Silas"
}
inst-strata-L01-012-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-013-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L01-013-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-013-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-013-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L01-013-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-013-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-013-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-013-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-013-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-013-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-013-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-013-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L01-013-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-013-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-013-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L01-013-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-013-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 1
}
inst-strata-L01-013-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-014-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-014-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L01-014-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-014-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-014-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-014-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-014-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-014-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-014-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-014-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-014-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L01-014-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L01-014-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-014-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-014-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": "3"
}
inst-strata-L01-014-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2claude-opus-5content_filter—
null
inst-strata-L01-014-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": "3"
}
inst-strata-L01-014-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-014-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L01-014-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-015-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1glm-5.3invalid_response0.0%
null
inst-strata-L01-015-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-015-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1kimi-k3transport_error—
null
inst-strata-L01-015-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-015-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-015-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-015-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2kimi-k3transport_error—
null
inst-strata-L01-015-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-015-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-015-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-015-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-015-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-015-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-015-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-015-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-015-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1claude-opus-5content_filter—
null
inst-strata-L01-015-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1kimi-k3transport_error—
null
inst-strata-L01-015-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L01-015-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-015-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-015-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-015-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-015-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L01-015-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "parish register",
  "value": 2
}
inst-strata-L01-015-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-015-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-015-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-016-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1kimi-k3transport_error—
null
inst-strata-L01-016-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-016-maritime--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-016-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L01-016-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2kimi-k3transport_error—
null
inst-strata-L01-016-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2claude-fable-5.1transport_error—
null
inst-strata-L01-016-maritime--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-016-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-016-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-016-maritime--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-016-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1kimi-k3transport_error—
null
inst-strata-L01-016-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-016-maritime--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-016-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-016-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2kimi-k3transport_error—
null
inst-strata-L01-016-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": "3"
}
inst-strata-L01-016-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-016-maritime--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 3
}
inst-strata-L01-016-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-017-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1kimi-k3transport_error—
null
inst-strata-L01-017-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-017-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-017-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-017-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L01-017-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L01-017-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-017-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-017-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-017-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-017-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-017-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L01-017-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-017-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-017-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1kimi-k3transport_error—
null
inst-strata-L01-017-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-017-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L01-017-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-017-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-017-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Odile"
}
inst-strata-L01-017-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-017-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L01-017-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-018-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-018-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-018-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-018-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-018-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2claude-fable-5content_filter—
null
inst-strata-L01-018-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-018-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-018-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-018-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-018-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-018-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L01-018-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-018-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1claude-opus-5content_filter—
null
inst-strata-L01-018-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-018-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-018-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L01-018-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-018-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "tithe receipt",
  "value": 4
}
inst-strata-L01-018-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-019-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1glm-5.3transport_error—
null
inst-strata-L01-019-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L01-019-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L01-019-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-019-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-019-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2glm-5.3-flashtransport_error—
null
inst-strata-L01-019-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-019-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-019-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L01-019-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L01-019-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-019-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L01-019-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": "2"
}
inst-strata-L01-019-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L01-019-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L01-019-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L01-019-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L01-019-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "rehearsal log",
  "value": 2
}
inst-strata-L01-019-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
Configured level: 2
InstanceProviderStatusCorrectSubmitted action
inst-strata-L02-000-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-000-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-000-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-000-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-000-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-000-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-000-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-000-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-000-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-000-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-000-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-000-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-000-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Cassia"
}
inst-strata-L02-000-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-001-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-001-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L02-001-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-001-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-001-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-001-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "register",
  "subject": "left-luggage ticket",
  "value": "Lyra"
}
inst-strata-L02-001-hotel--explicit-r2gpt-6-lunainvalid_response0.0%
null
inst-strata-L02-001-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-001-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-001-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-001-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-001-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L02-001-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-001-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-001-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-001-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-001-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-001-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-001-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-001-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L02-001-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2claude-opus-5content_filter—
null
inst-strata-L02-001-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2qwen3.8-27binvalid_response0.0%
null
inst-strata-L02-001-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "left-luggage ticket",
  "value": "Halden"
}
inst-strata-L02-001-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-001-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-001-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-002-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-002-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-002-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-002-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-002-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L02-002-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-002-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-002-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-002-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-002-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-002-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-002-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-002-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-002-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-002-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-002-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-002-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-002-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "consignment tag",
  "value": "Marek"
}
inst-strata-L02-002-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-002-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-002-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-003-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-003-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": "3"
}
inst-strata-L02-003-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-003-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-003-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-003-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": "3"
}
inst-strata-L02-003-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-003-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-003-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-003-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L02-003-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-003-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-003-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-003-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-003-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-003-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": "3"
}
inst-strata-L02-003-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-003-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-003-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-003-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2kimi-k3transport_error—
null
inst-strata-L02-003-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "switchboard log",
  "value": 3
}
inst-strata-L02-003-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-003-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-003-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-004-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-004-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-004-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-004-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-004-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-004-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-004-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-004-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L02-004-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L02-004-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-004-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-004-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-004-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-004-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1glm-5.3invalid_response0.0%
null
inst-strata-L02-004-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-004-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-004-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-004-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-004-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Halden"
}
inst-strata-L02-004-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-004-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-004-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-005-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-005-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-005-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-005-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-005-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2glm-5.3transport_error—
null
inst-strata-L02-005-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-005-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": "4"
}
inst-strata-L02-005-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-005-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-005-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-005-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-005-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-005-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-005-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-005-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-005-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L02-005-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1glm-5.3-flashanswered0.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 3
}
inst-strata-L02-005-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-005-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-005-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-005-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": 4
}
inst-strata-L02-005-theater--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "ticket manifest",
  "value": "4"
}
inst-strata-L02-005-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-005-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-005-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-006-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-006-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-006-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-006-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-006-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-006-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-006-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-006-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-006-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-006-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-006-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-006-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-006-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-006-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L02-006-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": "2"
}
inst-strata-L02-006-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-006-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-006-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-006-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-006-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-006-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L02-006-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "plate register",
  "value": 2
}
inst-strata-L02-006-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-006-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-006-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-007-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin's mark"
}
inst-strata-L02-007-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L02-007-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-007-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-007-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-007-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2glm-5.3transport_error—
null
inst-strata-L02-007-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2claude-fable-5invalid_response0.0%
null
inst-strata-L02-007-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-007-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-007-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-007-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-007-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0qwen3.8-27binvalid_response0.0%
null
inst-strata-L02-007-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-007-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-007-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-007-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1glm-5.3transport_error—
null
inst-strata-L02-007-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-007-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-007-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-007-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-007-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-007-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-007-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L02-007-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": "Corin"
}
inst-strata-L02-007-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "mess roster",
  "value": 1
}
inst-strata-L02-007-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-007-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-007-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-008-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-008-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L02-008-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-008-hotel--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-008-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-008-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-008-hotel--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-008-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L02-008-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-008-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-008-hotel--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-008-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-008-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-008-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-008-hotel--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-008-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2glm-5.3transport_error—
null
inst-strata-L02-008-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2kimi-k2.6answered0.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile's mark"
}
inst-strata-L02-008-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-008-hotel--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": "Odile"
}
inst-strata-L02-008-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-009-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": "1"
}
inst-strata-L02-009-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-009-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-009-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-009-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2claude-opus-5.5content_filter—
null
inst-strata-L02-009-observatory--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-009-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-009-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-009-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L02-009-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-009-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-009-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-009-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-009-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L02-009-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-009-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-009-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-009-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-009-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2glm-5.3-flashinvalid_response0.0%
null
inst-strata-L02-009-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": "1"
}
inst-strata-L02-009-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-009-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "cryostat sheet",
  "value": 1
}
inst-strata-L02-009-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-010-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L02-010-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-010-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-010-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-010-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L02-010-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": "4"
}
inst-strata-L02-010-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-010-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-010-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-010-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L02-010-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-010-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-010-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-010-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-010-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-010-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-010-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-010-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-010-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-010-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L02-010-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": 4
}
inst-strata-L02-010-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "power schedule",
  "value": "4"
}
inst-strata-L02-010-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-010-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-010-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-011-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-011-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-011-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-011-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2grok-4.6answered0.0%
null
inst-strata-L02-011-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-011-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-011-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-011-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-011-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-011-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-011-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-011-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-011-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L02-011-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-011-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-011-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-011-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-011-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 2
}
inst-strata-L02-011-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-011-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-011-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-012-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L02-012-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-012-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-012-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-012-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2claude-opus-5.5content_filter—
null
inst-strata-L02-012-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2glm-5.3-flashtransport_error—
null
inst-strata-L02-012-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-012-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-012-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-012-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-012-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-012-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-012-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-012-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-012-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1claude-haiku-4.5answered0.0%
null
inst-strata-L02-012-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-012-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-012-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-012-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-012-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2claude-opus-5.5content_filter—
null
inst-strata-L02-012-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "Vela"
}
inst-strata-L02-012-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-012-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-012-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-013-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-013-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-013-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1claude-opus-5content_filter—
null
inst-strata-L02-013-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-013-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-013-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "register",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-013-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-013-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L02-013-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-013-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-013-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-013-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-013-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-013-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-013-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-013-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1claude-opus-5content_filter—
null
inst-strata-L02-013-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": "2"
}
inst-strata-L02-013-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-013-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-013-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-013-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-013-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2claude-opus-5content_filter—
null
inst-strata-L02-013-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2kimi-k2.6answered0.0%
{
  "operation": "register",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-013-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "carrier's waybill",
  "value": 2
}
inst-strata-L02-013-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-014-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gemini-3.8-flashtransport_error—
null
inst-strata-L02-014-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-014-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-014-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-014-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-014-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-014-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-014-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-014-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L02-014-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-014-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-014-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-014-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-014-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-014-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-014-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-014-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2claude-opus-5content_filter—
null
inst-strata-L02-014-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "funicular ticket",
  "value": "Galia"
}
inst-strata-L02-014-hotel--implicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L02-014-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-014-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-014-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-015-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-015-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-015-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-015-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-015-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2glm-5.3transport_error—
null
inst-strata-L02-015-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-015-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-015-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-015-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-015-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-015-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-015-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-015-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Sable"
}
inst-strata-L02-015-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-015-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-015-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-015-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-015-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-015-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wardrobe ledger",
  "value": "Bram"
}
inst-strata-L02-015-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-015-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-015-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-016-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-016-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-016-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-016-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-016-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-016-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-016-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-016-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-016-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L02-016-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-016-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-016-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-016-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-016-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-016-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-016-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-016-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-016-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-016-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "terrace menu",
  "value": "Ferro"
}
inst-strata-L02-016-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-016-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-016-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-017-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-017-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-017-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-017-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L02-017-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-017-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-017-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": "1"
}
inst-strata-L02-017-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-017-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-017-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-017-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L02-017-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-017-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-017-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L02-017-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-017-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 1
}
inst-strata-L02-017-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-018-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L02-018-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L02-018-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-018-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-018-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-018-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-018-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-018-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-018-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-018-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-018-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": "3"
}
inst-strata-L02-018-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-018-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-018-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-018-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-018-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "wool account",
  "value": 3
}
inst-strata-L02-018-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-019-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": "2"
}
inst-strata-L02-019-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": "2"
}
inst-strata-L02-019-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-019-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-019-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-019-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2glm-5.3transport_error—
null
inst-strata-L02-019-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-019-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-019-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-019-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L02-019-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0qwen3.8-27binvalid_response0.0%
null
inst-strata-L02-019-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L02-019-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L02-019-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L02-019-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-019-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L02-019-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1claude-fable-5content_filter—
null
inst-strata-L02-019-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L02-019-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L02-019-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L02-019-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2glm-5.3transport_error—
null
inst-strata-L02-019-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L02-019-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tide-table entry",
  "value": 2
}
inst-strata-L02-019-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L02-019-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L02-019-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
Configured level: 3
InstanceProviderStatusCorrectSubmitted action
inst-strata-L03-000-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1glm-5.3transport_error—
null
inst-strata-L03-000-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1claude-fable-5content_filter—
null
inst-strata-L03-000-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-000-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-000-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-000-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gpt-6-solanswered0.0%
{
  "operation": "register",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L03-000-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-000-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-000-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-000-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0deepseek-v4-proinvalid_response0.0%
null
inst-strata-L03-000-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-000-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L03-000-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-000-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-000-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-000-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-000-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1claude-fable-5content_filter—
null
inst-strata-L03-000-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L03-000-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1claude-haiku-4.5answered0.0%
null
inst-strata-L03-000-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-000-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-000-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-000-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-000-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L03-000-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2minimax-m3answered0.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": "2"
}
inst-strata-L03-000-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "chandlery invoice",
  "value": 2
}
inst-strata-L03-000-maritime--implicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L03-000-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-000-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-000-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-001-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-001-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-001-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-001-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-001-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L03-001-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-001-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-001-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-001-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-001-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-001-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-001-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-001-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L03-001-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1claude-opus-5content_filter—
null
inst-strata-L03-001-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1glm-5.3-flashinvalid_response0.0%
null
inst-strata-L03-001-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-001-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-001-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-001-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-001-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2claude-opus-5content_filter—
null
inst-strata-L03-001-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L03-001-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-001-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-001-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-002-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": "altered after the fire"
}
inst-strata-L03-002-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L03-002-hotel--explicit-r1qwen3.8-27binvalid_response0.0%
null
inst-strata-L03-002-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r1claude-haiku-4.5invalid_response0.0%
null
inst-strata-L03-002-hotel--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-002-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-002-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-002-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-002-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": "5"
}
inst-strata-L03-002-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-002-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-002-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-002-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L03-002-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-002-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-002-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-002-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-002-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L03-002-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1grok-4.6answered0.0%
null
inst-strata-L03-002-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L03-002-hotel--implicit-r1qwen3.8-27banswered0.0%
null
inst-strata-L03-002-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-002-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-002-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-002-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "guest register",
  "value": 5
}
inst-strata-L03-002-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-002-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-002-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-003-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L03-003-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-003-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-003-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-003-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L03-003-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-003-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-003-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-003-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0claude-fable-5content_filter—
null
inst-strata-L03-003-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-003-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L03-003-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-003-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-003-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-003-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L03-003-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-003-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-003-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-003-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-003-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 3
}
inst-strata-L03-003-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-003-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-003-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-004-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r1claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": "4"
}
inst-strata-L03-004-maritime--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-004-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-004-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-004-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-004-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-004-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-004-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-004-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-004-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0claude-fable-5content_filter—
null
inst-strata-L03-004-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-004-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-004-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-004-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-004-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-004-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-004-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-004-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-004-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-004-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L03-004-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "pilot's note",
  "value": 4
}
inst-strata-L03-004-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-004-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-004-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-005-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": "2"
}
inst-strata-L03-005-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-005-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-005-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-005-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L03-005-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-005-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-005-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-005-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L03-005-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L03-005-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-005-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-005-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-005-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-005-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1claude-opus-5.5answered0.0%
null
inst-strata-L03-005-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L03-005-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-005-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-005-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-005-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-005-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-005-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L03-005-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": 2
}
inst-strata-L03-005-hotel--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "shuttle manifest",
  "value": "2"
}
inst-strata-L03-005-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-005-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-005-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-006-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-006-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-006-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-006-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-006-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2claude-opus-5content_filter—
null
inst-strata-L03-006-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-006-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-006-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-006-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L03-006-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-006-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-006-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-006-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-006-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-006-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-006-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-006-observatory--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-006-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": 4
}
inst-strata-L03-006-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-007-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-007-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-007-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-007-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-007-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-007-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-007-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-007-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-007-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-007-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0claude-fable-5content_filter—
null
inst-strata-L03-007-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-007-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-007-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-007-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-007-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-007-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L03-007-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-007-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-007-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-007-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-007-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L03-007-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": "Petra"
}
inst-strata-L03-007-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-007-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-007-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-008-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L03-008-theater--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "2"
}
inst-strata-L03-008-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L03-008-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-008-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-008-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L03-008-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L03-008-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2claude-haiku-4.5answered0.0%
{
  "operation": "register",
  "subject": "box-office tally",
  "value": "2"
}
inst-strata-L03-008-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-008-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-008-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-008-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-008-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": "2"
}
inst-strata-L03-008-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-008-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-008-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-008-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-008-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "box-office tally",
  "value": 2
}
inst-strata-L03-008-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-009-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1glm-5.3transport_error—
null
inst-strata-L03-009-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-009-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1claude-opus-5content_filter—
null
inst-strata-L03-009-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-009-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-009-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-009-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": "1"
}
inst-strata-L03-009-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-009-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-009-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0glm-5.3invalid_response0.0%
null
inst-strata-L03-009-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-009-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-009-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-009-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-009-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L03-009-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L03-009-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-009-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-009-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L03-009-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-009-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L03-009-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-009-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seeing report",
  "value": 1
}
inst-strata-L03-009-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-010-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gpt-6-solanswered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1glm-5.3answered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gemini-3.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-010-observatory--explicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1claude-fable-5answered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1claude-opus-5content_filter—
null
inst-strata-L03-010-observatory--explicit-r1grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-010-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-010-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-010-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2claude-opus-5content_filter—
null
inst-strata-L03-010-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-010-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-010-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0glm-5.3invalid_response0.0%
null
inst-strata-L03-010-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-010-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-010-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-010-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-010-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L03-010-observatory--implicit-r1grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-010-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-010-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-010-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L03-010-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-010-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": 3
}
inst-strata-L03-010-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-011-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L03-011-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-011-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-011-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-011-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-011-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-011-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-011-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-011-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-011-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-011-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-011-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-011-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "stable diary",
  "value": "Bram"
}
inst-strata-L03-011-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-012-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L03-012-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-012-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-012-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L03-012-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L03-012-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-012-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-012-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-012-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-012-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-012-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-012-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L03-012-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-012-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-012-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-012-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-012-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Lyra"
}
inst-strata-L03-012-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-013-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-013-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-013-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-013-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2glm-5.3transport_error—
null
inst-strata-L03-013-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-013-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-013-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-013-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L03-013-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-013-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-013-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-013-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-013-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L03-013-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1minimax-m3answered0.0%
null
inst-strata-L03-013-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r1claude-haiku-4.5answered0.0%
null
inst-strata-L03-013-hotel--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-013-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-013-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-013-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-013-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "wax-bench log",
  "value": "Cassia"
}
inst-strata-L03-013-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-013-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-013-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-014-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-014-hotel--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-014-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-014-hotel--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-014-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L03-014-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-014-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-014-hotel--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-014-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-014-hotel--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-014-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-014-hotel--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "night auditor sheet",
  "value": "Petra"
}
inst-strata-L03-014-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-015-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1glm-5.3transport_error—
null
inst-strata-L03-015-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1claude-haiku-4.5answered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-015-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-015-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-015-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-015-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-015-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-015-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-015-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-015-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-015-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-015-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-015-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1claude-opus-5content_filter—
null
inst-strata-L03-015-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-015-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-015-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-015-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-015-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2claude-opus-5content_filter—
null
inst-strata-L03-015-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Marek"
}
inst-strata-L03-015-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-015-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-015-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-016-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1glm-5.3transport_error—
null
inst-strata-L03-016-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-016-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-016-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-016-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-016-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-016-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-016-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-016-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-016-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-016-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-016-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-016-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-016-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-016-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-016-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-016-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seating chart",
  "value": "Sable"
}
inst-strata-L03-016-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-016-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-016-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-017-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L03-017-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1glm-5.3-flashinvalid_response0.0%
null
inst-strata-L03-017-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-017-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-017-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-017-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L03-017-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-017-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-017-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-017-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L03-017-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-017-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L03-017-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-017-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-017-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-017-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L03-017-theater--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r1claude-haiku-4.5invalid_response0.0%
null
inst-strata-L03-017-theater--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-017-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-017-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-017-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-017-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2gpt-5.6-lunaanswered0.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": "green-room register"
}
inst-strata-L03-017-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-017-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2claude-opus-5content_filter—
null
inst-strata-L03-017-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "understudy roster",
  "value": 2
}
inst-strata-L03-017-theater--implicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L03-017-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-017-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-017-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-018-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": "5"
}
inst-strata-L03-018-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L03-018-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-018-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-018-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-018-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L03-018-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-018-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-018-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-018-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-018-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0qwen3.8-27binvalid_response0.0%
null
inst-strata-L03-018-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-018-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L03-018-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-018-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-018-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L03-018-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-018-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-018-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": 5
}
inst-strata-L03-018-theater--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "prop list",
  "value": "5"
}
inst-strata-L03-018-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-018-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L03-018-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-019-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-019-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": "5"
}
inst-strata-L03-019-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-019-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-019-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-019-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2claude-fable-5content_filter—
null
inst-strata-L03-019-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2glm-4.7-flashinvalid_response0.0%
null
inst-strata-L03-019-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-019-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-019-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L03-019-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L03-019-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0minimax-m3invalid_response0.0%
null
inst-strata-L03-019-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L03-019-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-019-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1glm-5.3transport_error—
null
inst-strata-L03-019-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L03-019-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1claude-fable-5content_filter—
null
inst-strata-L03-019-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L03-019-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L03-019-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L03-019-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L03-019-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2claude-fable-5content_filter—
null
inst-strata-L03-019-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L03-019-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": "5"
}
inst-strata-L03-019-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L03-019-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "cryostat sheet",
  "value": 5
}
inst-strata-L03-019-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
Configured level: 4
InstanceProviderStatusCorrectSubmitted action
inst-strata-L04-000-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1glm-5.3invalid_response0.0%
null
inst-strata-L04-000-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-000-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-000-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2deepseek-v4-proanswered0.0%
null
inst-strata-L04-000-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile's mark"
}
inst-strata-L04-000-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L04-000-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-000-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-000-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-000-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-000-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-000-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-000-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-000-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-000-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "register",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2claude-sonnet-5invalid_response0.0%
null
inst-strata-L04-000-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L04-000-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile's mark"
}
inst-strata-L04-000-observatory--implicit-r2minimax-m3answered0.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile's mark"
}
inst-strata-L04-000-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2claude-haiku-4.5answered0.0%
null
inst-strata-L04-000-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "flare alert sheet",
  "value": "Odile's mark"
}
inst-strata-L04-000-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-000-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "flare alert sheet",
  "value": "Odile"
}
inst-strata-L04-000-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-001-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1gpt-6-solanswered0.0%
null
inst-strata-L04-001-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1deepseek-4.1-flashtransport_error—
null
inst-strata-L04-001-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1claude-opus-5.5answered0.0%
null
inst-strata-L04-001-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L04-001-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-001-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1qwen3.8-27binvalid_response0.0%
null
inst-strata-L04-001-theater--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-001-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-001-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-001-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L04-001-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-001-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-001-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-001-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-001-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-001-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-001-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-001-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1claude-opus-5.5answered0.0%
null
inst-strata-L04-001-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L04-001-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": "1"
}
inst-strata-L04-001-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-001-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-001-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-001-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L04-001-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "call sheet",
  "value": 1
}
inst-strata-L04-001-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-001-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-001-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-002-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-002-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": "4"
}
inst-strata-L04-002-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-002-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-002-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-002-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L04-002-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L04-002-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-002-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-002-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-002-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L04-002-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0claude-fable-5content_filter—
null
inst-strata-L04-002-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-002-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-002-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-002-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-002-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-002-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-002-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-002-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gemini-3.8-flashtransport_error—
null
inst-strata-L04-002-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "kennel book",
  "value": 4
}
inst-strata-L04-002-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-002-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-002-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-003-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1deepseek-4.1-flashtransport_error—
null
inst-strata-L04-003-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1mimo-v2.6-flashtransport_error—
null
inst-strata-L04-003-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L04-003-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-003-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-003-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-003-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2minimax-m3invalid_response0.0%
null
inst-strata-L04-003-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-003-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-003-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-003-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L04-003-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-003-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-003-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-003-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-003-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L04-003-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-003-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-003-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-003-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Wren"
}
inst-strata-L04-003-hotel--implicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L04-003-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-003-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-003-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-004-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-004-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1claude-fable-5content_filter—
null
inst-strata-L04-004-maritime--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L04-004-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-004-maritime--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-004-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2claude-fable-5content_filter—
null
inst-strata-L04-004-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-004-maritime--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-004-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L04-004-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-004-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-004-maritime--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-004-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-004-maritime--implicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-004-maritime--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-004-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-004-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-004-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-004-maritime--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": 1
}
inst-strata-L04-004-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1baseline:forward-chainanswered0.0%
null
inst-strata-L04-005-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1gemini-3.7-flashinvalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1gemini-3.8-flashinvalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1deepseek-4.1-flashtransport_error—
null
inst-strata-L04-005-hotel--explicit-r1gemini-3.6-flashinvalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 1
}
inst-strata-L04-005-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1grok-4.6answered0.0%
null
inst-strata-L04-005-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1qwen3.8-27binvalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r1claude-haiku-4.5invalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L04-005-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-005-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-005-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2baseline:forward-chainanswered0.0%
null
inst-strata-L04-005-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2gpt-6-solanswered0.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "unresolved"
}
inst-strata-L04-005-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2glm-5.3transport_error—
null
inst-strata-L04-005-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2claude-sonnet-5invalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2grok-4.6answered0.0%
null
inst-strata-L04-005-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2minimax-m3invalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2kimi-k3answered0.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 2
}
inst-strata-L04-005-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--explicit-r2claude-haiku-4.5invalid_response0.0%
null
inst-strata-L04-005-hotel--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L04-005-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-005-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-005-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-005-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0baseline:forward-chainanswered0.0%
null
inst-strata-L04-005-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L04-005-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-005-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-005-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-005-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1baseline:forward-chainanswered0.0%
null
inst-strata-L04-005-hotel--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L04-005-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1gemini-3.7-flashinvalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1gpt-5.6-terraanswered0.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 1
}
inst-strata-L04-005-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1gemini-3.6-flashinvalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": "Halden"
}
inst-strata-L04-005-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L04-005-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1grok-4.6answered0.0%
null
inst-strata-L04-005-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1minimax-m3invalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r1qwen3.8-27binvalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r1claude-haiku-4.5answered0.0%
null
inst-strata-L04-005-hotel--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L04-005-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-005-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-005-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2baseline:forward-chainanswered0.0%
null
inst-strata-L04-005-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2gemini-3.6-flashinvalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2claude-sonnet-5invalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r2gpt-5.6-lunaanswered0.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 1
}
inst-strata-L04-005-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-005-hotel--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2qwen3.8-27binvalid_response0.0%
null
inst-strata-L04-005-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 5
}
inst-strata-L04-005-hotel--implicit-r2claude-haiku-4.5answered0.0%
{
  "operation": "hold",
  "subject": "cellar card",
  "value": 1
}
inst-strata-L04-005-hotel--implicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L04-005-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-005-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-005-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-006-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1claude-fable-5content_filter—
null
inst-strata-L04-006-hotel--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-006-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-006-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-006-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-006-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-006-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-006-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L04-006-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-006-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-006-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-006-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-006-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-006-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L04-006-hotel--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-006-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-006-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-006-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L04-006-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cashier's drop slip",
  "value": "Dover"
}
inst-strata-L04-006-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-006-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-006-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-007-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-007-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-007-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-007-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2claude-fable-5content_filter—
null
inst-strata-L04-007-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-007-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0claude-fable-5content_filter—
null
inst-strata-L04-007-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-007-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-007-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-007-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-007-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L04-007-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-007-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-007-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-007-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-007-manor--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-007-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "apiary log",
  "value": "Corin"
}
inst-strata-L04-007-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-008-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": "3"
}
inst-strata-L04-008-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-008-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-008-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-008-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-008-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-008-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-008-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-008-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L04-008-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-008-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-008-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-008-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-008-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-008-observatory--implicit-r1gpt-5.6-lunainvalid_response0.0%
null
inst-strata-L04-008-observatory--implicit-r1claude-opus-5.5content_filter—
null
inst-strata-L04-008-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-008-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-008-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-008-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-008-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": "3"
}
inst-strata-L04-008-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": 3
}
inst-strata-L04-008-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "filter log",
  "value": "3"
}
inst-strata-L04-008-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-008-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-008-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-009-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-009-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1glm-5.3-flashanswered0.0%
{
  "operation": "register",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-009-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-009-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-009-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L04-009-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-009-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-009-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-009-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-009-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-009-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-009-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-009-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-009-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1claude-fable-5content_filter—
null
inst-strata-L04-009-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-009-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-009-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-009-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighthouse log",
  "value": "Wren"
}
inst-strata-L04-009-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-009-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-009-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-010-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1glm-5.3transport_error—
null
inst-strata-L04-010-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-010-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-010-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-010-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-010-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-010-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2claude-fable-5answered0.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-010-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-010-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-010-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-010-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-010-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-010-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-010-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-010-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-010-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2claude-fable-5answered0.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-010-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "tape index",
  "value": 3
}
inst-strata-L04-010-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-011-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-011-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-011-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-011-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-011-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-011-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2claude-fable-5transport_error—
null
inst-strata-L04-011-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2claude-opus-5content_filter—
null
inst-strata-L04-011-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-011-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": "wrong drop"
}
inst-strata-L04-011-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-011-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-011-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-011-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-011-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0qwen3.8-27binvalid_response0.0%
null
inst-strata-L04-011-observatory--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-011-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-011-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-011-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-011-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L04-011-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-011-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-011-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-011-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-011-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-011-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L04-011-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "instrument log",
  "value": 4
}
inst-strata-L04-011-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-011-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-011-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-012-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1deepseek-4.1-flashtransport_error—
null
inst-strata-L04-012-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L04-012-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L04-012-theater--explicit-r1glm-5.3-flashanswered0.0%
{
  "operation": "register",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-012-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-012-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-012-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2glm-5.3transport_error—
null
inst-strata-L04-012-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L04-012-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-012-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-012-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-012-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-012-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0claude-fable-5content_filter—
null
inst-strata-L04-012-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-012-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L04-012-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-012-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-012-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-012-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-012-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-012-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-012-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-012-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L04-012-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "hotel chit",
  "value": 5
}
inst-strata-L04-012-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-012-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-012-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-013-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-013-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L04-013-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-013-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-013-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-013-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-013-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-013-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-013-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-013-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-013-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L04-013-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-013-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-013-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-013-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1glm-5.3invalid_response0.0%
null
inst-strata-L04-013-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-013-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-013-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-013-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-013-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L04-013-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-013-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2kimi-k3answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "green-room register",
  "value": 5
}
inst-strata-L04-013-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-013-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-013-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-014-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1glm-5.3invalid_response0.0%
null
inst-strata-L04-014-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-014-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L04-014-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-014-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-014-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-014-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-014-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L04-014-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-014-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-014-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-014-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-014-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-014-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-014-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-014-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-014-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L04-014-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L04-014-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-014-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": "5"
}
inst-strata-L04-014-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-014-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-014-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-014-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-014-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-014-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2kimi-k3transport_error—
null
inst-strata-L04-014-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "churchwarden's book",
  "value": 5
}
inst-strata-L04-014-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-014-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-014-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-015-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1glm-5.3transport_error—
null
inst-strata-L04-015-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-015-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L04-015-observatory--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-015-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-015-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-015-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-015-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2qwen3.8-27binvalid_response0.0%
null
inst-strata-L04-015-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-015-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-015-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-015-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-015-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-015-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0minimax-m3invalid_response0.0%
null
inst-strata-L04-015-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0kimi-k3transport_error—
null
inst-strata-L04-015-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0claude-haiku-4.5invalid_response0.0%
null
inst-strata-L04-015-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-015-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-015-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-015-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-015-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L04-015-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-015-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-015-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-015-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-015-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-015-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2kimi-k3transport_error—
null
inst-strata-L04-015-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": "Tomas"
}
inst-strata-L04-015-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-015-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-015-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-016-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-016-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1kimi-k3transport_error—
null
inst-strata-L04-016-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-016-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-016-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-016-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-016-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2claude-opus-5content_filter—
null
inst-strata-L04-016-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-016-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-016-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-016-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-016-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-016-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0kimi-k3transport_error—
null
inst-strata-L04-016-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-016-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-016-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-016-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-016-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L04-016-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-016-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L04-016-observatory--implicit-r1claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-016-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-016-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L04-016-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-016-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L04-016-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2kimi-k3transport_error—
null
inst-strata-L04-016-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dome log",
  "value": "Juno"
}
inst-strata-L04-016-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-016-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-016-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-017-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1glm-5.3transport_error—
null
inst-strata-L04-017-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-017-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1claude-opus-5.5content_filter—
null
inst-strata-L04-017-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1kimi-k3transport_error—
null
inst-strata-L04-017-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-017-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-017-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-017-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-017-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L04-017-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-017-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-017-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-017-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-017-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0kimi-k3transport_error—
null
inst-strata-L04-017-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-017-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-017-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-017-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1deepseek-v4-proanswered0.0%
null
inst-strata-L04-017-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-017-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-017-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r1claude-haiku-4.5answered0.0%
null
inst-strata-L04-017-observatory--implicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L04-017-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-017-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-017-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-017-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2glm-5.3transport_error—
null
inst-strata-L04-017-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-017-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2kimi-k3transport_error—
null
inst-strata-L04-017-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "aurora watch",
  "value": 1
}
inst-strata-L04-017-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-017-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-017-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-018-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-018-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1kimi-k3transport_error—
null
inst-strata-L04-018-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-018-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-018-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-018-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2claude-fable-5content_filter—
null
inst-strata-L04-018-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-018-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-018-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-018-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-018-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L04-018-hotel--formal-r0mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L04-018-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-018-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0kimi-k3transport_error—
null
inst-strata-L04-018-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-018-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-018-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-018-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L04-018-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-018-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-018-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-018-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-018-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2claude-fable-5content_filter—
null
inst-strata-L04-018-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L04-018-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2kimi-k3transport_error—
null
inst-strata-L04-018-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "housekeeping sheet",
  "value": "Lyra"
}
inst-strata-L04-018-hotel--implicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L04-018-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-018-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-018-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-019-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-019-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1claude-fable-5content_filter—
null
inst-strata-L04-019-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1kimi-k3transport_error—
null
inst-strata-L04-019-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-019-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-019-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-019-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-019-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2kimi-k3transport_error—
null
inst-strata-L04-019-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-019-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-019-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-019-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L04-019-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0qwen3.8-27binvalid_response0.0%
null
inst-strata-L04-019-maritime--formal-r0kimi-k3transport_error—
null
inst-strata-L04-019-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L04-019-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L04-019-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L04-019-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-019-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L04-019-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1claude-fable-5content_filter—
null
inst-strata-L04-019-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L04-019-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1kimi-k3transport_error—
null
inst-strata-L04-019-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L04-019-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L04-019-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L04-019-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L04-019-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2kimi-k3transport_error—
null
inst-strata-L04-019-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "harbor manifest",
  "value": "Sable"
}
inst-strata-L04-019-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L04-019-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L04-019-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
Configured level: 5
InstanceProviderStatusCorrectSubmitted action
inst-strata-L05-000-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L05-000-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-000-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-000-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-000-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-000-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L05-000-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-000-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-000-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-000-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-000-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-000-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-000-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-000-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-000-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-000-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-000-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-000-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-000-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r1glm-4.7-flashinvalid_response0.0%
null
inst-strata-L05-000-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-000-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-000-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-000-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L05-000-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-000-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-000-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": 1
}
inst-strata-L05-000-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-000-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-000-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-001-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-001-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": "2"
}
inst-strata-L05-001-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-001-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-001-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-001-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-001-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-001-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-001-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-001-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-001-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0kimi-k3transport_error—
null
inst-strata-L05-001-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-001-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-001-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1glm-5.3transport_error—
null
inst-strata-L05-001-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-001-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-001-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-001-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": "2"
}
inst-strata-L05-001-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-001-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-001-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-001-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-001-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-001-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "watch rotation",
  "value": 2
}
inst-strata-L05-001-maritime--implicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L05-001-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-001-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-001-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-002-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L05-002-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-002-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": "3"
}
inst-strata-L05-002-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-002-maritime--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-002-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gemini-3.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-002-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-002-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-002-maritime--explicit-r2glm-5.3-flashanswered0.0%
{
  "operation": "hold",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-002-maritime--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-002-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-002-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0kimi-k3transport_error—
null
inst-strata-L05-002-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-002-maritime--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-002-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-002-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1claude-fable-5.1answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-002-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-002-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2claude-opus-5.5answered0.0%
{
  "operation": "hold",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2claude-fable-5answered0.0%
{
  "operation": "hold",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2claude-opus-5content_filter—
null
inst-strata-L05-002-maritime--implicit-r2grok-4.6answered0.0%
{
  "operation": "hold",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-002-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-002-maritime--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "storm glass",
  "value": 3
}
inst-strata-L05-002-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-003-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L05-003-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-003-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-003-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-003-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-003-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-003-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-003-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-003-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-003-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0minimax-m3invalid_response0.0%
null
inst-strata-L05-003-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0kimi-k3transport_error—
null
inst-strata-L05-003-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-003-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-003-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L05-003-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-003-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-003-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-003-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-003-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-003-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-003-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-003-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "dressmaker's bill",
  "value": 2
}
inst-strata-L05-003-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-004-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-004-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-004-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-004-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-004-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-004-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2claude-opus-5.5content_filter—
null
inst-strata-L05-004-maritime--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-004-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L05-004-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2kimi-k2.6answered0.0%
{
  "operation": "hold",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-004-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-004-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-004-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-004-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L05-004-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-004-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0kimi-k3transport_error—
null
inst-strata-L05-004-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-004-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-004-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-004-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1glm-5.3transport_error—
null
inst-strata-L05-004-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-004-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-004-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-004-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1claude-haiku-4.5answered0.0%
{
  "operation": "register",
  "subject": "dock_pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-004-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-004-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-004-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2deepseek-v4-proanswered0.0%
{
  "operation": "hold",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-004-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2claude-opus-5.5content_filter—
null
inst-strata-L05-004-maritime--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-004-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2claude-opus-5content_filter—
null
inst-strata-L05-004-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-004-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "dock pass",
  "value": "Halden"
}
inst-strata-L05-004-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-004-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-004-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-005-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-005-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-005-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-005-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2claude-opus-5.5content_filter—
null
inst-strata-L05-005-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-005-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2kimi-k2.6transport_error—
null
inst-strata-L05-005-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-005-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-005-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-005-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L05-005-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0claude-fable-5content_filter—
null
inst-strata-L05-005-theater--formal-r0mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L05-005-theater--formal-r0mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L05-005-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-005-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-005-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-005-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-005-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1glm-5.3transport_error—
null
inst-strata-L05-005-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-005-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1kimi-k3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-005-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-005-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2glm-5.3transport_error—
null
inst-strata-L05-005-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-005-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-005-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-005-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "fly schedule",
  "value": "Iris"
}
inst-strata-L05-005-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-006-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-006-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-006-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-006-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-006-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-006-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-006-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-006-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-006-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-006-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L05-006-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-006-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0kimi-k3transport_error—
null
inst-strata-L05-006-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-006-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-006-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-006-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1claude-opus-5content_filter—
null
inst-strata-L05-006-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-006-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-006-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-006-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-006-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-006-hotel--implicit-r2glm-5.3-flashanswered0.0%
{
  "operation": "register",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry chit",
  "value": 3
}
inst-strata-L05-006-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-006-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-006-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-007-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-007-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-007-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-007-manor--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-007-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2glm-5.3transport_error—
null
inst-strata-L05-007-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-007-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-007-manor--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-007-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-007-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0kimi-k3transport_error—
null
inst-strata-L05-007-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-007-manor--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-007-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-007-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-007-manor--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1claude-opus-5content_filter—
null
inst-strata-L05-007-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-007-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-007-manor--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-007-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-007-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-007-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-007-manor--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "seed ledger",
  "value": "Wren"
}
inst-strata-L05-007-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-008-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-008-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-008-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-008-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-008-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": "4"
}
inst-strata-L05-008-theater--explicit-r2claude-opus-5invalid_response0.0%
null
inst-strata-L05-008-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-008-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-008-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-008-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-008-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-008-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-008-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-008-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-008-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-008-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-008-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-008-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-008-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-008-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "per diem sheet",
  "value": 4
}
inst-strata-L05-008-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-009-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1claude-sonnet-5invalid_response0.0%
null
inst-strata-L05-009-theater--explicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L05-009-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-009-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-009-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-009-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-009-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2glm-5.3transport_error—
null
inst-strata-L05-009-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-009-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-009-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-009-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-009-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0claude-fable-5content_filter—
null
inst-strata-L05-009-theater--formal-r0mimo-v2.6-flashanswered0.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": "2"
}
inst-strata-L05-009-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-009-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-009-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-009-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-009-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-009-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": "2"
}
inst-strata-L05-009-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-009-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-009-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-009-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-009-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2deepseek-4.1-flashtransport_error—
null
inst-strata-L05-009-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-009-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "laundry bundle chit",
  "value": 2
}
inst-strata-L05-009-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-009-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-009-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-010-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1glm-5.3transport_error—
null
inst-strata-L05-010-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-010-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-010-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-010-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-010-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-010-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-010-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-010-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-010-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-010-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-010-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0deepseek-v4-proinvalid_response0.0%
null
inst-strata-L05-010-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0claude-fable-5content_filter—
null
inst-strata-L05-010-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-010-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-010-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-010-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-010-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-010-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-010-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-010-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-010-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-010-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-010-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-010-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "advance booking sheet",
  "value": "Cassia"
}
inst-strata-L05-010-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-010-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-010-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-011-hotel--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-011-hotel--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-011-hotel--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-011-hotel--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-011-hotel--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-011-hotel--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-011-hotel--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-011-hotel--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "valet_ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-011-hotel--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-011-hotel--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-011-hotel--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0gpt-6-astratransport_error—
null
inst-strata-L05-011-hotel--formal-r0gpt-6-solinvalid_response0.0%
null
inst-strata-L05-011-hotel--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0claude-fable-5content_filter—
null
inst-strata-L05-011-hotel--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-011-hotel--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0kimi-k3transport_error—
null
inst-strata-L05-011-hotel--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-011-hotel--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-011-hotel--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-011-hotel--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-011-hotel--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-011-hotel--implicit-r1mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-011-hotel--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-011-hotel--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-011-hotel--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-011-hotel--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-011-hotel--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-011-hotel--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "valet ticket",
  "value": "Silas"
}
inst-strata-L05-011-hotel--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-011-hotel--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-011-hotel--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-012-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-012-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-012-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-012-observatory--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-012-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-012-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2glm-5.3transport_error—
null
inst-strata-L05-012-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L05-012-observatory--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-012-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-012-observatory--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-012-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gpt-6-astratransport_error—
null
inst-strata-L05-012-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-012-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0kimi-k3transport_error—
null
inst-strata-L05-012-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-012-observatory--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-012-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-012-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L05-012-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-012-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-012-observatory--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-012-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-012-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-012-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-012-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-012-observatory--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "generator book",
  "value": "Galia"
}
inst-strata-L05-012-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-013-observatory--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-013-observatory--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L05-013-observatory--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-013-observatory--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-013-observatory--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-013-observatory--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-013-observatory--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-013-observatory--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-013-observatory--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2claude-opus-5content_filter—
null
inst-strata-L05-013-observatory--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-013-observatory--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2glm-4.7-flashanswered0.0%
{
  "operation": "register",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-013-observatory--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-013-observatory--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gpt-6-astratransport_error—
null
inst-strata-L05-013-observatory--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-013-observatory--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0kimi-k3transport_error—
null
inst-strata-L05-013-observatory--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-013-observatory--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-013-observatory--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-013-observatory--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-013-observatory--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1claude-opus-5.5answered0.0%
null
inst-strata-L05-013-observatory--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-013-observatory--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1claude-opus-5content_filter—
null
inst-strata-L05-013-observatory--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-013-observatory--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-013-observatory--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-013-observatory--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-013-observatory--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-013-observatory--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-013-observatory--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2claude-opus-5content_filter—
null
inst-strata-L05-013-observatory--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-013-observatory--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "snow-cat log",
  "value": "Petra"
}
inst-strata-L05-013-observatory--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-013-observatory--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-013-observatory--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-014-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-014-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L05-014-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-014-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-014-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-014-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-014-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2claude-fable-5content_filter—
null
inst-strata-L05-014-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-014-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-014-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-014-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-014-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-014-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-014-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-014-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-014-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-014-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L05-014-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-014-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1claude-fable-5.1answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-014-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-014-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-014-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-014-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-014-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-014-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "register",
  "subject": "stage manager's log",
  "value": 3
}
inst-strata-L05-014-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-015-maritime--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-015-maritime--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L05-015-maritime--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-015-maritime--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L05-015-maritime--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-015-maritime--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-015-maritime--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-015-maritime--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-015-maritime--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2deepseek-v4-proinvalid_response0.0%
null
inst-strata-L05-015-maritime--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L05-015-maritime--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-015-maritime--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2claude-haiku-4.5invalid_response0.0%
null
inst-strata-L05-015-maritime--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-015-maritime--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-015-maritime--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-015-maritime--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-015-maritime--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0kimi-k3transport_error—
null
inst-strata-L05-015-maritime--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-015-maritime--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-015-maritime--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-015-maritime--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-015-maritime--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-015-maritime--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L05-015-maritime--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-015-maritime--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-015-maritime--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-015-maritime--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-015-maritime--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2claude-opus-5.5answered0.0%
null
inst-strata-L05-015-maritime--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-015-maritime--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "customs seal",
  "value": 3
}
inst-strata-L05-015-maritime--implicit-r2glm-4.7-flashinvalid_response0.0%
null
inst-strata-L05-015-maritime--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-015-maritime--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-015-maritime--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-016-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-016-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-016-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L05-016-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-016-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r1glm-4.7-flashanswered0.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": "1"
}
inst-strata-L05-016-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-016-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-016-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-016-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-016-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gpt-6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2mimo-v2.6-flashinvalid_response0.0%
null
inst-strata-L05-016-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-016-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--explicit-r2glm-4.7-flashtransport_error—
null
inst-strata-L05-016-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-016-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-016-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-016-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gpt-6-astraanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0claude-sonnet-5invalid_response0.0%
null
inst-strata-L05-016-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-016-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0kimi-k3transport_error—
null
inst-strata-L05-016-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-016-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-016-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-016-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-016-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-016-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-016-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1minimax-m3answered0.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": "1"
}
inst-strata-L05-016-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-016-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-016-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-016-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-016-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-016-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-016-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "cheese room slate",
  "value": 1
}
inst-strata-L05-016-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-016-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-016-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-017-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-017-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-017-theater--explicit-r1glm-5.3-flashanswered0.0%
{
  "operation": "register",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-017-theater--explicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-017-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-017-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2glm-5.3transport_error—
null
inst-strata-L05-017-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-017-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-017-theater--explicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-017-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gpt-6-astratransport_error—
null
inst-strata-L05-017-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-017-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-017-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-017-theater--formal-r0baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-017-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-017-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1deepseek-v4-proinvalid_response0.0%
null
inst-strata-L05-017-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-017-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1claude-opus-5invalid_response0.0%
null
inst-strata-L05-017-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-017-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-017-theater--implicit-r1baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-017-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-017-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2glm-5.3transport_error—
null
inst-strata-L05-017-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-017-theater--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-017-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-017-theater--implicit-r2baseline:direct-factsanswered100.0%
{
  "operation": "hold",
  "subject": "armory check-out",
  "value": 1
}
inst-strata-L05-017-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-018-manor--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-018-manor--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1claude-fable-5content_filter—
null
inst-strata-L05-018-manor--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1mimo-v2.6-proinvalid_response0.0%
null
inst-strata-L05-018-manor--explicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-018-manor--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r1glm-4.7-flashtransport_error—
null
inst-strata-L05-018-manor--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-018-manor--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-018-manor--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-018-manor--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-018-manor--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-018-manor--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-018-manor--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-018-manor--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-018-manor--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gpt-6-astratransport_error—
null
inst-strata-L05-018-manor--formal-r0gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0claude-fable-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-018-manor--formal-r0grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0kimi-k3transport_error—
null
inst-strata-L05-018-manor--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0glm-4.7-flashinvalid_response0.0%
null
inst-strata-L05-018-manor--formal-r0claude-fable-5.1answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-018-manor--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-018-manor--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-018-manor--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1claude-sonnet-5content_filter—
null
inst-strata-L05-018-manor--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-018-manor--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1claude-opus-5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-018-manor--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-018-manor--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-018-manor--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-018-manor--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-018-manor--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2glm-5.3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2claude-sonnet-5content_filter—
null
inst-strata-L05-018-manor--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2claude-fable-5content_filter—
null
inst-strata-L05-018-manor--implicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2claude-opus-5content_filter—
null
inst-strata-L05-018-manor--implicit-r2grok-4.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2minimax-m3answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-018-manor--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "register",
  "subject": "game book",
  "value": "Vela"
}
inst-strata-L05-018-manor--implicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-018-manor--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-018-manor--implicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-019-theater--explicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-019-theater--explicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1claude-fable-5content_filter—
null
inst-strata-L05-019-theater--explicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1kimi-k3transport_error—
null
inst-strata-L05-019-theater--explicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-019-theater--explicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-019-theater--explicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-019-theater--explicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-019-theater--explicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2kimi-k3transport_error—
null
inst-strata-L05-019-theater--explicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--explicit-r2claude-fable-5.1content_filter—
null
inst-strata-L05-019-theater--explicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-019-theater--explicit-r2baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-019-theater--formal-r0baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gpt-6-astratransport_error—
null
inst-strata-L05-019-theater--formal-r0gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0gpt-5.6-lunaanswered0.0%
{
  "operation": "register",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0mimo-v2.6-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0claude-opus-5content_filter—
null
inst-strata-L05-019-theater--formal-r0grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0kimi-k3transport_error—
null
inst-strata-L05-019-theater--formal-r0glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--formal-r0claude-fable-5.1content_filter—
null
inst-strata-L05-019-theater--formal-r0baseline:direct-factsanswered0.0%
null
inst-strata-L05-019-theater--formal-r0baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-019-theater--implicit-r1baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gpt-6-astratransport_error—
null
inst-strata-L05-019-theater--implicit-r1gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1glm-5.3answered0.0%
{
  "operation": "register",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1claude-fable-5content_filter—
null
inst-strata-L05-019-theater--implicit-r1mimo-v2.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1kimi-k3transport_error—
null
inst-strata-L05-019-theater--implicit-r1glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r1claude-fable-5.1content_filter—
null
inst-strata-L05-019-theater--implicit-r1baseline:direct-factsanswered0.0%
null
inst-strata-L05-019-theater--implicit-r1baseline:story-copyinvalid_response0.0%
null
inst-strata-L05-019-theater--implicit-r2baseline:constraint-solveranswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2baseline:forward-chainanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gpt-6-astratransport_error—
null
inst-strata-L05-019-theater--implicit-r2gpt-6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gemini-3.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gpt-5.6-solanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gemini-3.8-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2glm-5.3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gpt-5.6-terraanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2deepseek-4.1-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gemini-3.6-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2deepseek-v4-proanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gpt-6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2claude-sonnet-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2gpt-5.6-lunaanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2claude-opus-5.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2claude-fable-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2mimo-v2.6-flashanswered0.0%
{
  "operation": "register",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2mimo-v2.6-proanswered0.0%
{
  "operation": "register",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2claude-opus-5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2grok-4.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2kimi-k2.6answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2minimax-m3answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2qwen3.8-27banswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2kimi-k3transport_error—
null
inst-strata-L05-019-theater--implicit-r2glm-5.3-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2claude-haiku-4.5answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2glm-4.7-flashanswered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2claude-fable-5.1answered100.0%
{
  "operation": "hold",
  "subject": "lighting plot",
  "value": "Ansel"
}
inst-strata-L05-019-theater--implicit-r2baseline:direct-factsanswered0.0%
null
inst-strata-L05-019-theater--implicit-r2baseline:story-copyinvalid_response0.0%
null

Appendix: run provenance and generation completeness. Also available in results.json.

Generation completeness
{
  "available": 120,
  "classification": "v3",
  "complete": true,
  "conditions": [
    "formal",
    "explicit",
    "implicit"
  ],
  "expected": 120,
  "expected_variants": 600,
  "realizations": [
    1,
    2
  ]
}
Provenance
{
  "benchmark_version": "3",
  "grader_version": "3.1",
  "sources": {
    "__init__.py": "0a0b0ed757aacfdd844c7ea335c2a134019b6d309245d2cfc912b1abac872060",
    "compile.py": "d2e5c36a2baf4c6173d399a4adbf74a42d0ccb27a3a20a13b280ce757ea205d0",
    "decisions.py": "52b6b7298cb7fd7265635a435530b7b0250591aed5ecaedc411f05425a54cf9a",
    "evaluate.py": "f425359a63343d6c7ecf4218f17c962de5410e995bb915d2accf74880fc5a677",
    "experiments.py": "ce06e18d24e27eb81fd6328f1228544605c3081a765046ab0e5553dd25baac5a",
    "generator.py": "37877a6b21815a37538c68167272ee16fe9c9e0da4408f768e926d05b8bb62ee",
    "genres.py": "2a0ab884239cadc8d4175ac978854c88732e96e4b77caa8e0ed36e6ae3e6b151",
    "grading.py": "4f7336bc23085da839b18f24af79431e79e6d9a36c4551a416e72fbc90b368f1",
    "harness.py": "04c2f73bc3a143c49e9cbece56f2a4df451483e783d6aef4cc58d9faac312b77",
    "interactive.py": "030faebbbec71f4ae6eedb650278c60da432679d978a14662c6aa3c1eec78293",
    "judge.py": "9be37e0f06c7caa88d3171dd9f5bc71575c16d9441059f0b6c0d2a50a924268d",
    "llm.py": "508a5a37ac6d9071a522aa659334325f966b9552af4a098abde8cf8c12f2aad4",
    "narrative.py": "66455bc38d907edf2dfcc5668f96e5628ecfaa0e9a7c2fefcaab3bb805d93569",
    "oracle.py": "ab5878f8ed180bccc9653a0b2fc601220d0d81cbaa24a91622d764aacfc37c55",
    "pipeline.py": "e05a0889f24003a90ef4b6c4a9ce60bd50759939e839a9bc4d03377e3dc572ca",
    "populate.py": "2dab5370fd9895de2f25c92cd851dff84a642bb125d6e07666241661136577a3",
    "reporting.py": "6cf96e7d1c2ddeae233062be20facad57e41ed7cf8ebba78b5479403917fc013",
    "rng.py": "3de3ceaced32995ab61a317be204656229ad67b10a05f21736cac082b1941917",
    "sat.py": "bfbb94117dca5e649f609b388dc741d5082be17cb278c581a7da78cd3b81797d",
    "story.py": "391f2f97fd142cbd0cbcdf12fbdef194ba4377896fd315ee19ec1bddf7d1f965",
    "verify.py": "998c048a3185bd959bc34a892217314e465ec30c3efc7db94191fcff90f8e321",
    "world.py": "963011d7ec5249030aed8c33ff0faa3b9d086bdfab024095ec0852202d59628e"
  }
}