All sessions
nine models, three trials each, bare agent
invalid
Every model on the same subject, same harness, three trials each so the spread is measured rather than assumed / Started 31 Aug 2026, 11:12
Started
Completed
Planned27
Produced27
Missing0
Data problems
Session validation and membership diagnostics remain visible beside the plan
session-run-state-mismatch
session records 'failed', but the linked run lifecycle records 'completed'
afi/deepseek-v4-pro/20260831T111226ZPlan completion
Every requested trial remains visible, including runs that produced no record
| Sequence | Reviewer | Run identity | Lifecycle | Reason | Inspect run |
|---|---|---|---|---|---|
| 1 | afi | afi/gpt-oss-120b/20260831T111204Z | completed | - | View evidence |
| 2 | afi | afi/gpt-oss-120b/20260831T111205Z | completed | - | View evidence |
| 3 | afi | afi/gpt-oss-120b/20260831T111206Z | completed | - | View evidence |
| 4 | afi | afi/qwen3-coder-30b/20260831T111207Z | failed | - | View evidence |
| 5 | afi | afi/qwen3-coder-30b/20260831T111208Z | failed | - | View evidence |
| 6 | afi | afi/qwen3-coder-30b/20260831T111209Z | failed | - | View evidence |
| 7 | afi | afi/glm-5.3-flash/20260831T111210Z | completed | - | View evidence |
| 8 | afi | afi/glm-5.3-flash/20260831T111211Z | completed | - | View evidence |
| 9 | afi | afi/glm-5.3-flash/20260831T111212Z | completed | - | View evidence |
| 10 | afi | afi/deepseek-v4-flash/20260831T111213Z | completed | - | View evidence |
| 11 | afi | afi/deepseek-v4-flash/20260831T111214Z | completed | - | View evidence |
| 12 | afi | afi/deepseek-v4-flash/20260831T111215Z | completed | - | View evidence |
| 13 | afi | afi/kimi-k2.7-code/20260831T111216Z | completed | - | View evidence |
| 14 | afi | afi/kimi-k2.7-code/20260831T111217Z | completed | - | View evidence |
| 15 | afi | afi/kimi-k2.7-code/20260831T111218Z | completed | - | View evidence |
| 16 | afi | afi/glm-5.2/20260831T111219Z | completed | - | View evidence |
| 17 | afi | afi/glm-5.2/20260831T111220Z | completed | - | View evidence |
| 18 | afi | afi/glm-5.2/20260831T111221Z | completed | - | View evidence |
| 19 | afi | afi/glm-5.3/20260831T111222Z | completed | - | View evidence |
| 20 | afi | afi/glm-5.3/20260831T111223Z | completed | - | View evidence |
| 21 | afi | afi/glm-5.3/20260831T111224Z | completed | - | View evidence |
| 22 | afi | afi/deepseek-v4-pro/20260831T111225Z | completed | - | View evidence |
| 23 | afi | afi/deepseek-v4-pro/20260831T111226Z | failed | - | View evidence |
| 24 | afi | afi/deepseek-v4-pro/20260831T111227Z | completed | - | View evidence |
| 25 | afi | afi/grok-4.5/20260831T111228Z | completed | - | View evidence |
| 26 | afi | afi/grok-4.5/20260831T111229Z | completed | - | View evidence |
| 27 | afi | afi/grok-4.5/20260831T111230Z | completed | - | View evidence |
Produced runs
View evidence opens one run detail
| Details | ||||||||
|---|---|---|---|---|---|---|---|---|
| afi afi · cli | default | proxy | 45% | N/A | 9 | scored | View evidence | |
| afi afi · cli | default | proxy | 40% | N/A | 8 | scored | View evidence | |
| afi afi · cli | default | proxy | 40% | N/A | 8 | scored | View evidence | |
| afi afi · cli | default | proxy | 25% | N/A | 5 | scored | View evidence | |
| afi afi · cli | default | proxy | 5% | N/A | 1 | scored | View evidence | |
| afi afi · cli | default | proxy | 60% | N/A | 58 | scored | View evidence | |
| afi afi · cli | default | proxy | 5% | N/A | 34 | scored | View evidence | |
| afi afi · cli | default | proxy | 0% | N/A | 0 | scored | View evidence | |
| afi afi · cli | default | proxy | 40% | N/A | 21 | scored | View evidence | |
| afi afi · cli | default | proxy | 20% | N/A | 4 | scored | View evidence | |
| afi afi · cli | default | proxy | 15% | N/A | 4 | scored | View evidence | |
| afi afi · cli | default | proxy | 15% | N/A | 3 | scored | View evidence | |
| afi afi · cli | default | proxy | 30% | N/A | 6 | scored | View evidence | |
| afi afi · cli | default | proxy | 30% | N/A | 7 | scored | View evidence | |
| afi afi · cli | default | proxy | 45% | N/A | 13 | scored | View evidence | |
| afi afi · cli | default | proxy | 0% | N/A | 2 | scored | View evidence | |
| afi afi · cli | default | proxy | 5% | N/A | 2 | scored | View evidence | |
| afi afi · cli | default | proxy | 0% | N/A | 0 | scored | View evidence | |
| afi afi · cli | default | proxy | 40% | N/A | 10 | scored | View evidence | |
| afi afi · cli | default | proxy | 40% | N/A | 8 | scored | View evidence | |
| afi afi · cli | default | proxy | 30% | N/A | 8 | scored | View evidence | |
| afi afi · cli | default | proxy | N/A | N/A | Not recorded | unscored | View evidence | |
| afi afi · cli | default | proxy | N/A | N/A | Not recorded | unscored | View evidence | |
| afi afi · cli | default | proxy | N/A | N/A | Not recorded | unscored | View evidence | |
| afi afi · cli | default | proxy | 0% | N/A | 0 | scored | View evidence | |
| afi afi · cli | default | proxy | 0% | N/A | 1 | scored | View evidence | |
| afi afi · cli | default | proxy | 0% | N/A | 0 | scored | View evidence |
Session specification
The committed JSON is shown as data, not interpreted as instructions
{
"defaults": {
"effort": "high",
"key_limit": 2,
"mode": "agent",
"pr": "smykla-skalski/cairn#8",
"subject": "proxy"
},
"description": "Every model on the same subject, same harness, three trials each so the spread is measured rather than assumed",
"name": "nine models, three trials each, bare agent",
"runs": [
{
"label": "gpt-oss-120b",
"model": "openrouter:openai/gpt-oss-120b",
"repeat": 3
},
{
"label": "qwen3-coder-30b",
"model": "openrouter:qwen/qwen3-coder-30b-a3b-instruct",
"repeat": 3
},
{
"label": "glm-5.3-flash",
"model": "openrouter:z-ai/glm-5.3-flash",
"repeat": 3
},
{
"label": "deepseek-v4-flash",
"model": "openrouter:deepseek/deepseek-v4-flash",
"repeat": 3
},
{
"label": "kimi-k2.7-code",
"model": "openrouter:moonshotai/kimi-k2.7-code",
"repeat": 3
},
{
"label": "glm-5.2",
"model": "openrouter:z-ai/glm-5.2",
"repeat": 3
},
{
"label": "glm-5.3",
"model": "openrouter:z-ai/glm-5.3",
"repeat": 3
},
{
"label": "deepseek-v4-pro",
"model": "openrouter:deepseek/deepseek-v4-pro",
"repeat": 3
},
{
"label": "grok-4.5",
"model": "openrouter:x-ai/grok-4.5",
"repeat": 3
}
]
}Session evidence
Committed specification and session record
record
Open this path at the exported commit
The artifact is present; its content is available through the verified source link
spec
Open this path at the exported commit
The artifact is present; its content is available through the verified source link