OpenAI
GPT-6 Astra
Codex
Not repaired
Cost
$3.98
Wall clock
28m 50s
Steps
43
Turns
38
Tool calls
37
Prompt tokens
2.6M
Cache hit
97%
The same moment three ways: the defect, this candidate, and the merged fix.
Episode 1
The candidate capture has no step marks; jump the other two to a step to line up the moment.
Play All
BeforeThe defect, before any patch
0:00.00 / 0:00.00Frame 0 · Review collection permissions

Watch the Groups list and the space below it. The baseline sends the invitation successfully, but does not explain that the selected groups cannot view this dashboard.

CandidateWhat this agent produced
0:00.00 / 0:00.00Frame 0
ReferenceThe merged fix
0:00.00 / 0:00.00Frame 0 · Review collection permissions

Watch the warning directly below Groups: it appears for Marketing, clears when Sales is added, and returns when Sales is removed. The warning still allows the invitation to be sent.

Final frame the judge scored
Final state of the candidate run