Reasoning effort only matters when the agent can't run tests
A Reddit post argued Opus 5 codes worse at higher reasoning effort. I swept all five effort levels, 155 runs. With tests available every level went 18 for 18. With tests hidden, solves went from 0 to 8 out of 13.
Coding ability is not what separates frontier models
Five frontier models ran the same 410 coding-agent tasks, traced into Latitude. Capability tied; cost, speed, and refusals did not. What actually separates them and how to choose.
How We Built a System for Agents to Fix Themselves
Wire a self-healing loop for your AI agent in seven steps: telemetry, semantic search, annotations, Signals, generated evaluations, coding-agent dispatch, and a regression test in CI.
