Unwarranted rate
0.2%
Did agent-merged work deserve to exist? The unwarranted-merge rate — agent PRs later reverted because the change shouldn't have been built (a hallucinated premise), not because of a bug — over the trailing 90 days. As of 2026-08-27 07:50 MST.
| Model | Merged | Reverted | Unwarranted | Bug-reverts |
|---|---|---|---|---|
| deepseek/deepseek-v4-flash | 75 | 1 (1.3%) | 1 (1.3%) | 0 |
| claude-sonnet-4-6 | 662 | 3 (0.5%) | 1 (0.2%) | 2 |
| claude-sonnet-5 | 114 | 1 (0.9%) | 0 (0.0%) | 1 |
| claude-opus-4-7 | 4 | 0 (0.0%) | 0 (0.0%) | 0 |
| claude-opus-5 | 2 | 0 (0.0%) | 0 (0.0%) | 0 |
| deepseek/deepseek-chat | 98 | 0 (0.0%) | 0 (0.0%) | 0 |
| moonshot/kimi-k2.7-code | 4 | 0 (0.0%) | 0 (0.0%) | 0 |
| openai/mimo-v2.5-pro | 2 | 0 (0.0%) | 0 (0.0%) | 0 |
| Repo | Merged | Reverted | Unwarranted | Bug-reverts |
|---|---|---|---|---|
| Platform & internal | 127 | 1 (0.8%) | 1 (0.8%) | 0 |
| Lyra | 508 | 2 (0.4%) | 1 (0.2%) | 1 |
| Corvus | 214 | 2 (0.9%) | 0 (0.0%) | 2 |
| Vela | 105 | 0 (0.0%) | 0 (0.0%) | 0 |
| Pavo | 1 | 0 (0.0%) | 0 (0.0%) | 0 |
| Orion | 6 | 0 (0.0%) | 0 (0.0%) | 0 |
Revert-reason: tag on the revert PR (unwarranted | bug | superseded | other). A detected revert with no tag reads unclassified until a human labels it — never silently dropped.