Skip to content- Sources: primary, discussion
- Summary: Reviewing over 130 Patch the Planet PRs merged upstream, Trail of Bits confirmed 21 regressions (16 functional, one performance, four build or test), none of which broke a security protection. Its regression-hunt plugin requires a live proof of concept per claim and produced 25% fewer false positives than a baseline Codex prompt, with a 95% interval of 14% to 38%. The patching-bugs plugin uses a three-arm proof (original fails, patch passes, revert fails) and reads project THREAT_MODEL.md and PATCHING_GUIDELINES.md files.
- Why it matters: Maintainers receiving agent-written patches get a concrete regression rate and a repeatable review workflow with schema-checked evidence.