Skip to content- Sources: primary
- Summary: Meta's Catching JiTTests system targets risky diffs with a risk score, generates tests through intent-aware and mutation-style workflows, and ranks failing tests with an LLM-as-Judge ensemble plus a rule-based assessor called RubFake. Engineers are contacted only for high-ranked catches. Meta reports 589 engineers engaged, a 60 percent true positive rate, and 74 serious privacy bugs caught before landing in the first half of 2026.
- Why it matters: It is a production example of an executable-test review gate for agent-era diffs, with human-on-the-loop oversight and measured outcomes.