Skip to content- Sources: primary
- Summary: Robinhood's data platform team built a two-layer reviewer for pipeline PRs. Deterministic scripts check the schema registry, catalog tags, registered lineage and staging performance, and they turn CI red on failure. A separate agent with read-only repository tools scores risk and approves or escalates. The agent can never approve grants that touch sensitive data, migrations that change intent, or verdicts where it has low confidence. As of 2026-08-31, about 60% of these PRs merged without human review, manual review effort fell about 75%, about 132 engineer hours a month were saved, related incidents fell about 30%, and the miss rate was about 2%. An on-call engineer updates the agent's rules by hand each week from reviewer replies.
- Why it matters: It gives a concrete pattern for scoped auto-merge: scripts settle factual checks, the agent judges only what they cannot see, and some change types always need a person.