Meta deploys Catching JiTTests to production
Meta has published the production deployment results of Catching JiTTests: the system uses large language models to automatically generate executable tests for code changes awaiting merge, exposing defects before the code is merged. The system employs two workflows, intent-aware and dodgy diff, and uses an LLM-as-Judge ensemble together with the rule-based method RubFake to filter false positives, while reducing manual item-by-item review through a human-on-the-loop approach. Meta says 589 engineers have participated, with a true positive rate of 60%; in the first half of 2026, it caught 74 severe privacy SEVs at the diff stage, reducing the overall incidence of such issues by 20%.
Matched fieldsTitle
View story:Meta deploys Catching JiTTests to the production environment