← Back to the wire

Meet Meta's JiTTests: LLM-Generated Tests Designed to Fail Before Risky Code Lands

AnnouncementResearchNov 16, 2026

Meta moved JiTTests, an LLM-based system that generates executable tests designed to fail on risky code changes, from research prototype into production. The company reports JiTTests caught 74 privacy SEVs at the diff stage in H1 2026, with privacy SEV occurrence down 20%. Engineers self-report a 60% true-positive rate, up from 19.5% in the initial deployment. The FSE 2026 paper analyzes 22,126 generated tests. JiTTests remains internal; Meta released no code, models, or API.

Receipt № 29121 source · awaiting confirmation ◐

Evidence

1source· awaiting independent confirmation

No score is assigned. Sources and their independence are shown in the citation chain below.

Citation chain · 1 source

01med
www.marktechpost.comBloghttps://www.marktechpost.com/2026/11/16/meta-jittests-llm-catching-tests-privacy-bugs/This source explains the full JiTTests pipeline, its two diff-aware test generation workflows, and the shift from a modest initial deployment to stronger self-reported production results.
PRIMARY
MetaCompanyGemini 3 ProModelJiTTestsModelLlama3.3-70BModelClaude Sonnet 4Model
Canonical: https://www.marktechpost.com/2026/11/16/meta-jittests-llm-catching-tests-privacy-bugs/