Back office ops · Production

Meta builds a swarm of 50+ AI agents to map tribal knowledge across large-scale data pipelines

The problem

Meta's AI agents failed to make useful edits on a large proprietary pipeline because they lacked any map of the codebase's tribal knowledge — non-obvious naming conventions, cross-module dependencies, and undocumented rules that existed only in engineers' heads.

First attempt

Existing AI-powered operational systems could not be extended to development tasks because agents had no understanding of the proprietary config-as-code structure, causing them to produce subtly incorrect code.

Workflow diagram · grounded in source
1
Explorer agents map codebase
ai_action
“Two explorer agents mapped the codebase”
2
Module analysts analyze files
ai_action
“11 module analysts read every file and answered five key questions”
3
Writers generate context files
ai_action
“Two writers generated context files”
4
Critic agents review quality
validation
“10+ critic passes ran three rounds of independent quality review”
5
Fixers apply corrections
ai_action
“Four fixers applied corrections”
6
Orchestration routes engineer queries
routing
“we built an orchestration layer that auto-routes engineers to the right tool based on natural language. Type, "Is the pipeline healthy?" and it scans dashboards and matches against 85+ historical incident patterns. Type, "Add a new data …”
7
Automated self-refresh
feedback_loop
“automated jobs periodically validate file paths, detect coverage gaps, re-run quality critics, and auto-fix stale references”
Reported outcome

The pre-compute engine achieved 100% AI context coverage across 4,100+ files (up from ~5%), documented 50+ non-obvious patterns, and preliminary tests show 40% fewer AI agent tool calls per task; complex workflow guidance time dropped from ~two days to ~30 minutes.

Reported metrics
AI context coverage100%
Codebase files with AI navigation4,100+
AI agent tool calls per task40% fewer
Complex workflow guidance completion time~30 minutes
Show all 7 reported metrics
AI context coverage100%
Codebase files with AI navigation4,100+
AI agent tool calls per task40% fewer
Complex workflow guidance completion time~30 minutes
Quality critic score (after three rounds)4.20 out of 5.0
File path hallucinationszero hallucinations
Tested prompts core pass rate100%
Reported stack
large-context-window model
Source
https://engineering.fb.com/2026/04/06/developer-tools/how-meta-used-ai-to-map-tribal-knowledge-in-large-scale-data-pipelines/
Read source ↗

Frequently asked questions

What did this team achieve with this AI workflow?

The pre-compute engine achieved 100% AI context coverage across 4,100+ files (up from ~5%), documented 50+ non-obvious patterns, and preliminary tests show 40% fewer AI agent tool calls per task; complex workflow guid…

What tools did this team use?

large-context-window model.

What results were reported?

AI context coverage: 100%; Codebase files with AI navigation: 4,100+; AI agent tool calls per task: 40% fewer; Complex workflow guidance completion time: ~30 minutes (source-reported, not independently verified).

What failed first in this deployment?

Existing AI-powered operational systems could not be extended to development tasks because agents had no understanding of the proprietary config-as-code structure, causing them to produce subtly incorrect code.

How is this back office ops AI workflow structured?

Explorer agents map codebase → Module analysts analyze files → Writers generate context files → Critic agents review quality → Fixers apply corrections → Orchestration routes engineer queries → Automated self-refresh.