quality_assurance · saas · workflow
Factory uses LangSmith to achieve 2x iteration speed and 20% cycle time reduction in SDLC automation
Factory's LLM-based Droids needed robust observability in customer environments with tight data controls, while existing tools were cumbersome for tracking data flow and debugging context-awareness issues. Manual prompt optimization was also time-consuming and inaccurate.
How it works
Common implementation structure
How this type of workflow is generally built, generalized across documented cases — not tied to any one vendor's stack. Click any stage to read what happens there. Specific products that implement these stages appear in “Tools commonly seen” below.
Stage 1 · Droid SDLC workflow initiates
Factory's fleet of Droids automates different stages of the SDLC, boosting engineering velocity for large organizations.
Tools used
LangSmithLangChainAWS CloudWatchFeedback API
Outcome
Factory achieved 2x iteration speed, an average ~20% reduction in open-to-merge time, and a 3x reduction in code churn in the first 90 days. Clients also report an average cycle time reduction of up to 20% and over 550,000 hours of development time saved.
Results
Time saved~20%
Volume2x
Grounding & classification
Source type: vendor customer story
28 fields verified against source quotes.
agentic workflowcode generationcode diff prhuman review describedmetric backednamed customerproduction runtime claimedsource backedtools describedworkflow describedsoftwareaccuracy improvementcycle time reductionerror reductionthroughput increasetime savedvendor customer storyquality assurancedata sync enrichmentmonitor detect alert