Dropbox builds ML-based document detection pipeline for iOS scanning
Dropbox needed accurate, fast document detection that could run on mobile devices. DNNs were too expensive in compute and memory for mobile deployment, and Apple's built-in rectangle detection SDK was insufficiently accurate for essential use-cases such as scanning small receipts or business cards in cluttered backgrounds.
DNNs were ruled out due to mobile compute and memory cost. Apple's rectangle detection SDK underperformed in complex scenes. The Canny edge detector was trialled but produced poor results because it amplified text inside the document while failing to clearly detect document edges.
Dropbox's custom pipeline runs near-realtime at 8–10 frames per second, requires much less labeled training data than DNNs, and produces detections 60% less likely to need manual user correction than Apple's SDK — validated by an A/B test.
Frequently asked questions
What did this team achieve with this AI workflow?
Dropbox's custom pipeline runs near-realtime at 8–10 frames per second, requires much less labeled training data than DNNs, and produces detections 60% less likely to need manual user correction than Apple's SDK — val…
What tools did this team use?
OCR, Hough transform.
What results were reported?
manual correction likelihood vs Apple SDK: 60% less likely; Pipeline throughput: near realtime at about 8–10 frames per second (source-reported, not independently verified).
What failed first in this deployment?
DNNs were ruled out due to mobile compute and memory cost.
How is this data entry ops AI workflow structured?
User scans document → ML-based edge detection → Hough transform line finding → Quadrilateral scoring and selection → Extract and save as PDF → OCR for Business users.