Executive Summary
AI is changing manufacturing quality control mainly through camera inspection: a camera, steady lighting and a trained model check every part and flag the bad ones. It catches defects visible in a clear photo, such as scratches, dents, missing parts and bad print, but not defects inside a part.
The measured evidence is more modest than headline claims. In one study, 82 human inspectors caught 85% of defective items but also rejected 35% of acceptable ones.1 Research models still struggle with hard images.2 And AI use in general is spreading: 20.0% of EU enterprises with 10 or more employees used AI in 2025, up from 13.5% in 2024.3
Bottom line: judge AI inspection by two error rates against your current inspection, not by one accuracy figure, and start with one station in shadow mode.
Current State of AI Implementation
Market Penetration and Growth
Official statistics track AI use in general, not AI for quality control. In the EU, 20.0% of enterprises with 10 or more employees used AI in 2025, up from 13.5% in 2024, across most business sectors.3 Use rises with size: 17% of small enterprises, 30% of medium-sized ones and 55% of large ones.4 EU manufacturers that used AI did so mostly for marketing and sales (30%) and business administration (27%).4
In the United States, the Census Bureau’s Business Trends and Outlook Survey put AI use “in any business function” at 17% to 20% of businesses from December 2025 to May 2026.5 It covers all nonfarm sectors. Neither survey reports AI used for inspection.
Technology Maturity
Three families of methods make the pass/fail call, and many systems mix them:
Rule-based machine vision: hand-set tools that find an edge, measure a gap or read a code. It is the most established and easiest to explain, but it breaks when good parts vary in look.
Deep learning: models trained on labeled images of good and bad parts. They handle defects that vary in shape, but they need real examples of each defect type.
Anomaly detection: models trained on good parts only, which flag anything different. That suits rare defects, but results on hard images still fall short.
Visual Performance Analysis
Comparative Performance Metrics
One accuracy figure hides what matters on a line. Track two error rates:
False reject rate = good parts flagged as bad / all good parts checked
Escape rate = bad parts passed as good / all bad parts checked
False rejects cost re-inspection, scrap and trust; escapes reach your customer. The threshold trades one for the other, so decide per defect type which error costs more.
Example (illustrative): assume 1 part in 200 is defective. A system that passes every part is then 99.5% accurate and catches nothing.
Human inspection sets the baseline to beat:
| Source | Setting | Finding |
|---|---|---|
| Sandia National Laboratories review (See, 2012) | 212 documents on visual inspection, 1958–2012 | Cites a 1975 source: “error rates of 20% to 30% are frequently quoted in the inspection literature”6 |
| See, Human Factors (2015) | 82 inspectors, 140 precision parts, eight defect types, U.S. Nuclear Security Enterprise | 85% of defective items correctly rejected; 35% of acceptable parts incorrectly rejected1 |
In those terms, the 2015 inspectors had a 15% escape rate and a 35% false reject rate, in a very strict setting: one data point, not an industry average. Measure your inspectors and any AI system on the same golden set of known good and bad parts.
Published Performance Results
| Source | What was published | What it shows |
|---|---|---|
| MVTec AD (CVPR, 2019) | 5,354 images, 15 categories, over 70 defect types; 60 to 391 defect-free training images per category7 | Models can learn from good parts alone |
| MVTec AD 2 (preprint, 2025) | More than 8,000 images in eight scenarios, with lighting changes, transparent objects and very small defects2 | Top methods often under one percentage point apart on older benchmarks; the evaluated methods stayed below 60% average AU-PRO on this dataset |
| BMW Group press release (2019) | Press-shop model trained on around 100 real images per feature: good parts, dust particles, oil droplets8 | One manufacturer’s reported training-set size, not an audited result |
AU-PRO scores how well a method outlines the defect. Methods that look solved on clean images fall short on hard ones, so test on your own line’s images first.
Technology Deep Dive
Computer Vision Systems
An inline inspection station has six parts, and the model is only one of them:
- Camera and lens: the smallest defect should span several pixels. Field-of-view width divided by the pixels across the sensor gives millimeters per pixel.
- Lighting: makes defects stand out and every image alike.
- Trigger: a photo eye, encoder or PLC signal that fires the camera.
- Edge computer: runs the model within the cycle time. BMW Group described AI that compares component images with hundreds of others “in milliseconds”.8
- Reject mechanism: an air blast, pusher, line stop or operator alert.
- PLC and MES link: pass/fail to the line, and each result with its image and part ID to your records.
A camera sees only the surface; X-ray and 3D sensors cover hidden joints, height and flatness. For how such a station fits an existing line, see AI visual inspection on production-line cameras.
Machine Learning Implementation
Predictive quality models: these read process data, not images. In 2020, BMW Group said an algorithm in its Munich paint shop monitors over 160 car-body features to predict the quality of paint application.9
Anomaly detection: it needs no defect examples, which helps with rare defects. But it says “different”, not “which defect”, and it can flag harmless changes such as a new material lot.
Process optimization: a model that changes machine settings itself needs separate validation and human sign-off.
Industry-Specific Applications
Automotive Manufacturing
Surface quality inspection: at BMW Group’s Regensburg plant, cameras read striped patterns reflected off each painted body to find slight defects. The system records each defect’s position, shape and size, a laser projector marks it, and AI-controlled robots process each vehicle individually. Up to 1,000 vehicles a working day go through this process, BMW said in 2023.10
Weld and assembly checks: cameras confirm seam appearance and that parts are present, correctly oriented and seated. Internal weld quality still needs ultrasonic tests or teardown.
Semiconductor and Electronics Production
Wafer inspection: optical and electron-beam tools find particles and pattern defects; machine learning sorts the defect images into classes linked to process steps.
SMT assembly: automated optical inspection (AOI) after reflow checks presence, polarity, offset and solder bridges, while X-ray covers joints hidden under BGA packages. An AI model can also review AOI calls to cut false alarms.
Pharmaceutical Manufacturing
Particle inspection: FDA’s 2021 draft guidance says each final container of an injectable product must be inspected for visible particles (100% inspection) using a qualified method.11 Trained people, automated inspection technology or both should do it, and the quality unit then samples each batch for acceptance quality limit (AQL) testing.
Packaging checks: cameras verify fill level, seals, label text and serialization codes.
Food and Beverage Industry
Label and code checks: cameras confirm that the right label is present and straight, and text reading (OCR) checks lot codes and dates against the work order.
Seal, fill and foreign-object checks: vision checks caps, seals and fill levels; X-ray and vision systems find foreign material and grade produce by color and size.
Implementation Challenges and Risk Mitigation
Technical Barriers
Data quality requirements: collect images at the real station, across lots, suppliers and shifts, and pull defect examples from scrap, rework and returns. Labeling is where your quality knowledge goes in: write a defect catalog with accept/reject limits, and have two inspectors label the same images to expose unclear specs.
Legacy system integration: an older line may lack a clean trigger signal or a free PLC input, and MES records may lack a part ID for each image.
Scalability considerations: a model may not transfer to a station with different light or camera height, so standardize the setup before you copy a pilot.
Financial Planning and ROI Analysis
There is no honest list price: the setup decides the cost, and the model is often not the largest item. The main cost drivers are:
- Optics and lighting: views, defect size, part finish and line speed.
- Fixturing: holding each part in place and shielding it from stray light.
- PLC and MES integration: trigger and reject signals, an operator screen, records.
- Labeling time: your quality engineers’ hours.
- Retraining: for each new variant, supplier or material.
- Monitoring: drift alerts, audit samples, lens cleaning and spares.
On the benefit side, count re-inspection hours, scrap, rework, escapes and false rejects. For the payback arithmetic, use the method in Calculating the True ROI of Workflow Automation with your own pilot data.
Workforce Transition Management
Role evolution: inspectors move to reviewing flagged parts, auditing passed parts and labeling new defects. Their defect knowledge becomes the training data.
Skills development: train people on the review screen and on reporting wrong calls. Reject rates stay a signal for statistical process control.
Employment impact: be open about which tasks change, and keep experienced inspectors in charge of the golden set.
Risk Assessment and Mitigation Strategies
Cybersecurity Considerations
Inspection cameras and edge computers are operational technology (OT), which NIST covers in its OT security guide, SP 800-82 Rev. 3 (2023).12 The usual measures apply:
- Network segmentation: inspection systems on the OT network, apart from office IT and the internet.
- Encrypted communications: for image and result traffic that leaves the cell.
- Continuous monitoring: a log of every change to models, thresholds and settings.
- Access control: only named people can change a threshold or deploy a model.
Quality Assurance Validation
For injectables, FDA’s draft guidance calls for a qualified inspection method.11 For medical devices, FDA’s final guidance on computer software assurance (February 2026) takes a risk-based approach to establishing confidence in production and quality-system automation.13 Validation usually covers:
- Challenge set: detection proven on known good and defective parts.
- Documentation requirements: every decision logged with its image, model version, threshold and part ID.
- Performance qualification: stable results across lighting, part variants and line speed.
- Change control: re-testing after any retraining or threshold change.
Reliability and Redundancy
The model does not change on its own, but what the camera sees does: an aging lamp, a bumped mount, a dirty lens, a new supplier.
- Hybrid approaches: a human audit sample of passed parts and a review of rejects.
- Fail-safe mechanisms: on a camera or computer fault, stop the line or divert parts to manual inspection.
- Redundant systems: spare cameras and lights, and a rollback to the last approved model.
What Works Now, Where the Limits Are, and What to Ask a Supplier For
Nothing here is a forecast. The dates are publication dates of work that already exists.
What works now
Surface defects a camera can see under steady lighting: scratches, dents, missing or misoriented parts, bad print, label and code checks. Training on good parts alone is established practice, not a novelty: MVTec AD, published in 2019, provides 5,354 images across 15 categories with 60 to 391 defect-free training images per category.7 Making the pass/fail call inside the cycle time is routine, which is why inference runs on a computer at the line rather than in a data centre.
Where the limits are
Three are worth naming out loud before you compare suppliers.
Benchmark scores do not transfer to your parts. MVTec AD 2, released in 2025, holds more than 8,000 images across eight scenarios including transparent and overlapping objects, dark-field and back light illumination, and extremely small defects. The state-of-the-art methods evaluated on it stayed below 60% average AU-PRO.2 AU-PRO scores how well a method outlines the defect, and that figure is a result for those methods on that dataset. It is not a ceiling on inspection accuracy, not a property of the technology and not a number to quote about your line. What it does show is that methods separated by less than a percentage point on older sets separate clearly once the scene resembles a plant.
A camera sees the surface. Some defects appear as changes in an object’s geometry, which a depth scan captures: MVTec 3D-AD, published in 2022, provides industrial depth scans of 10 object categories for that reason.14 X-ray covers joints hidden under packages. Work out which of your defect types each sensor can physically reach before any model is discussed.
What the camera sees drifts even when the model does not. An aging lamp, a bumped mount, a dirty lens, a new material lot. This is the limit that bites in year two rather than in the pilot.
What to ask a supplier for
- Both error rates, not one accuracy figure, measured on your own acceptance set of known good and bad parts.
- An acceptance set kept out of training and out of threshold setting. A threshold tuned on the same images it is then scored against produces a number you cannot use.
- A run in shadow mode on your line before the system rejects anything.
- The cost and lead time of retraining for a new variant, supplier or material.
- A named rule for threshold changes: who may make one, and where it is recorded.
- A straight answer on what the proposed sensor cannot see, and what still needs ultrasonic testing, X-ray, a gauge or a person.
Who supplies the parts
An AI inspection station draws on four kinds of suppliers, and some vendors cover several:
- Camera and optics makers: industrial cameras, lenses, lighting, and X-ray or 3D sensors.
- Machine-vision software vendors: rule-based, deep-learning and anomaly-detection tools.
- PLC and MES integrators: trigger and reject wiring, operator screens and result records.
- Edge and cloud compute providers: industrial PCs and GPUs at the line, plus storage and training off it.
What it changes outside the plant
- Regulatory compliance: injectables already need 100% inspection with a qualified method, and FDA’s draft guidance names automated inspection technology as one way to do it.11
- Customer requirements: image evidence tied to lot and serial numbers.
- Supply chain integration: results sent to a customer’s quality system instead of manual reports.
Strategic Implementation Framework
Durations are planning ranges for a small or mid-size plant starting with one product family at one station, not benchmarks. Many variants or rare defects add time.
Phase 1: Foundation Building (planning range: 2–4 weeks)
- Pick one station and two to four defect types, with an owner in quality.
- Write the defect catalog and build the golden set.
- Measure today’s false reject and escape rates on that set, and agree go-live criteria in writing.
- Confirm access to a trigger signal, the PLC and the MES.
Phase 2: Pilot Implementation (planning range: about 8 weeks)
- Weeks 1–2: set up the camera, lighting and trigger.
- Weeks 3–4: collect and label images across shifts, lots and variants.
- Week 5: train a first model and set the threshold on held-out images.
- Weeks 6–7: run in shadow mode, where the system judges every part but rejects nothing.
- Week 8: compare both error rates with the manual baseline, then go, extend or stop.
Phase 3: Line-by-Line Scaling (planning range: 4–8 weeks per similar station)
- Extend to similar stations first, reusing mounts, lighting and trigger designs.
- Run each new station in shadow mode before it rejects parts.
- Name owners for monitoring and retraining, and put model changes under change control.
Conclusion and Strategic Implications
AI quality control is practical today for defects a camera can see under stable conditions. Headline accuracy figures do not carry over between lines. Human inspectors err,16 and the methods evaluated on the hardest public dataset fall well short of solving it,2 so make the comparison on your own parts.
Key success factors:
- A defect catalog and an acceptance set of known good and bad parts, built before any hardware is bought and kept out of training and threshold setting.
- Lighting, fixturing and triggers treated as the main engineering work.
- Shadow-mode trials judged by both error rates against today’s baseline, on that same set.
- Named owners for monitoring and retraining after go-live.
Strategic implications: start where defects are visible and a wrong call costs little during the trial. Then expand line by line as measured results come in.
Footnotes
-
Judi E. See, “Visual Inspection Reliability for Precision Manufactured Parts”, Human Factors, 2015. https://journals.sagepub.com/doi/10.1177/0018720815602389 ↩ ↩2 ↩3
-
Lars Heckler-Kram, Jan-Hendrik Neudeck, Ulla Scheler, Rebecca König and Carsten Steger, “The MVTec AD 2 Dataset: Advanced Scenarios for Unsupervised Anomaly Detection”, arXiv preprint, 2025. https://arxiv.org/abs/2503.21622 ↩ ↩2 ↩3 ↩4
-
Eurostat, “20% of EU enterprises use AI technologies”, news article, 11 December 2025. https://ec.europa.eu/eurostat/web/products-eurostat-news/w/ddn-20251211-2 ↩ ↩2
-
Eurostat, “Use of artificial intelligence in enterprises”, Statistics Explained, data extracted December 2025. https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Use_of_artificial_intelligence_in_enterprises ↩ ↩2
-
U.S. Census Bureau (Adam Grundy, Cory Breaux and Dhanapati Khatiwoda), “Large Firms With at Least 20 Employees Biggest AI Users”, May 2026. https://www.census.gov/library/stories/2026/05/ai-use-businesses.html ↩
-
Sandia National Laboratories (Judi E. See), “Visual Inspection: A Review of the Literature”, SAND2012-8590, 2012. https://digital.library.unt.edu/ark:/67531/metadc835891/m2/1/high_res_d/1055636.pdf ↩ ↩2
-
Bergmann, Fauser, Sattlegger and Steger, “MVTec AD — A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection”, CVPR, 2019. https://openaccess.thecvf.com/content_CVPR_2019/papers/Bergmann_MVTec_AD_—_A_Comprehensive_Real-World_Dataset_for_Unsupervised_Anomaly_CVPR_2019_paper.pdf ↩ ↩2
-
BMW Group, “Fast, efficient, reliable: Artificial intelligence in BMW Group Production”, press release, July 2019. https://www.press.bmwgroup.com/global/article/detail/T0298650EN/fast-efficient-reliable:-artificial-intelligence-in-bmw-group-production?language=en ↩ ↩2
-
BMW Group, “BMW Group applies AI solutions to increase paint shop quality”, press release, May 2020. https://www.press.bmwgroup.com/middle-east/article/detail/T0308585EN/bmw-group-applies-ai-solutions-to-increase-paint-shop-quality ↩
-
BMW Group, “Automated surface processing at BMW Group Plant Regensburg – trio of digital paint shop processes”, press release, May 2023. https://www.press.bmwgroup.com/global/article/detail/T0411621EN/automated-surface-processing-at-bmw-group-plant-regensburg-%C3%A2%C2%80%C2%93-trio-of-digital-paint-shop-processes ↩
-
U.S. Food and Drug Administration, “Inspection of Injectable Products for Visible Particulates”, draft guidance for industry, December 2021. https://www.fda.gov/media/154868/download ↩ ↩2 ↩3
-
National Institute of Standards and Technology, “Guide to Operational Technology (OT) Security”, NIST SP 800-82 Rev. 3, September 2023. https://csrc.nist.gov/pubs/sp/800/82/r3/final ↩
-
U.S. Food and Drug Administration, “Computer Software Assurance for Production and Quality Management System Software”, final guidance, February 2026. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/computer-software-assurance-production-and-quality-management-system-software ↩
-
Paul Bergmann, Xin Jin, David Sattlegger and Carsten Steger, “The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localization”, VISAPP, 2022. https://arxiv.org/abs/2112.09045 ↩


