Quality 4.0 Framework for Detecting Post-Quality-Gate Rare Failures in Automotive Manufacturing Under Extreme Class Imbalance
Muhammed Hakan Yorulmuş, Hür Bersam SidalPredictive quality systems are central to Industry 4.0 manufacturing, yet detecting rare defects that pass established quality gates remains an open problem. This study addresses post-quality-gate failure detection in automotive brake manufacturing, where 310 faulty units (1.20%) among 25,756 production records create a naturally occurring extreme class imbalance of 1:82. Fault labels are derived from warranty reports and linked to multi-station production line measurements, while negative samples may include latent failures, motivating a recall-focused evaluation. We propose a Quality 4.0 machine learning framework that compares five resampling methods (ADASYN, SMOTE-Tomek, KMeans-SMOTE, CTGAN, and TVAE) plus a no-resampling baseline across 24 classifiers and stacking ensembles. In total, 504 configurations are tested on a held-out test set. The proposed SVM-RBF model trained on ADASYN-augmented data achieves recall of 0.871, specificity of 0.982, balanced accuracy of 0.926, and ROC-AUC of 0.952, producing only 93 false positives (FPR = 1.8%). Stacking ensembles provide alternative operating points maximizing the detection rate (93.5%) and a separate operating point with the highest discrimination capacity (ROC-AUC = 0.975). Feature importance analysis through Permutation Importance and SHAP identifies Force Increment as the leading feature under both attribution methods. Friedman and Wilcoxon tests confirm statistically significant differences among strategies. The framework offers a practical way to add predictive capability to existing quality control systems.