DOI: 10.3390/s26154857 ISSN: 1424-8220

A Span-Prior-Guided Explainable Multimodal Neural Network Method for Final-State Quality Inspection of Hairpin Windings

Xiaopeng Chang, Bangcheng Zhang, Zhi Gao, Siyu Chen, Jingru Liu

For final-state quality inspection of three-dimensional stamped hairpin windings, existing studies still lack multimodal methods that integrate mechanical geometric constraints, prior-guided fusion, and decision interpretability. This study proposes a span-prior-guided explainable multimodal neural network method and develops SPIMA-Net. The final-state images were acquired at a fixed inspection station with a fixed camera position and imaging angle under a CCD vision light source. Final-state images are used as visual inputs, while geometric priors are constructed from span measurements and model-type information. A visual branch and a span branch extract image and prior features, and a span-prior-assisted gating mechanism modulates visual features to enable collaborative fusion. Experimental results show that SPIMA-Net achieves an accuracy of 98.14%, an F1-score of 96.55%, and an AUC of 0.9983 on the test set. Its nonconforming-class F1-score is improved by 10.44, 3.04, 6.27, 1.38, and 0.66 percentage points over the image-only, span-only, direct-fusion, SE-fusion, and CBAM-fusion models, respectively, while the total number of misclassifications decreases to five. Interpretability analysis shows that the model mainly focuses on span openings, end profiles, and local abnormal regions. Relative and absolute span deviations are identified as the main mechanical geometric factors affecting final-state quality classification. The proposed method provides a neuro-mechanical fusion approach that demonstrates high discriminative performance and engineering interpretability for hairpin winding quality inspection on the investigated industrial dataset.

More from our Archive