DOI: 10.3390/machines14070730 ISSN: 2075-1702

Multispectral Sensor Fusion and YOLO-Family Benchmarking in PCB Component Detection: Challenges, State of the Art, and Future Directions

Xinglong Zhou, Sos Agaian

The worldwide spread of semiconductor devices has driven a surge in electronic waste (e-waste), which reached 62 million metric tons in 2022 and is projected to exceed 80 million metric tons by 2030. E-waste contains hazardous substances such as cadmium and mercury, yet also represents a $57 billion annual opportunity through the recovery of valuable and critical raw materials (CRMs). However, formal recycling rates remain stagnant at 22.3%, largely due to limitations of current automated sorting methods. These systems primarily rely on visible-light (RGB) imaging, which lacks the spectral resolution needed to distinguish chemically similar polymers, complex metal alloys, and composite substrates on printed circuit boards (PCBs). This paper presents a multidisciplinary synthesis of AI-driven detection and classification for e-waste, bridging materials science and computer vision through three interconnected themes. 1. Material and Economic Context: The toxicological risks and economic drivers of semiconductor recycling are characterized, framing fine-grained material identification as essential for a circular economy. 2. Multispectral Sensing & Fusion: Sensing modalities such as near-infrared (NIR), hyperspectral imaging (HSI), and X-ray fluorescence (XRF) are assessed, and sensor fusion strategies, including early, late, and intermediate fusion, are reviewed for high-throughput industrial settings. 3. Deep Learning Benchmarking: 11 publicly available PCB datasets are analyzed, and the YOLO series (YOLOv3–YOLOv12) is compared with leading non-YOLO detectors, including Faster R-CNN, RT-DETR-L, and RetinaNet. The results show that while YOLOv9s achieves a peak mAP@0.5 of 56.5% and YOLOv11s offers an optimal industrial profile (37.2% mAP@0.5:0.95 at 115 ms edge inference), all RGB-based models fail to detect visually ambiguous surface-mount devices (SMDs), with mAP values below 12%. This confirms a performance ceiling for purely visual systems. The review concludes that transitioning from RGB-centric to multispectral fusion architectures is the primary research frontier and proposes a roadmap for standardized multimodal datasets and edge-deployable fusion models to enable next-generation, high-recovery automated recycling.

More from our Archive