Signal-Image-Level Multimodal Fusion Network for Fault Diagnosis of Photovoltaic Panels in Solar Insecticidal Lamps

Solar insecticidal lamps are important physical control devices for green pest management, but faults in their photovoltaic power supply units can reduce trapping efficiency and shorten service life. To improve fault identification under complex agricultural environments, this study proposes a signal-image-level multimodal fusion network (SIL-MMFN) for detecting and classifying photovoltaic panel operating states in solar insecticidal lamps. The method combines time-series measurements with short-time Fourier transform (STFT)-based time–frequency images. A convolutional image branch extracts spatial features from time–frequency representations, whereas a bidirectional GRU branch with attention models temporal dependencies in the original signals. In addition, physics-informed features based on the illumination–current residual and output power are introduced to enhance discriminative fault information. Field data collected from four agricultural deployment nodes were used to classify normal, open-circuit, and mismatch states. Experimental results show that the proposed method achieved an accuracy of 97.5%, precision of 96.7%, recall of 97.8%, and macro-F1 score of 97.3%, outperforming single-modality and representative comparison models. The results indicate that multimodal fusion helps reduce confusion between open-circuit and mismatch faults and provides a potential approach for operating-state monitoring and maintenance of agricultural photovoltaic equipment. In this study, fault diagnosis refers to the detection and classification of photovoltaic panel operating states, including normal, open-circuit, and mismatch conditions.