Research on Fire Source Recognition and Fire Extinguishing Algorithms Based on Multimodal Fusion and Lightweight Model Deployment
Daoshang Zhai, Qianjuan Zhai, Shuo Liu, Xiuyan Liu, Tingting GuoConventional fire monitoring systems frequently exhibit high false alarm rates, delayed response times, and a lack of closed-loop control capabilities, which severely constrain their deployment in complex real-world environments. To address these issues, this paper proposes an embedded fire detection, tracking, and extinguishing system based on multimodal information fusion and a lightweight neural model. The system follows a “Perception–Decision–Execution–Feedback” closed-loop paradigm and is implemented on a heterogeneous cooperative computing architecture comprising OpenMV4 H7 Plus and STM32F103C8T6 microcontrollers. The perception layer implements a decision-level RGB-infrared fusion mechanism that incorporates a pruned, INT8-quantized lightweight FOMO model, enabling real-time fire detection with an inference latency of 210 ms and a model size of merely 1.8 MB under resource-constrained embedded conditions. The decision layer employs a Bayesian inference-based multimodal fusion framework that effectively suppresses spurious fire interference. The vision-only false detection rate is 15.3%. After infrared fusion verification, the system-level false alarm rate is reduced to 2.0% on the interference test set. In the execution layer, a sixth-degree polynomial jet trajectory model was established and combined with an improved PID–PI dual-loop controller to enable dynamic optimization of spray angle and flow rate in real time. Experimental results demonstrate that the proposed system achieves an average fire recognition accuracy of 95.6% with a false alarm rate as low as 1.4%. Furthermore, it realizes an extinguishing accuracy better than ±5 cm within an effective operating range of 10–60 cm and completes the entire perception-to-extinguishing cycle within 8.5 s under illumination conditions ranging from 50 to 100,000 lux. These results demonstrate the excellent real-time capability, robustness, and energy efficiency of the proposed system, providing a practical and scalable solution for autonomous embedded fire-fighting applications in household, industrial, and warehouse environments.