DOI: 10.3390/s26165106 ISSN: 1424-8220

Dynamic Low-Rank Modulation and Frequency-Domain Collaboration for Scene-Adaptive Image Fusion Network

Yao Zhang, Lin Tian, Sirui Huang

Infrared and visible image fusion aims to integrate the complementary information from heterogeneous sensors, thereby enhancing the robustness of visual perception in complex environments. Most existing methods, however, employ fixed network parameters, a characteristic that limits their adaptive modeling capabilities for cross-modal information under scenarios such as drastic illumination changes, low light conditions, dense fog, and strong glare. To address this issue, we propose a scene-adaptive image fusion network, termed HL-Fuse, based on dynamic low-rank modulation and frequency-domain collaboration. For the spatial domain, the Hyper-LoRA is introduced via our designed SceneHyperNet, which mathematically constrains parameter variations within a low-rank subspace to adaptively calibrate attention mappings according to the global scene information. For the frequency domain, a tailored FAM is introduced to bridge spatial-domain feature aggregation and explicit spectrum reweighting by implementing targeted high- and low-frequency filtering, thereby enhancing edge and texture representation. Experiments conducted on the MSRS, TNO, M3FD, and FMB datasets demonstrate that HL-Fuse achieves competitive performance in terms of both multiple objective metrics and subjective visual quality, while the overall performance in the MSRS downstream object detection task is also enhanced. These results indicate the potential value of HL-Fuse for complex scene perception and remote sensing applications.

More from our Archive