DOI: 10.3390/rs18162674 ISSN: 2072-4292

Freq-LoRA: Frequency-Domain Low-Rank Adaptation for Weather-Robust Aircraft Segmentation in EO Remote Sensing

Yingwei Xia, Tian Yu, Wang Xi, Fan Wang, Yong Liu, Nanhao Liang, Wen Zhang

Adverse weather poses a major challenge to ground-based electro-optical (EO) aircraft surveillance. Existing parameter-efficient fine-tuning (PEFT) methods operate mainly in the spatial domain and treat weather as a generic domain shift rather than a frequency-dependent degradation. We propose Freq-LoRA, a frequency-domain PEFT method that applies the Type II Discrete Cosine Transform (DCT-II) to frozen encoder features, decomposes them into K=4 learned Gaussian frequency bands, and modulates the bands with an image-driven spectral gate. SpectralGate contains 140 parameters and estimates band importance from the input image’s DCT statistics, removing the need for external weather metadata at inference; weather-diverse training data are still required to learn the decomposition. On a Blender-simulated aircraft dataset covering five weather conditions, Freq-LoRA achieved a test mean Intersection-over-Union (mIoU) of 0.904, with a 95% confidence interval (CI) of [0.899, 0.908], using 559 K trainable parameters. Its point estimate differed by −0.002 from that of the weather-conditioned spatial method Feature-wise Linear Modulation (FiLM; 0.906), despite requiring no external weather metadata at inference. Relative to batch-size-matched Spatial LoRA (0.873; 95% CI: [0.867, 0.879]), Freq-LoRA had a 0.031 higher point estimate. Preliminary evaluation on real unmanned aerial vehicle (UAV) imagery yielded 0.421 mIoU (+13% relative to the zero-shot Segment Anything Model (SAM); one platform), and evaluation under six unseen image corruptions showed differences of at most 0.001 mIoU from the weather-oracle variant.

More from our Archive