Spatial–Spectral Decoupling-Enhanced Lightweight Network for Few-Shot Hyperspectral Anomaly Detection in Remote Sensing Imagery
Hongwei Qu, Qing Guo, Jinlin ZouHyperspectral anomaly detection (HAD) identifies targets by spectral differences. However, large deep learning models overfit under the small-sample conditions typical of remote sensing, where anomalies are sparse and annotations costly. We propose a lightweight network on the GT-HAD transformer backbone for hyperspectral imagery. The design includes: (1) capacity reduction via multi-layer perceptron (MLP) ratio and embedding dimension optimization; (2) a Decoupled Projection Gating Fusion (DPGF) module enforcing spatial–spectral decoupling via dual-path projection and complementary regularization; (3) analysis of capacity–generalization tradeoffs across six airborne hyperspectral datasets. Experiments reveal an inverted-U relationship between capacity and generalization. The Mini configuration (121 K parameters) achieves a 53% parameter reduction. It yields AUC improvements on three datasets, maintains negligible performance loss (<0.1%) on two datasets, and exhibits a measurable decline on only one dataset, compared with the 255 K baseline. Notably, the baseline attains higher accuracy with only 25% training data on Pavia (+3.69% area under the receiver operating characteristic curve, AUC). This dataset-specific observation provides empirical evidence that capacity–data mismatch can induce severe overfitting in deep HAD models. Under a 25% training ratio, DPGF shows observable performance trends on spectrally homogeneous scenes, and zero initialization ensures identical performance to that of the baseline at the initial training stage, eliminating insertion risk during module deployment. However, the limited diversity of sensors and scene types constrains the generalizability of the observed trends. These results demonstrate that spatial–spectral decoupling with lightweight design suppresses overfitting in few-shot HAD, guiding compact models for onboard satellite and unmanned aerial vehicle (UAV) applications.