SRAC-Net: HSI-Primary Residual Adaptation with Consistency Regularization for Lightweight Hyperspectral–LiDAR Classification
Guangrun Xiao, Zhongren Wang, Ziyang Guo, Zhijing Ye, Yantao WeiHyperspectral imagery (HSI) provides rich spectral information for land-cover classification, while Light Detection and Ranging (LiDAR) data provide complementary elevation and structural cues. Existing HSI–LiDAR fusion methods can achieve strong performance, but many rely on complex cross-modal interaction modules with substantial computational cost. This paper proposes the HSI-Primary Residual Adaptation with Consistency Regularization Network (SRAC-Net) for lightweight HSI–LiDAR classification. The method treats HSI as the primary spectral–spatial modality and introduces LiDAR features as an adapted residual correction. A learnable channel-wise residual scaling vector controls the contribution of the LiDAR residual in each feature channel. In addition, the HSI-primary branch is explicitly supervised and provides a stop-gradient reference distribution for consistency regularization of the fused prediction. Experiments on Houston2013, MUUFL, and Trento show that SRAC-Net achieves the highest mean OA, AA, and Kappa values among the evaluated internal baselines and selected representative fusion methods under the adopted protocol. The ablation results show that the complete configuration obtains the best mean performance among the evaluated variants. LiDAR perturbation experiments on Houston2013 further show smaller mean OA reductions than direct residual fusion under the tested Gaussian-noise, random-dropout, and block-occlusion settings. The method also maintains a compact parameter scale and low measured inference latency relative to several heavier multimodal architectures. These results suggest that HSI-primary residual adaptation with consistency regularization is an effective lightweight fusion alternative for the evaluated HSI–LiDAR classification settings.