DOI: 10.3390/rs18152526 ISSN: 2072-4292

Hyperspectral Image Classification Based on a Spatial–Spectral Dual-Branch Mamba Architecture

Jialing Li, Shangbo Zhou, Yawen Liu, Guiwen Hu, Xiaojuan Liu

Hyperspectral image classification is a core task in remote sensing image analysis and understanding. Existing Transformer-based methods have achieved excellent performance but are limited by the quadratic computational complexity of the self-attention mechanism, while the high-dimensional redundancy of hyperspectral data and the difficulty in deeply integrating spatial–spectral features also restrict further performance improvement. To address these issues, we introduce the Mamba architecture based on state-space models into hyperspectral image classification and propose the DFMamba model. The main innovations include (1) constructing a Hyperspectral Spatial Attention Embed (HSAE) to achieve efficient channel compression and feature extraction via adaptive grouped convolution, depth-wise separable convolution, and spatial attention; (2) proposing a spatial–spectral dual-branch collaborative modeling mechanism, EnhancedBothMamba, which separately models global dependencies in the spatial and spectral branches and integrates their outputs through softmax-normalized learnable global weights together with a learnable residual scaling factor; and (3) building an improved classification head, ClsHead, with a multi-scale branch fusion strategy to fully exploit local and global feature information. The experimental results on four standard hyperspectral datasets demonstrate that DFMamba achieves overall accuracy (OA) of 97.41% on the Pavia University dataset, 92.25% on the HanChuan dataset, 95.12% on the HongHu dataset, and 94.98% on the Houston dataset. Under the adopted evaluation protocol, DFMamba obtains higher mean OA than MambaHSI and the other compared methods while retaining favorable computational efficiency.

More from our Archive