DOI: 10.3390/s26165271 ISSN: 1424-8220

Mamba-BEV: A Multiscale State-Space Framework for 3D Object Detection from Point Clouds

Yuyang Liu, Jiabin Wang, Min Mao, Kun Zhang, Yu Xu, Mingchen Zhu, Xianjun Wu

LiDAR point clouds are sparse, irregular, and unevenly distributed, which makes representative feature extraction challenging for 3D object detection. Currently, Mamba modules have been increasingly applied to 3D object detection due to their ability to efficiently model global spatial dependencies. However, preserving geometric structures while modeling global spatial dependencies remains challenging in Mamba-based frameworks. In view of this, this paper proposes a single-stage 3D object detection framework for LiDAR-based point clouds. First, this paper designs a hierarchical multiscale structure called Multiscale Voxel–Point Alternating Fusion (MVPF) Module. Within this module, the 2DMamba module is introduced into the feature extraction stage at each scale to model global spatial dependencies in the BEV plane through selective state-space scanning. Second, we design a Z-to-Channel cross-dimensional reorganization strategy that merges the voxel Z dimension into the channel dimension, yielding a BEV-form feature representation suitable for 2DMamba processing. Third, this paper proposes a Local Voxel Feature Enhancement (LVFE) module composed of a Point-to-Voxel Feature Aggregation (PVFA) module, a Voxel Densification Module (VDM), and a coordinate-indexed Voxel-to-Point Mapping (VPM) module, which enhances local voxel representations while maintaining point–voxel spatial correspondence. On the KITTI validation set, Mamba-BEV achieved higher detection accuracy and inference speed than the baseline. Under the Moderate difficulty level of APR11, the 3D AP for Car, Pedestrian, and Cyclist improved by 0.6%, 1.5%, and 0.4%, respectively, compared to the baseline, while the inference speed increased from 44.05 FPS to 67.11 FPS. These results demonstrate the effectiveness of the proposed Mamba-BEV for point cloud-based 3D object detection.

More from our Archive