DOI: 10.3390/app16126220 ISSN: 2076-3417

Semantic-Assisted Global Localization and Navigation for Mobile Robots

Xueqiang Yu, Yingchun Zhao, Chen Chen

Traditional global localization systems frequently struggle with perceptual ambiguities in dynamic environments and structurally similar scenes, which severely compromises navigation robustness. Concurrently, conventional path planning methodologies rarely integrate proactive safety considerations regarding high-risk environmental features. To resolve these critical limitations, this paper introduces a comprehensive semantic-assisted framework for mobile robots to enhance both global localization and navigation. First, we develop a semantic-aware place representation derived from LiDAR point clouds. By explicitly filtering dynamic objects and assigning category-specific weights, this approach mitigates perceptual aliasing and ensures robust scene recognition. Furthermore, we implement a Hyper-Semantic Point Histogram (HyperSPH) to embed semantic encoding directly into local geometric features. A Semantic Geometric Consistency Filter is subsequently applied to eliminate matching outliers and maximize registration accuracy. For secure navigation, we propose the Semantic-guided Twin Delayed Deep Deterministic Policy Gradient with Long Short-Term Memory (S-TD3-LSTM) algorithm within a deep reinforcement learning architecture. This strategy extracts temporal correlations via Long Short-Term Memory networks and integrates a dedicated semantic cost function to optimize obstacle avoidance policies. Extensive experiments demonstrate that the proposed localization module achieves superior retrieval and pose estimation precision over conventional methods. In complex path planning scenarios, the S-TD3-LSTM algorithm ensures stable convergence and generates highly adaptive trajectories. By proactively identifying and bypassing semantic hazards, the integrated system drastically minimizes exposure to dangerous zones, successfully establishing a rigorous balance between path efficiency and execution safety.

More from our Archive