DOI: 10.3390/math14203830 ISSN: 2227-7390

An Improved Escape Algorithm with Reinforcement Learning and Multi-Strategy Synergy for Global Optimization and Real Problems

Bolai Jin, Haotian Zheng, Yangjian Yang

To address the limitations of the standard Escape Algorithm (ESC), including its tendency to become trapped in local optima and its slow convergence speed in complex optimization scenarios, this paper proposes an Improved Escape Algorithm (IESC) for global optimization and robot path planning. First, a reinforcement learning–based decision-making mechanism using Q-learning is introduced to replace the fixed rule–driven population update strategy in ESC. By constructing a closed-loop framework of “individual–action–reward,” the proposed method enables adaptive strategy selection and effectively balances exploration and exploitation during different stages of the optimization process. Second, to enhance information interaction among individuals, a thermal conduction–enhanced search strategy is developed. Inspired by heat transfer principles, this strategy leverages global population information through the combined guidance of the population means and the global best solution, thereby improving local search directionality and convergence stability. Third, an elite-guided Lévy flight and quadratic interpolation fusion strategy is incorporated to strengthen global exploration and fine-grained local exploitation. Elite individuals guide long-range Lévy flights to avoid premature convergence, while quadratic interpolation refines solutions around high-quality regions to improve optimization precision. The performance of the proposed IESC is comprehensively evaluated on the CEC2017 benchmark suite, covering unimodal, multimodal, hybrid, and composite functions with multiple dimensional settings. Experimental results demonstrate that IESC consistently outperforms several state-of-the-art metaheuristic algorithms in terms of optimization accuracy, convergence speed, and robustness. Furthermore, IESC is applied to robot path planning, where a multi-objective model considering path length, smoothness, and feasibility is constructed under collision-avoidance constraints. Simulation results show that the paths generated by IESC are shorter, smoother, and more stable than those produced by comparative algorithms. These findings indicate that the proposed IESC provides an effective and reliable optimization framework for robot path planning and other complex optimization problems.

More from our Archive