DOI: 10.3390/s26134050 ISSN: 1424-8220

Real-Time Terrain Recognition for Quadruped Robots Using Proprioceptive Sensors and Temporal Convolutional Networks

Tzu-Hsiu Chang, Minyechil Alehegn Tefera, Jun-Ming Cheng, Tsung-Ming Fang, Chin-Sheng Chen, Chia-Jen Lin, Peng-Chun Peng, Chao-Ching Ho, Tzu-Hsuan Tsai, Cherng-Yuh Su, Shih-Hao Chang, Pai-Yen Chen, Hsiang-Wei Ho, Ching-Yuan Chang

In this article, we propose a novel real-time terrain recognition and slip estimation method for quadruped robots using proprioceptive sensors and temporal convolutional networks (TCNs). As quadruped robots are increasingly deployed in complex environments, accurate terrain understanding is crucial. External sensors can be affected by lighting variations, occlusion, reflective surfaces, and others. To overcome these challenges, we propose a proprioceptive sensing-based complementary perception module with a TCN, enabling reliable real-time terrain recognition while reducing dependence on external perception. The TCN model effectively captures temporal dependencies in sensor signals, enabling precise and robust detection. The framework is validated through extensive real-world experiments and deployed on an embedded edge computing platform for real-time operation. Results show that the proposed TCN method achieves 98.8% recognition accuracy, outperforming the baseline models compared in this study. In addition, this study analyzes how locomotion speed and environmental conditions affect slip in quadruped robots. These findings confirm that quadruped robots can not only recognize terrain types but also detect surface states, enabling safer and more adaptive locomotion. Therefore, the proposed system is a cost-effective, robust, and low-latency solution for real-time terrain recognition, providing a strong foundation for future deployment across more diverse terrains.

More from our Archive