DOI: 10.3390/s26165071 ISSN: 1424-8220

Real-Time Road Crack Detection on Smartphones Through ConvLSTM-Based Temporal Knowledge Distillation from a CNN-KAN and VMamba Dual-Path Network

Mengzhao Nie, Hua Huang, Mengxue Guo, Mingxia Dang, Ming Tang

Road crack images captured by smartphones suffer from low resolution, uneven illumination, and complex background interference. Mobile devices also have limited resources for real-time high-accuracy segmentation. A two-stage framework combines a high-accuracy dual-path teacher model with a knowledge-distilled lightweight student model. The teacher model integrates a CNN-KAN path for local texture extraction and a VMamba path for global context modeling at linear complexity. A dedicated KAN-based fusion module learns adaptive nonlinear mappings between the two feature streams. On public crack datasets, the teacher model achieves an mIoU of 0.8087 and an mDice of 0.9028. It is then transferred to a self-constructed smartphone dataset built from continuous 30 fps video, where it reaches an mIoU of 0.7084 with strong robustness to illumination and blur. A GAN-based super-resolution strategy further improves the mIoU by 4.01%. A ConvLSTM-based knowledge distillation framework compresses the teacher into a lightweight MobileViT student model. This reduces the parameter count from 57.80 M to 1.57 M and cuts the GPU inference time from 99.56 ms to 1.46 ms, while retaining an mIoU of 0.7078. The deployed student model runs at 15 to 20 frames per second on an Android smartphone. An ablation study confirms that the ConvLSTM-based temporal distillation contributes beyond standard distillation. This framework provides a practical solution for real-time road crack monitoring on smartphones.

More from our Archive