DOI: 10.3390/s26196232 ISSN: 1424-8220

Structure-Constrained RGB-D Joint Estimation of Robot Pose and 3D Damage Location in Weakly Textured Pipelines

Shaoyi Hu, Saiful Bahri Mohamed, Bing Li

Weakly textured closed pipelines—including energy and buried drainage conduits—require timely inspection of cracks, corrosion, joints and related defects. Weak illumination, sparse texture and repetitive cylindrical geometry degrade visual odometry and RGB-D SLAM, especially along the pipe axis, while image-level detectors rarely provide the axial distance, circumferential angle and pipe-frame 3D coordinates needed for maintenance. This paper presents the Structure-Constrained Pipe Joint Estimator (SC-PipeJE), an RGB-D framework that jointly estimates robot poses and 3D damage locations under weak texture. SC-PipeJE improves YOLOv8-seg for structural landmarks and damage masks, fits cylinders and centerlines from local point clouds, and optimizes a sliding window that couples RGB-D odometry with continuous geometric residuals, discrete landmarks and multi-frame damage factors so that damage observations also refine pose. On a primary RGB-D corpus of 5468 annotated frames and multi-structure sequences, the detector reaches mAP@0.5:0.95 of 0.7194 and Mask AP of 0.6980. Absolute trajectory error is 0.0343 m (67.6% lower than RTAB-Map under the same RGB-D protocol), and multi-frame damage localization yields 32.88 mm mean 3D error (46.6% lower than single-frame back-projection) at about 20 FPS. Quantitative pose and 3D damage results are reported on the laboratory RGB-D Corpus A; a complementary CCTV subset (Corpus B) is used only for qualitative appearance stress checks and is not mixed into the quantitative protocol. Ablation and robustness studies show that continuous geometry, discrete landmarks and multi-frame damage factors provide complementary observability when appearance cues are unreliable.