Automatic multi-image stitching for concrete bridge inspection by combining point and line features

Most of the current techniques for concrete bridge inspection are based on human visual interpretation, which often is dangerous and time-consuming. To address this problem, we introduce in this paper a newly developed vehicle-based robot inspection system that can automatically capture thousands of bottom surface images with a group of high-resolution industrial cameras, which are then stitched into a single composite image. However, traditional image stitching methods generally fail with large drift due to the great number (more than 2000) and sparse texture of linearly distributed images in sequence. Therefore, a novel image stitching method was developed for our robot inspection system, which combines both the 2D image point features and the 3D line features to reduce the drift. First, the bottom surface images are arranged into different strips based on their acquisition order and rough poses, and images in a single strip are divided into several groups. Then, the proposed image stitching method is performed in a bottom-up way, as follows: 1) the images within a single group initially are aligned via their point and line features; 2) the groups within a single strip are then stitched together via a homographic refinement procedure; 3) the strips are aligned into a single composite image that completely covers the bottom surface of the bridge; and 4) after all the stitching procedure are complete, a multi-band blending algorithm is applied to generate the mosaicked panorama as seamlessly as possible. The experimental results on a set of representative images acquired from the bottom surfaces of a real bridge demonstrate the capabilities and the limitations of the proposed approach.