TY - JOUR
T1 - Towards accurate image stitching for drone-based wind turbine blade inspection
AU - Yang, Cong
AU - Liu, Xun
AU - Zhou, Hua
AU - Ke, Yan
AU - See, John
N1 - Funding Information:
This work was funded by the Research Fund of Horizon Robotics (Grant Number: KB1801ZW201609-03 ), the Natural Science Foundation of the Jiangsu Higher Education Institutions of China (Grant Number: 22KJB520008 ), the National Natural Science Foundation of China (Grant Number: 62073229 ), and Jiangsu Policy Guidance Program (International Science and Technology Cooperation) The Belt and Road Initiative Innovative Cooperation Projects (Grant Number: BZ2021016 ).
Publisher Copyright:
© 2022 The Author(s)
PY - 2023/2
Y1 - 2023/2
N2 - Accurate image stitching is crucial to wind turbine blade visualization and defect analysis. It is inevitable that drone-captured images for blade inspection are high resolution and heavily overlapped. This also necessitates the stitching-based deduplication process on detected defects. However, the stitching task suffers from texture-poor blade surfaces, unstable drone pose (especially off-shore), and the lack of public blade datasets that cater to real-world challenges. In this paper, we present a simple yet efficient algorithm for robust and accurate blade image stitching. To promote further research, we also introduce a new dataset, Blade30, which contains 1,302 real drone-captured images covering 30 full blades captured under various conditions (both on- and off-shore), accompanied by a rich set of annotations such as defects and contaminations, etc. The proposed stitching algorithm generates the initial blade panorama based on blade edges and drone-blade distances at the coarse-grained level, followed by fine-grained adjustments optimized by regression-based texture and shape losses. Our method also fully utilizes the properties of blade images and prior information of the drone. Experiments report promising accuracy in blade stitching and defect deduplication tasks in the vision-based wind turbine blade inspection scenario, surpassing the performance of existing methods.
AB - Accurate image stitching is crucial to wind turbine blade visualization and defect analysis. It is inevitable that drone-captured images for blade inspection are high resolution and heavily overlapped. This also necessitates the stitching-based deduplication process on detected defects. However, the stitching task suffers from texture-poor blade surfaces, unstable drone pose (especially off-shore), and the lack of public blade datasets that cater to real-world challenges. In this paper, we present a simple yet efficient algorithm for robust and accurate blade image stitching. To promote further research, we also introduce a new dataset, Blade30, which contains 1,302 real drone-captured images covering 30 full blades captured under various conditions (both on- and off-shore), accompanied by a rich set of annotations such as defects and contaminations, etc. The proposed stitching algorithm generates the initial blade panorama based on blade edges and drone-blade distances at the coarse-grained level, followed by fine-grained adjustments optimized by regression-based texture and shape losses. Our method also fully utilizes the properties of blade images and prior information of the drone. Experiments report promising accuracy in blade stitching and defect deduplication tasks in the vision-based wind turbine blade inspection scenario, surpassing the performance of existing methods.
KW - Blade inspection
KW - Defect analysis
KW - Image stitching
KW - Wind turbine
UR - http://www.scopus.com/inward/record.url?scp=85144488031&partnerID=8YFLogxK
U2 - 10.1016/j.renene.2022.12.063
DO - 10.1016/j.renene.2022.12.063
M3 - Article
SN - 0960-1481
VL - 203
SP - 267
EP - 279
JO - Renewable Energy
JF - Renewable Energy
ER -