Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot

doi:10.1109/JAS.2020.1003234

CASIA OpenIR > 学术期刊 > IEEE/CAA Journal of Automatica Sinica

	Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot
	Liang Yang; Bing Li; Wei Li; Howard Brand; Biao Jiang; Jizhong Xiao
发表期刊	IEEE/CAA Journal of Automatica Sinica
ISSN	2329-9266
	2020
卷号	7 期号:4 页码:991-1002
摘要	The concrete aging problem has gained more attention in recent years as more bridges and tunnels in the United States lack proper maintenance. Though the Federal Highway Administration requires these public concrete structures to be inspected regularly, on-site manual inspection by human operators is time-consuming and labor-intensive. Conventional inspection approaches for concrete inspection, using RGB image-based thresholding methods, are not able to determine metric information as well as accurate location information for assessed defects for conditions. To address this challenge, we propose a deep neural network (DNN) based concrete inspection system using a quadrotor flying robot (referred to as CityFlyer) mounted with an RGB-D camera. The inspection system introduces several novel modules. Firstly, a visual-inertial fusion approach is introduced to perform camera and robot positioning and structure 3D metric reconstruction. The reconstructed map is used to retrieve the location and metric information of the defects. Secondly, we introduce a DNN model, namely AdaNet, to detect concrete spalling and cracking, with the capability of maintaining robustness under various distances between the camera and concrete surface. In order to train the model, we craft a new dataset, i.e., the concrete structure spalling and cracking (CSSC) dataset, which is released publicly to the research community. Finally, we introduce a 3D semantic mapping method using the annotated framework to reconstruct the concrete structure for visualization. We performed comparative studies and demonstrated that our AdaNet can achieve 8.41% higher detection accuracy than ResNets and VGGs. Moreover, we conducted five field tests, of which three are manual hand-held tests and two are drone-based field tests. These results indicate that our system is capable of performing metric field inspection, and can serve as an effective tool for civil engineers.
关键词	3D reconstruction concrete inspection deep neural network quadrotor flying robot visual-inertial fusion
DOI	10.1109/JAS.2020.1003234
引用统计	被引频次：45[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/43007
专题	学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式 GB/T 7714	Liang Yang,Bing Li,Wei Li,et al. Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot[J]. IEEE/CAA Journal of Automatica Sinica,2020,7(4):991-1002.
APA	Liang Yang,Bing Li,Wei Li,Howard Brand,Biao Jiang,&Jizhong Xiao.(2020).Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot.IEEE/CAA Journal of Automatica Sinica,7(4),991-1002.
MLA	Liang Yang,et al."Concrete Defects Inspection and 3D Mapping Using CityFlyer Quadrotor Robot".IEEE/CAA Journal of Automatica Sinica 7.4(2020):991-1002.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
JAS-2019-0450.pdf（59427KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载