Cognitive-Based Crack Detection for Road Maintenance: An Integrated System in Cyber-Physical-Social Systems

doi:10.1109/TSMC.2022.3227209

	Cognitive-Based Crack Detection for Road Maintenance: An Integrated System in Cyber-Physical-Social Systems
	Fan, Lili 1; Cao, Dongpu 2; Zeng, Changxian 3; Li, Bai 4; Li, Yunjie 1; Wang, Fei-Yue5
发表期刊	IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS
ISSN	2168-2216
	2023-06-01
卷号	53 期号:6 页码:3485-3500
通讯作者	Cao, Dongpu(dpcao2016@163.com)
摘要	Effective road maintenance can not only achieve a balance between limited resources and long-term high-efficiency performance of road but also reduce the loss of life and property caused by road damage to vehicles and pedestrians. Due to the lack of a multidimensional dynamic monitoring system and enough extremely special data, the existing road maintenance system cannot accurately assess the road surface condition and provide timely early warning of sudden road damage. In this article, the M-RM system is proposed, that is, a metaverse-enabled road maintenance system based on cyber-physical-social systems (CPSSs), which fully utilizes the social and artificial system information of CPSS, as well as the simulation, monitoring, diagnosis and prediction functions of road systems in the virtual world of the metaverse. Then, in the road damage detection of system model in the virtual world, for the virtual data of the core assets of the metaverse, we propose an adaptive and information-preserving data augmentation (AIDA) algorithm-based nonclassical receptive field suppression and enhancement, an algorithm developed from human visual cognition. This algorithm enables the generation of a large amount of scarce fidelity data and avoids the introduced noise from impairing the performance of nonaugmented data. Finally, a crack detection algorithm named pay attention twice (PAT) is proposed, which uses the generated virtual data for training, and achieves secondary attention to high-frequency targets by fusing frequency-division convolution and mixed-domain attention mechanism. The detection performance of small targets in uncertain environments is enhanced. The metaverse system built in the current research can not only be used for road maintenance but also empower the traffic metaverse by using the traffic flow prediction module embedded in the algorithm. Experimental results demonstrate that the proposed algorithm can be applied to the road damage detection task under different noise and weather conditions, and the performance outweighs other state-of-the-art algorithms.
关键词	Roads Maintenance engineering Metaverse Visualization Real-time systems Monitoring Safety Brain inspired crack detection data augmentation metaverse road maintenance visual cognition
DOI	10.1109/TSMC.2022.3227209
收录类别	SCI
语种	英语
资助项目	14th Five-Year Project of Ministry of Science and Technology of China[2021YFD2000304]
项目资助者	14th Five-Year Project of Ministry of Science and Technology of China
WOS研究方向	Automation & Control Systems ; Computer Science
WOS类目	Automation & Control Systems ; Computer Science, Cybernetics
WOS记录号	WOS:000992404400018
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：4[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/53369
专题	多模态人工智能系统全国重点实验室
通讯作者	Cao, Dongpu
作者单位	1.Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China 2.Tsinghua Univ, Sch Vehicle & Mobil, Beijing 116600, Peoples R China 3.Dalian Nationalities Univ, Sch Sci, Dalian 116600, Peoples R China 4.Hunan Univ, Coll Mech & Vehicle Engn, State Key Lab Adv Design & Mfg Vehicle Body, Changsha 410082, Peoples R China 5.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Fan, Lili,Cao, Dongpu,Zeng, Changxian,et al. Cognitive-Based Crack Detection for Road Maintenance: An Integrated System in Cyber-Physical-Social Systems[J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,2023,53(6):3485-3500.
APA	Fan, Lili,Cao, Dongpu,Zeng, Changxian,Li, Bai,Li, Yunjie,&Wang, Fei-Yue.(2023).Cognitive-Based Crack Detection for Road Maintenance: An Integrated System in Cyber-Physical-Social Systems.IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,53(6),3485-3500.
MLA	Fan, Lili,et al."Cognitive-Based Crack Detection for Road Maintenance: An Integrated System in Cyber-Physical-Social Systems".IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS 53.6(2023):3485-3500.