A New Parallel Intelligence Based Light Field Dataset for Depth Refinement and Scene Flow Estimation
Shen, Yu1,2; Liu, Yuhang1,2; Tian, Yonglin1; Liu, Zhongmin3; Wang, Feiyue1,4,5
Source PublicationSENSORS
2022-12-01
Volume22Issue:23Pages:15
Corresponding AuthorWang, Feiyue(feiyue.wang@ia.ac.cn)
AbstractComputer vision tasks, such as motion estimation, depth estimation, object detection, etc., are better suited to light field images with more structural information than traditional 2D monocular images. However, since costly data acquisition instruments are difficult to calibrate, it is always hard to obtain real-world scene light field images. The majority of the datasets for static light field images now available are modest in size and cannot be used in methods such as transformer to fully leverage local and global correlations. Additionally, studies on dynamic situations, such as object tracking and motion estimates based on 4D light field images, have been rare, and we anticipate a superior performance. In this paper, we firstly propose a new static light field dataset that contains up to 50 scenes and takes 8 to 10 perspectives for each scene, with the ground truth including disparities, depths, surface normals, segmentations, and object poses. This dataset is larger scaled compared to current mainstream datasets for depth estimation refinement, and we focus on indoor and some outdoor scenarios. Second, to generate additional optical flow ground truth that indicates 3D motion of objects in addition to the ground truth obtained in static scenes in order to calculate more precise pixel level motion estimation, we released a light field scene flow dataset with dense 3D motion ground truth of pixels, and each scene has 150 frames. Thirdly, by utilizing the DistgDisp and DistgASR, which decouple the angular and spatial domain of the light field, we perform disparity estimation and angular super-resolution to evaluate the performance of our light field dataset. The performance and potential of our dataset in disparity estimation and angular super-resolution have been demonstrated by experimental results.
Keywordlight field parallel intelligence disparity estimation scene flow digital twin virtual real interaction angular super-resolution
DOI10.3390/s22239483
WOS KeywordGEOMETRY
Indexed BySCI
Language英语
WOS Research AreaChemistry ; Engineering ; Instruments & Instrumentation
WOS SubjectChemistry, Analytical ; Engineering, Electrical & Electronic ; Instruments & Instrumentation
WOS IDWOS:000896415800001
PublisherMDPI
Citation statistics
Cited Times:3[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/50816
Collection多模态人工智能系统全国重点实验室_平行智能技术与系统团队
Corresponding AuthorWang, Feiyue
Affiliation1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
3.North Automat Control Technol Inst, Taiyuan 030006, Peoples R China
4.Macau Univ Sci & Technol, Macao Inst Syst Engn, Macau 999078, Peoples R China
5.Chinese Acad Sci, Inst Automat, Beijing Engn Res Ctr Intelligent Syst & Technol, Beijing 100190, Peoples R China
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Corresponding Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Shen, Yu,Liu, Yuhang,Tian, Yonglin,et al. A New Parallel Intelligence Based Light Field Dataset for Depth Refinement and Scene Flow Estimation[J]. SENSORS,2022,22(23):15.
APA Shen, Yu,Liu, Yuhang,Tian, Yonglin,Liu, Zhongmin,&Wang, Feiyue.(2022).A New Parallel Intelligence Based Light Field Dataset for Depth Refinement and Scene Flow Estimation.SENSORS,22(23),15.
MLA Shen, Yu,et al."A New Parallel Intelligence Based Light Field Dataset for Depth Refinement and Scene Flow Estimation".SENSORS 22.23(2022):15.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Shen, Yu]'s Articles
[Liu, Yuhang]'s Articles
[Tian, Yonglin]'s Articles
Baidu academic
Similar articles in Baidu academic
[Shen, Yu]'s Articles
[Liu, Yuhang]'s Articles
[Tian, Yonglin]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Shen, Yu]'s Articles
[Liu, Yuhang]'s Articles
[Tian, Yonglin]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.