CASIA OpenIR  > 模式识别国家重点实验室  > 机器人视觉
Fine-level semantic labeling of large-scale 3d model by active learning
Zhou Y(周洋)1,2; Shen SH(申抒含)1,2; Hu ZY(胡占义)1,2
2018-09
Conference NameInternational Conference on 3D Vision 2018
Conference Date2018-9-5~8
Conference PlaceVerona, Italy
Abstract

Semantic labeling of 3D models has been a challenging task in recent years. Due to the various categories and shapes of 3D objects in different scenes, it is hard to develop a versatile method suitable for most scenes. In this paper, we propose an Active Learning based method to tackle the problem. The proposed method takes a 3D mesh model generated from images using SfM and MVS, as well as the calibrated images, as the input, and outputs a semantic meshmodel in which each facet takes a fine-level semantic label. Starting with a small annotated image set, we progressively fine-tune a Convolutional Neural Network (CNN) with the ever-enlarging annotated image set for image semantic segmentation. In each iteration, by back-projecting the pixel labels to the 3D model and fusing them in 3D space, a semantic 3D model is generated. The semantic 3D model functions as a supervisor to select a batch of worthy images for annotation to boost the performance of the CNN in next iteration. This process iterates until the label assignment of the 3D model becomes steady. By making full use of the 3D geometric information, the proposed method could significantly reduce the annotation cost without losing the labeling quality of 3D models. Experimental results of fine-level labeling on two large-scale ancient Chinese architectures demonstrate the effectiveness of the proposed method.

KeywordSemantic Labeling Active Learning Large Scale
Indexed ByEI
Language英语
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/23568
Collection模式识别国家重点实验室_机器人视觉
Corresponding AuthorShen SH(申抒含)
Affiliation1.中国科学院自动化研究所
2.中国科学院大学
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Corresponding Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Zhou Y,Shen SH,Hu ZY. Fine-level semantic labeling of large-scale 3d model by active learning[C],2018.
Files in This Item: Download All
File Name/Size DocType Version Access License
0032.pdf(5390KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhou Y(周洋)]'s Articles
[Shen SH(申抒含)]'s Articles
[Hu ZY(胡占义)]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhou Y(周洋)]'s Articles
[Shen SH(申抒含)]'s Articles
[Hu ZY(胡占义)]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhou Y(周洋)]'s Articles
[Shen SH(申抒含)]'s Articles
[Hu ZY(胡占义)]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 0032.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.