CASIA OpenIR  > 模式识别国家重点实验室  > 模式分析与学习
Multi-Oriented and Multi-Lingual Scene Text Detection With Direct Regression
He, Wenhao1,2; Zhang, Xu-Yao1,2; Yin, Fei1,2; Liu, Cheng-Lin1,2,3
AbstractMulti-oriented and multi-lingual scene text detection plays an important role in computer vision area and is challenging due to the wide variety of text and background. In this paper, first, we point out the two key tasks when extending convolutional neural network (CNN)-based object detection frameworks to scene text detection. The first task is to localize the text region by a downsampled segmentation-based module, and the second task is to regress the boundaries of text region determined by the first task. Second, we propose a scene text detection framework based on fully convolutional network with a bi-task prediction module, in which one is a pixel-wise classification between the text and non-text and the other is pixel-wise regression to determine the vertex coordinates of quadrilateral text boundaries. Post-processing for word-level detection is based on non-maximum suppression, and for the line-level detection, we design a heuristic line segments grouping method to localize long text lines. We evaluated the proposed framework on various benchmarks, including multi-oriented and multi-lingual scene text data sets, and achieved the state-of-the-art performance on most of them. We also provide abundant ablation experiments to analyze several key factors in building high performance CNN-based scene text detection systems.
KeywordFully Convolutional Network Scene Text Detection Multi-oriented Multi-task
WOS HeadingsScience & Technology ; Technology
Indexed BySCI
Funding OrganizationNational Natural Science Foundation of China (NSFC)(61721004 ; NVIDIA NVAIL Program ; 61411136002 ; 61733007 ; 61633021)
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS IDWOS:000442340100005
Citation statistics
Cited Times:2[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Affiliation1.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
3.Chinese Acad Sci, Ctr Excellence Brain Sci & Intelligence Technol, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
He, Wenhao,Zhang, Xu-Yao,Yin, Fei,et al. Multi-Oriented and Multi-Lingual Scene Text Detection With Direct Regression[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2018,27(11):5406-5419.
APA He, Wenhao,Zhang, Xu-Yao,Yin, Fei,&Liu, Cheng-Lin.(2018).Multi-Oriented and Multi-Lingual Scene Text Detection With Direct Regression.IEEE TRANSACTIONS ON IMAGE PROCESSING,27(11),5406-5419.
MLA He, Wenhao,et al."Multi-Oriented and Multi-Lingual Scene Text Detection With Direct Regression".IEEE TRANSACTIONS ON IMAGE PROCESSING 27.11(2018):5406-5419.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[He, Wenhao]'s Articles
[Zhang, Xu-Yao]'s Articles
[Yin, Fei]'s Articles
Baidu academic
Similar articles in Baidu academic
[He, Wenhao]'s Articles
[Zhang, Xu-Yao]'s Articles
[Yin, Fei]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[He, Wenhao]'s Articles
[Zhang, Xu-Yao]'s Articles
[Yin, Fei]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.