CASIA OpenIR  > 个人空间
On the role of sparsity in feature selection and an innovative method LRMI
Yuchun Fang; Qiulong Yuan; Zhaoxiang Zhang
Source PublicationNeurocomputing
2018
Issue321Pages:237-250
Abstract

Feature selection is used in many applications in machine learning and bioinformatics. As a popular approach, feature selection can be implemented in the filter-manner based on the sparse solution of the l1 regularization. Most study of the l1 regularization concentrates on investigating the iteration solution of the problem or focuses on adapting sparsity to different applications. It is necessary to explore more deeply about how the sparsity learned with the l1 regularization contributes to feature selection. In this paper, we make an effort to analyze the role of the l1 regularization in feature selection from the perspective of information theory. We discover that the l1 regularization contributes to minimizing the redundancy in feature selection. To avoid the complex computation of the l1 optimization, we propose a novel feature selection algorithm, i.e. the Laplacian regularization based on mutual information (LRMI), which realizes the minimization of the redundancy in a new way, and incorporates the l2 norm to achieve automatic grouping. Extensive experimental results demonstrate the superiority of LRMI over several traditional l1 regularization based feature selection algorithms with less time consumption.

KeywordFeature Selection L1 Regularization Information Theory Mutual Information
Language英语
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/23226
Collection个人空间
Recommended Citation
GB/T 7714
Yuchun Fang,Qiulong Yuan,Zhaoxiang Zhang. On the role of sparsity in feature selection and an innovative method LRMI[J]. Neurocomputing,2018(321):237-250.
APA Yuchun Fang,Qiulong Yuan,&Zhaoxiang Zhang.(2018).On the role of sparsity in feature selection and an innovative method LRMI.Neurocomputing(321),237-250.
MLA Yuchun Fang,et al."On the role of sparsity in feature selection and an innovative method LRMI".Neurocomputing .321(2018):237-250.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yuchun Fang]'s Articles
[Qiulong Yuan]'s Articles
[Zhaoxiang Zhang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yuchun Fang]'s Articles
[Qiulong Yuan]'s Articles
[Zhaoxiang Zhang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yuchun Fang]'s Articles
[Qiulong Yuan]'s Articles
[Zhaoxiang Zhang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.