Knowledge Commons of Institute of Automation,CAS
Maxi-Min discriminant analysis via online learning | |
Xu, Bo; Huang, Kaizhu; Liu, Cheng-Lin | |
发表期刊 | NEURAL NETWORKS |
2012-10-01 | |
卷号 | 34页码:56-64 |
文章类型 | Article |
摘要 | Linear Discriminant Analysis (LDA) is an important dimensionality reduction algorithm, but its performance is usually limited on multi-class data. Such limitation is incurred by the fact that LDA actually maximizes the average divergence among classes, whereby similar classes with smaller divergence tend to be merged in the subspace. To address this problem, we propose a novel dimensionality reduction method called Maxi-Min Discriminant Analysis (MMDA). In contrast to the traditional LDA, MMDA attempts to find a low-dimensional subspace by maximizing the minimal (worst-case) divergence among classes. This "minimal" setting overcomes the problem of LDA that tends to merge similar classes with smaller divergence when used for multi-class data. We formulate MMDA as a convex problem and further as a large-margin learning problem. One key contribution is that we design an efficient online learning algorithm to solve the involved problem, making the proposed method applicable to large scale data. Experimental results on various datasets demonstrate the efficiency and the efficacy of our proposed method against five other competitive approaches, and the scalability to the data with thousands of classes. (C) 2012 Elsevier Ltd. All rights reserved. |
关键词 | Linear Discriminant Analysis Dimensionality Reduction Multi-category Classification Handwritten Chinese Character Recognition |
WOS标题词 | Science & Technology ; Technology ; Life Sciences & Biomedicine |
关键词[WOS] | CHINESE CHARACTER-RECOGNITION ; DIMENSIONALITY REDUCTION ; OPTIMIZATION |
收录类别 | SCI |
语种 | 英语 |
WOS研究方向 | Computer Science ; Neurosciences & Neurology |
WOS类目 | Computer Science, Artificial Intelligence ; Neurosciences |
WOS记录号 | WOS:000308842300007 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/3083 |
专题 | 多模态人工智能系统全国重点实验室_模式分析与学习 |
作者单位 | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
推荐引用方式 GB/T 7714 | Xu, Bo,Huang, Kaizhu,Liu, Cheng-Lin. Maxi-Min discriminant analysis via online learning[J]. NEURAL NETWORKS,2012,34:56-64. |
APA | Xu, Bo,Huang, Kaizhu,&Liu, Cheng-Lin.(2012).Maxi-Min discriminant analysis via online learning.NEURAL NETWORKS,34,56-64. |
MLA | Xu, Bo,et al."Maxi-Min discriminant analysis via online learning".NEURAL NETWORKS 34(2012):56-64. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Maxi-Min discriminan(889KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论