UNIT: A unified metric learning framework based on maximum entropy regularization | |
Deng, Huiyuan1; Meng, Xiangzhu2; Deng, Fengxia3; Feng, Lin1 | |
发表期刊 | APPLIED INTELLIGENCE |
ISSN | 0924-669X |
2023-07-26 | |
页码 | 21 |
通讯作者 | Feng, Lin(fenglin@dlut.edu.cn) |
摘要 | Metric learning has emerged as a critical tool for analyzing the semantic similarities between objects. However, numerous existing methods are incapable of simultaneously maximizing the proximity of similar pairs and the separability between dissimilar ones to achieve the largest margin principle. Additionally, most graph Laplacian-based semi-supervised approaches fail to consider the valuable dissimilar information of unlabeled data, and they treat neighborhood graph construction and metric learning as separate procedures, thereby breaking the unified relationship between these two components. To overcome these challenges, this paper proposes a scalable and efficient metric learning framework called Unified metric learNing based on maxIum enTropy (UNIT). UNIT attempts to unify supervised and semi-supervised metric learning into a framework by introducing the maximum entropy regularizer of the eigenvalues of the learned matrix. With the novel regularizer, UNIT can maximize the closeness of similar instances and the separability of dissimilar ones without encountering the trivial solution problem. Furthermore, the adaptive graph Laplacian, formulated by a similar graph as well as a dissimilar graph, is constructed to mine the rich discriminant information of the unlabeled data. We demonstrate that UNIT can be solved efficiently with the alternating direction method, with each sub-problem being solvable using a closed-form solution. To account for nonlinear data distribution, a kernelized version of UNIT is also provided. The effectiveness of the proposed methods is validated through extensive supervised and semi-supervised experiments on various datasets. |
关键词 | Metric learning Kernel learning Nearest-neighbors classification Semi-supervised learning Maximum entropy principle |
DOI | 10.1007/s10489-023-04831-x |
关键词[WOS] | EIGENVALUE |
收录类别 | SCI |
语种 | 英语 |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Artificial Intelligence |
WOS记录号 | WOS:001037138200002 |
出版者 | SPRINGER |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/53820 |
专题 | 模式识别实验室 |
通讯作者 | Feng, Lin |
作者单位 | 1.Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China 2.Chinese Acad Sci, Inst Automat, Ctr Res Intelligent Percept & Comp, Beijing 100190, Peoples R China 3.Harbin Inst Technol, State Key Lab Urban Water Resources & Environm, Harbin 150090, Peoples R China |
推荐引用方式 GB/T 7714 | Deng, Huiyuan,Meng, Xiangzhu,Deng, Fengxia,et al. UNIT: A unified metric learning framework based on maximum entropy regularization[J]. APPLIED INTELLIGENCE,2023:21. |
APA | Deng, Huiyuan,Meng, Xiangzhu,Deng, Fengxia,&Feng, Lin.(2023).UNIT: A unified metric learning framework based on maximum entropy regularization.APPLIED INTELLIGENCE,21. |
MLA | Deng, Huiyuan,et al."UNIT: A unified metric learning framework based on maximum entropy regularization".APPLIED INTELLIGENCE (2023):21. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论