CASIA OpenIR  > 模式识别国家重点实验室  > 多媒体计算与图形学
Self-Paced Learning: An Implicit Regularization Perspective
Yanbo Fan1,4; Ran He1,2,3,4; Jian Liang1,2,4; Baogang Hu1,4
2017
Conference NameAmerican Association for AI National Conference(AAAI)
Conference Date2017
Conference PlaceSan Francisco, California USA
Abstract
Self-paced learning (SPL) mimics the cognitive mechanism of humans and animals that gradually learns from easy to hard samples. One key issue in SPL is to obtain better weighting strategy that is determined by the minimizer function. Existing
methods usually pursue this by artificially designing the explicit form of SPL regularizer. In this paper, we study a group of new regularizer (named self-paced implicit regularizer)
that is deduced from robust loss function. Based on the convex conjugacy theory, the minimizer function for selfpaced implicit regularizer can be directly learned from the
latent loss function, while the analytic form of the regularizer can be even unknown. A general framework (named SPL-IR) for SPL is developed accordingly. We demonstrate that the learning procedure of SPL-IR is associated with latent robust loss functions, thus can provide some theoretical insights for its working mechanism. We further analyze the relation between SPL-IR and half-quadratic optimization and provide a group of self-paced implicit regularizer. Finally, we implement SPL-IR to both supervised and unsupervised asks, and experimental results corroborate our ideas and demonstrate the correctness and effectiveness of implicit regularizers.
Indexed ByEI
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/19999
Collection模式识别国家重点实验室_多媒体计算与图形学
Affiliation1.National Laboratory of Pattern Recognition, CASIA
2.Center for Research on Intelligent Perception and Computing, CASIA
3.Center for Excellence in Brain Science and Intelligence Technology, CAS
4.University of Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Yanbo Fan,Ran He,Jian Liang,et al. Self-Paced Learning: An Implicit Regularization Perspective[C],2017.
Files in This Item: Download All
File Name/Size DocType Version Access License
Self-Paced Learning-(890KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yanbo Fan]'s Articles
[Ran He]'s Articles
[Jian Liang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yanbo Fan]'s Articles
[Ran He]'s Articles
[Jian Liang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yanbo Fan]'s Articles
[Ran He]'s Articles
[Jian Liang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Self-Paced Learning- an Implicit Regularization Perspective.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.