CASIA OpenIR  > 智能感知与计算研究中心
Unconstrained Multimodal Multi-Label Learning
Huang, Yan1; Wang, Wei1; Wang, Liang1,2
2015-11-01
发表期刊IEEE TRANSACTIONS ON MULTIMEDIA
卷号17期号:11页码:1923-1935
文章类型Article
摘要Multimodal learning has been mostly studied by assuming that multiple label assignments are independent of each other and all the modalities are available. In this paper, we consider a more general problem where the labels contain dependency relationships and some modalities are likely to be missing. To this end, we propose a multi-label conditional restricted Boltzmann machine (ML-CRBM), which handles modality completion, fusion, and multi-label prediction in a unified framework. The proposed model is able to generate missing modalities based on observed ones, by explicitly modelling and sampling their conditional distributions. After that, it can discriminatively fuse multiple modalities to obtain shared representations under the supervision of class labels. To consider the co-occurrence of the labels, the proposed model formulates the multi-label prediction as a max-margin-based multi-task learning problem. Model parameters can be jointly learned by seeking a balance between being generative for modality generation and being discriminative for label prediction. We perform a series of experiments in terms of classification, visualization, and retrieval, and the experimental results clearly demonstrate the effectiveness of our method.
关键词Multi-label Learning Multi-task Learning Multimodal Learning Restricted Boltzmann Machine
WOS标题词Science & Technology ; Technology
DOI10.1109/TMM.2015.2476658
关键词[WOS]NEURAL-NETWORKS ; REPRESENTATION ; COLOR
收录类别SCI
语种英语
项目资助者National Natural Science Foundation of China(61175003 ; National Basic Research Program of China(2012CB316300) ; 61202328 ; 61572504 ; 61420106015)
WOS研究方向Computer Science ; Telecommunications
WOS类目Computer Science, Information Systems ; Computer Science, Software Engineering ; Telecommunications
WOS记录号WOS:000364102400006
引用统计
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/10497
专题智能感知与计算研究中心
作者单位1.Chinese Acad Sci CASIA, Inst Automat, Natl Lab Pattern Recognit, Ctr Res Intelligent Percept & Comp, Beijing 100190, Peoples R China
2.CASIA, Inst Automat, CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing 100190, Peoples R China
推荐引用方式
GB/T 7714
Huang, Yan,Wang, Wei,Wang, Liang. Unconstrained Multimodal Multi-Label Learning[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2015,17(11):1923-1935.
APA Huang, Yan,Wang, Wei,&Wang, Liang.(2015).Unconstrained Multimodal Multi-Label Learning.IEEE TRANSACTIONS ON MULTIMEDIA,17(11),1923-1935.
MLA Huang, Yan,et al."Unconstrained Multimodal Multi-Label Learning".IEEE TRANSACTIONS ON MULTIMEDIA 17.11(2015):1923-1935.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
UMMLL.pdf(3011KB)期刊论文作者接受稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Huang, Yan]的文章
[Wang, Wei]的文章
[Wang, Liang]的文章
百度学术
百度学术中相似的文章
[Huang, Yan]的文章
[Wang, Wei]的文章
[Wang, Liang]的文章
必应学术
必应学术中相似的文章
[Huang, Yan]的文章
[Wang, Wei]的文章
[Wang, Liang]的文章
相关权益政策
暂无数据
收藏/分享
文件名: UMMLL.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。