Knowledge Commons of Institute of Automation,CAS
A Residual Merged Neutral Network for Multimodal Sentiment Analysis | |
Xu, Nan1,2; Mao, Wenji1,2 | |
2017-03 | |
会议名称 | The 2017 IEEE 2nd International Conference on Big Data Analysis |
会议日期 | March 10-12, 2017 |
会议地点 | Beijing, China |
摘要 | With the continuous development of social networking sites, the volume of social media data has exploded and the user-generated content is becoming more and more diverse. As a result, the modality of massive social media data is no longer confined to the single text mode. This brings new challenges to social media analytics in general and its examplar field such as sentiment analysis in particular. Multimodal sentiment analysis has become an increasingly important research topic in recent years, especially in the context of social media big data. Most of the previous work only focuses on single modality content such as text, image or speech. Moreover, as the traditional sentiment analysis methods often lack the support of scalable deep models, this hinders their usage in processing large amount of online data. To overcome the limitations in the previous work, in this paper, we propose an end-to-end framework for multimodal sentiment analysis based on deep neural network. We propose a Merged Neural Network (MNN) model that utilizes CNNs to extract representations of text and image respectively. To fuse the multimodal features, we introduce the residual model and propose two combined merged strategies, namely the Early-RMNN (i.e. Early Residual MNN) and Late-RMNN (i.e. Late Residual MNN), to get deeper and more discriminative features than the previous methods. The experiments on two public available datasets demonstrate the effectiveness of our models for multimodal sentiment analysis in comparison with the related methods. |
收录类别 | EI |
语种 | 英语 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/39147 |
专题 | 多模态人工智能系统全国重点实验室_互联网大数据与信息安全 |
通讯作者 | Xu, Nan |
作者单位 | 1.Institute of Automation, Chinese Academy of Sciences 2.University of Chinese Academy of Sciences |
第一作者单位 | 中国科学院自动化研究所 |
通讯作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Xu, Nan,Mao, Wenji. A Residual Merged Neutral Network for Multimodal Sentiment Analysis[C],2017. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
A Residual Merged Ne(311KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
个性服务 |
推荐该条目 |
保存到收藏夹 |
查看访问统计 |
导出为Endnote文件 |
谷歌学术 |
谷歌学术中相似的文章 |
[Xu, Nan]的文章 |
[Mao, Wenji]的文章 |
百度学术 |
百度学术中相似的文章 |
[Xu, Nan]的文章 |
[Mao, Wenji]的文章 |
必应学术 |
必应学术中相似的文章 |
[Xu, Nan]的文章 |
[Mao, Wenji]的文章 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论