Knowledge Commons of Institute of Automation,CAS
Hierarchical Graph Semantic Pooling Network for Multi-modal Community Question Answer Matching | |
Jun Hu1; Shengsheng Qian2,3; Quan Fang2,3; Changsheng Xu1,2,3,4 | |
2019-10 | |
会议名称 | ACM international conference on Multimedia |
会议日期 | October 21 - 25, 2019 |
会议地点 | Nice, France |
摘要 | Nowadays, community question answering (CQA) systems have attracted millions of users to share their valuable knowledge. Matching relevant answers for a specific question is a core function of CQA systems. Previous interaction-based matching approaches show promising performance in CQA systems. However, they typically suffer from two limitations: (1) They usually model content as word sequences, which ignores the semantics provided by nonconsecutive phrases, long-distance word dependency and visual information. (2) Word-level interactions focus on the distribution of similar words in terms of position, while being agnostic to the semantic-level interactions between questions and answers. To address these limitations, we propose a Hierarchical Graph Semantic Pooling Network (HGSPN) to model the hierarchical semantic-level interactions in a unified framework for multi-modal CQA matching. Instead of viewing text content as word sequences, we convert them into graphs, which can model non-consecutive phrases and long-distance word dependency for better obtaining the composition of semantics. In addition, visual content is also modeled into the graphs to provide complementary semantics. A well-designed stacked graph pooling network is proposed to capture the hierarchical semantic-level interactions between questions and answers based on these graphs. A novel convolutional matching network is designed to infer the matching score by integrating the hierarchical semantic-level interaction features. Experimental results on two real-world datasets demonstrate that our model outperforms the state-of-the-art CQA matching models. |
收录类别 | EI |
语种 | 英语 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/25837 |
专题 | 多模态人工智能系统全国重点实验室_多媒体计算 |
作者单位 | 1.Hefei University of Technology 2.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences 3.University of Chinese Academy of Sciences 4.Peng Cheng Laboratory |
推荐引用方式 GB/T 7714 | Jun Hu,Shengsheng Qian,Quan Fang,et al. Hierarchical Graph Semantic Pooling Network for Multi-modal Community Question Answer Matching[C],2019. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Hierarchical Graph S(1404KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论