Knowledge Commons of Institute of Automation,CAS
Multi-modal Knowledge-aware Hierarchical Attention Network for Explainable Medical Question Answering | |
Yingying Zhang1,2; Shengsheng Qian1; Quan Fang1; Changsheng Xu1,2,3 | |
2019-10 | |
会议名称 | ACM international conference on Multimedia |
会议日期 | October 21 - 25, 2019 |
会议地点 | Nice, France |
摘要 | Online healthcare services can offer public ubiquitous access to the medical knowledge, especially with the emergence of medical question answering websites, where patients can get in touch with doctors without going to hospital. Explainability and accuracy are two main concerns for medical question answering. However, existing methods mainly focus on accuracy and cannot provide a good explanation for retrieved medical answers. This paper proposes a novel Multi-Modal Knowledge-aware Hierarchical Attention Network (MKHAN) to effectively exploit multi-modal knowledge graph (MKG) for explainable medical question answering. MKHAN can generate path representation by composing the structural, linguistics, and visual information of entities, and infer the underlying rationale of question-answer interactions by leveraging the sequential dependencies within a path from MKG. Furthermore, a novel hierarchical attention network is proposed to discriminate the salience of paths endowing our model with explainability. We build a large-scale multi-modal medical knowledge graph and two real-world medical question answering datasets, the experimental results demonstrate the superior performance on our approach compared with the state-of-the-art methods. |
收录类别 | EI |
语种 | 英语 |
七大方向——子方向分类 | 多模态智能 |
文献类型 | 会议论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/25841 |
专题 | 多模态人工智能系统全国重点实验室_多媒体计算 |
作者单位 | 1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences 2.University of Chinese Academy of Sciences 3.Peng Cheng Laboratory |
第一作者单位 | 模式识别国家重点实验室 |
推荐引用方式 GB/T 7714 | Yingying Zhang,Shengsheng Qian,Quan Fang,et al. Multi-modal Knowledge-aware Hierarchical Attention Network for Explainable Medical Question Answering[C],2019. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Multi-modal Knowledg(4568KB) | 会议论文 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论