CASIA OpenIR  > 多媒体计算与图形学团队
Multi-modal Knowledge-aware Hierarchical Attention Network for Explainable Medical Question Answering
Yingying Zhang1,2; Shengsheng Qian1; Quan Fang1; Changsheng Xu1,2,3
2019-10
Conference NameACM international conference on Multimedia
Conference DateOctober 21 - 25, 2019
Conference PlaceNice, France
Abstract

Online healthcare services can offer public ubiquitous access to the medical knowledge, especially with the emergence of medical question answering websites, where patients can get in touch with doctors without going to hospital. Explainability and accuracy are two main concerns for medical question answering. However, existing methods mainly focus on accuracy and cannot provide a good explanation for retrieved medical answers. This paper proposes a novel Multi-Modal Knowledge-aware Hierarchical Attention Network (MKHAN) to effectively exploit multi-modal knowledge graph (MKG) for explainable medical question answering. MKHAN can generate path representation by composing the structural, linguistics, and visual information of entities, and infer the underlying rationale of question-answer interactions by leveraging the sequential dependencies within a path from MKG. Furthermore, a novel hierarchical attention network is proposed to discriminate the salience of paths endowing our model with explainability. We build a large-scale multi-modal medical knowledge graph and two real-world medical question answering datasets, the experimental results demonstrate the superior performance on our approach compared with the state-of-the-art methods.

Indexed ByEI
Language英语
Document Type会议论文
Identifierhttp://ir.ia.ac.cn/handle/173211/25841
Collection多媒体计算与图形学团队
Affiliation1.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
2.University of Chinese Academy of Sciences
3.Peng Cheng Laboratory
First Author AffilicationChinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
Recommended Citation
GB/T 7714
Yingying Zhang,Shengsheng Qian,Quan Fang,et al. Multi-modal Knowledge-aware Hierarchical Attention Network for Explainable Medical Question Answering[C],2019.
Files in This Item: Download All
File Name/Size DocType Version Access License
Multi-modal Knowledg(4568KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Yingying Zhang]'s Articles
[Shengsheng Qian]'s Articles
[Quan Fang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Yingying Zhang]'s Articles
[Shengsheng Qian]'s Articles
[Quan Fang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Yingying Zhang]'s Articles
[Shengsheng Qian]'s Articles
[Quan Fang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Multi-modal Knowledge-aware Hierarchical Attention Network for Explainable Medical Question Answering.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.