Multimodal Data Enhanced Representation Learning for Knowledge Graphs
Wang, Zikang1,2; Li, Linjing1; Li, Qiudan1; Zeng, Dajun1,2
Conference NameThe 2019 International Joint Conference on Neural Networks (IJCNN)
Conference Date2019.7.14-19
Conference PlaceBudapest, Hungary

Knowledge graph, or knowledge base, plays an
important role in a variety of applications in the field of artificial
intelligence. In both research and application of knowledge
graph, knowledge representation learning is one of the fundamen-
tal tasks. Existing representation learning approaches are mainly
based on structural knowledge between entities and relations,
while knowledge among entities per se is largely ignored. Though
a few approaches integrated entity knowledge while learning
representations, these methods lack the flexibility to apply to
multimodalities. To tackle this problem, in this paper, we propose
a new representation learning method, TransAE, by combining
multimodal autoencoder with TransE model, where TransE
is a simple and effective representation learning method for
knowledge graphs. In TransAE, the hidden layer of autoencoder
is used as the representation of entities in the TransE model,
thus it encodes not only the structural knowledge, but also the
multimodal knowledge, such as visual and textural knowledge,
into the final representation. Compared with traditional methods
based on only structural knowledge, TransAE can significantly
improve the performance in the sense of link prediction and
triplet classification. Also, TransAE has the ability to learn
representations for entities out of knowledge base in zero-shot.
Experiments on various tasks demonstrate the effectiveness of
our proposed TransAE method.

Keywordrepresentation learning, knowledge graph, mul- timodal
Indexed ByEI
Sub direction classification知识表示与推理
Document Type会议论文
Affiliation1.The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
2.School of Computer and Control Engineering, University of Chinese Academy of Sciences, Beijing, China
First Author AffilicationInstitute of Automation, Chinese Academy of Sciences
Recommended Citation
GB/T 7714
Wang, Zikang,Li, Linjing,Li, Qiudan,et al. Multimodal Data Enhanced Representation Learning for Knowledge Graphs[C]:IEEE,2019.
Files in This Item: Download All
File Name/Size DocType Version Access License
Zikang.pdf(3954KB)会议论文 开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang, Zikang]'s Articles
[Li, Linjing]'s Articles
[Li, Qiudan]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang, Zikang]'s Articles
[Li, Linjing]'s Articles
[Li, Qiudan]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang, Zikang]'s Articles
[Li, Linjing]'s Articles
[Li, Qiudan]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: Zikang.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.