Learning attention-based embeddings for relation prediction in knowledge graphs

Nathani, Deepak and Chauhan, J. and Sharma, C. and Kaul, M (2020) Learning attention-based embeddings for relation prediction in knowledge graphs. In: ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, 28 July 2019 - 2 August 2019, Florence.

Text
Learning_attention_based_embeddings.pdf - Published Version
Available under License Creative Commons Attribution.
Download (1MB)

Abstract

The recent proliferation of knowledge graphs (KGs) coupled with incomplete or partial information, in the form of missing relations (links) between entities, has fueled a lot of research on knowledge base completion (also known as relation prediction). Several recent works suggest that convolutional neural network (CNN) based models generate richer and more expressive feature embeddings and hence also perform well on relation prediction. However, we observe that these KG embeddings treat triples independently and thus fail to cover the complex and hidden information that is inherently implicit in the local neighborhood surrounding a triple. To this effect, our paper proposes a novel attention-based feature embedding that captures both entity and relation features in any given entity's neighborhood. Additionally, we also encapsulate relation clusters and multi-hop relations in our model. Our empirical study offers insights into the efficacy of our attention-based model and we show marked performance gains in comparison to state-of-the-art methods on all datasets.

[error in script]

IITH Creators:

IITH Creators	ORCiD
Kaul, M	https://orcid.org/0000-0003-1871-1620

Item Type:

Conference or Workshop Item (Paper)

Additional Information:

We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research.

Uncontrolled Keywords:

Empirical studies; Feature embedding; Hidden information; Knowledge graphs; Local neighborhoods; Partial information; Performance Gain; State-of-the-art methods

Subjects:

Computer science

Divisions:

Department of Computer Science & Engineering

Depositing User:

. LibTrainee 2021

Date Deposited:

11 Aug 2021 05:24

Last Modified:

24 Nov 2022 11:10

URI:

http://raiithold.iith.ac.in/id/eprint/8794