KBGAN: Adversarial Learning for Knowledge Graph Embeddings

Liwei Cai, William Yang Wang


Abstract
We introduce KBGAN, an adversarial learning framework to improve the performances of a wide range of existing knowledge graph embedding models. Because knowledge graphs typically only contain positive facts, sampling useful negative training examples is a nontrivial task. Replacing the head or tail entity of a fact with a uniformly randomly selected entity is a conventional method for generating negative facts, but the majority of the generated negative facts can be easily discriminated from positive facts, and will contribute little towards the training. Inspired by generative adversarial networks (GANs), we use one knowledge graph embedding model as a negative sample generator to assist the training of our desired model, which acts as the discriminator in GANs. This framework is independent of the concrete form of generator and discriminator, and therefore can utilize a wide variety of knowledge graph embedding models as its building blocks. In experiments, we adversarially train two translation-based models, TRANSE and TRANSD, each with assistance from one of the two probability-based models, DISTMULT and COMPLEX. We evaluate the performances of KBGAN on the link prediction task, using three knowledge base completion datasets: FB15k-237, WN18 and WN18RR. Experimental results show that adversarial training substantially improves the performances of target embedding models under various settings.
Anthology ID:
N18-1133
Volume:
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marilyn Walker, Heng Ji, Amanda Stent
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1470–1480
Language:
URL:
https://aclanthology.org/N18-1133
DOI:
10.18653/v1/N18-1133
Bibkey:
Cite (ACL):
Liwei Cai and William Yang Wang. 2018. KBGAN: Adversarial Learning for Knowledge Graph Embeddings. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 1470–1480, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
KBGAN: Adversarial Learning for Knowledge Graph Embeddings (Cai & Wang, NAACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/N18-1133.pdf
Note:
 N18-1133.Notes.pdf
Video:
 https://aclanthology.org/N18-1133.mp4
Code
 cai-lw/KBGAN +  additional community code
Data
FB15kFB15k-237WN18WN18RR