What Analogies Reveal about Word Vectors and their Compositionality

Gregory Finley, Stephanie Farmer, Serguei Pakhomov


Abstract
Analogy completion via vector arithmetic has become a common means of demonstrating the compositionality of word embeddings. Previous work have shown that this strategy works more reliably for certain types of analogical word relationships than for others, but these studies have not offered a convincing account for why this is the case. We arrive at such an account through an experiment that targets a wide variety of analogy questions and defines a baseline condition to more accurately measure the efficacy of our system. We find that the most reliably solvable analogy categories involve either 1) the application of a morpheme with clear syntactic effects, 2) male–female alternations, or 3) named entities. These broader types do not pattern cleanly along a syntactic–semantic divide. We suggest instead that their commonality is distributional, in that the difference between the distributions of two words in any given pair encompasses a relatively small number of word types. Our study offers a needed explanation for why analogy tests succeed and fail where they do and provides nuanced insight into the relationship between word distributions and the theoretical linguistic domains of syntax and semantics.
Anthology ID:
S17-1001
Volume:
Proceedings of the 6th Joint Conference on Lexical and Computational Semantics (*SEM 2017)
Month:
August
Year:
2017
Address:
Vancouver, Canada
Editors:
Nancy Ide, Aurélie Herbelot, Lluís Màrquez
Venue:
*SEM
SIGs:
SIGLEX | SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–11
Language:
URL:
https://aclanthology.org/S17-1001
DOI:
10.18653/v1/S17-1001
Bibkey:
Cite (ACL):
Gregory Finley, Stephanie Farmer, and Serguei Pakhomov. 2017. What Analogies Reveal about Word Vectors and their Compositionality. In Proceedings of the 6th Joint Conference on Lexical and Computational Semantics (*SEM 2017), pages 1–11, Vancouver, Canada. Association for Computational Linguistics.
Cite (Informal):
What Analogies Reveal about Word Vectors and their Compositionality (Finley et al., *SEM 2017)
Copy Citation:
PDF:
https://aclanthology.org/S17-1001.pdf