VecShare: A Framework for Sharing Word Representation Vectors

Jared Fernandez, Zhaocheng Yu, Doug Downey


Abstract
Many Natural Language Processing (NLP) models rely on distributed vector representations of words. Because the process of training word vectors can require large amounts of data and computation, NLP researchers and practitioners often utilize pre-trained embeddings downloaded from the Web. However, finding the best embeddings for a given task is difficult, and can be computationally prohibitive. We present a framework, called VecShare, that makes it easy to share and retrieve word embeddings on the Web. The framework leverages a public data-sharing infrastructure to host embedding sets, and provides automated mechanisms for retrieving the embeddings most similar to a given corpus. We perform an experimental evaluation of VecShare’s similarity strategies, and show that they are effective at efficiently retrieving embeddings that boost accuracy in a document classification task. Finally, we provide an open-source Python library for using the VecShare framework.
Anthology ID:
D17-1032
Volume:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Martha Palmer, Rebecca Hwa, Sebastian Riedel
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
316–320
Language:
URL:
https://aclanthology.org/D17-1032
DOI:
10.18653/v1/D17-1032
Bibkey:
Cite (ACL):
Jared Fernandez, Zhaocheng Yu, and Doug Downey. 2017. VecShare: A Framework for Sharing Word Representation Vectors. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 316–320, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
VecShare: A Framework for Sharing Word Representation Vectors (Fernandez et al., EMNLP 2017)
Copy Citation:
PDF:
https://aclanthology.org/D17-1032.pdf