<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="antoniak-mimno-2018-evaluating">
    <titleInfo>
        <title>Evaluating the Stability of Embedding-based Word Similarities</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Maria</namePart>
        <namePart type="family">Antoniak</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">David</namePart>
        <namePart type="family">Mimno</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2018</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <genre authority="bibutilsgt">journal article</genre>
    <relatedItem type="host">
        <titleInfo>
            <title>Transactions of the Association for Computational Linguistics</title>
        </titleInfo>
        <originInfo>
            <issuance>continuing</issuance>
            <publisher>MIT Press</publisher>
            <place>
                <placeTerm type="text">Cambridge, MA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">periodical</genre>
        <genre authority="bibutilsgt">academic journal</genre>
    </relatedItem>
    <abstract>Word embeddings are increasingly being used as a tool to study word associations in specific corpora. However, it is unclear whether such embeddings reflect enduring properties of language or if they are sensitive to inconsequential variations in the source documents. We find that nearest-neighbor distances are highly sensitive to small changes in the training corpus for a variety of algorithms. For all methods, including specific documents in the training set can result in substantial variations. We show that these effects are more prominent for smaller training corpora. We recommend that users never rely on single embedding models for distance calculations, but rather average over multiple bootstrap samples, especially for small corpora.</abstract>
    <identifier type="citekey">antoniak-mimno-2018-evaluating</identifier>
    <identifier type="doi">10.1162/tacl_a_00008</identifier>
    <location>
        <url>https://aclanthology.org/Q18-1008</url>
    </location>
    <part>
        <date>2018</date>
        <detail type="volume"><number>6</number></detail>
        <extent unit="page">
            <start>107</start>
            <end>119</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Journal Article
%T Evaluating the Stability of Embedding-based Word Similarities
%A Antoniak, Maria
%A Mimno, David
%J Transactions of the Association for Computational Linguistics
%D 2018
%V 6
%I MIT Press
%C Cambridge, MA
%F antoniak-mimno-2018-evaluating
%X Word embeddings are increasingly being used as a tool to study word associations in specific corpora. However, it is unclear whether such embeddings reflect enduring properties of language or if they are sensitive to inconsequential variations in the source documents. We find that nearest-neighbor distances are highly sensitive to small changes in the training corpus for a variety of algorithms. For all methods, including specific documents in the training set can result in substantial variations. We show that these effects are more prominent for smaller training corpora. We recommend that users never rely on single embedding models for distance calculations, but rather average over multiple bootstrap samples, especially for small corpora.
%R 10.1162/tacl_a_00008
%U https://aclanthology.org/Q18-1008
%U https://doi.org/10.1162/tacl_a_00008
%P 107-119

Markdown (Informal)

[Evaluating the Stability of Embedding-based Word Similarities](https://aclanthology.org/Q18-1008) (Antoniak & Mimno, TACL 2018)

• Evaluating the Stability of Embedding-based Word Similarities (Antoniak & Mimno, TACL 2018)

ACL

• Maria Antoniak and David Mimno. 2018. Evaluating the Stability of Embedding-based Word Similarities. Transactions of the Association for Computational Linguistics, 6:107–119.