<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="lagus-klami-2021-learning">
    <titleInfo>
        <title>Learning to Lemmatize in the Word Representation Space</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Jarkko</namePart>
        <namePart type="family">Lagus</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Arto</namePart>
        <namePart type="family">Klami</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-may 31–2 jun</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 23rd Nordic Conference on Computational Linguistics (NoDaLiDa)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Simon</namePart>
            <namePart type="family">Dobnik</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Lilja</namePart>
            <namePart type="family">Øvrelid</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Linköping University Electronic Press, Sweden</publisher>
            <place>
                <placeTerm type="text">Reykjavik, Iceland (Online)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Lemmatization is often used with morphologically rich languages to address issues caused by morphological complexity, performed by grammar-based lemmatizers. We propose an alternative for this, in form of a tool that performs lemmatization in the space of word embeddings. Word embeddings as distributed representations natively encode some information about the relationship between base and inflected forms, and we show that it is possible to learn a transformation that approximately maps the embeddings of inflected forms to the embeddings of the corresponding lemmas. This facilitates an alternative processing pipeline that replaces traditional lemmatization with the lemmatizing transformation in downstream processing for any application. We demonstrate the method in the Finnish language, outperforming traditional lemmatizers in example task of document similarity comparison, but the approach is language independent and can be trained for new languages with mild requirements.</abstract>
    <identifier type="citekey">lagus-klami-2021-learning</identifier>
    <location>
        <url>https://aclanthology.org/2021.nodalida-main.25</url>
    </location>
    <part>
        <date>2021-may 31–2 jun</date>
        <extent unit="page">
            <start>249</start>
            <end>258</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Learning to Lemmatize in the Word Representation Space
%A Lagus, Jarkko
%A Klami, Arto
%Y Dobnik, Simon
%Y Øvrelid, Lilja
%S Proceedings of the 23rd Nordic Conference on Computational Linguistics (NoDaLiDa)
%D 2021
%8 may 31–2 jun
%I Linköping University Electronic Press, Sweden
%C Reykjavik, Iceland (Online)
%F lagus-klami-2021-learning
%X Lemmatization is often used with morphologically rich languages to address issues caused by morphological complexity, performed by grammar-based lemmatizers. We propose an alternative for this, in form of a tool that performs lemmatization in the space of word embeddings. Word embeddings as distributed representations natively encode some information about the relationship between base and inflected forms, and we show that it is possible to learn a transformation that approximately maps the embeddings of inflected forms to the embeddings of the corresponding lemmas. This facilitates an alternative processing pipeline that replaces traditional lemmatization with the lemmatizing transformation in downstream processing for any application. We demonstrate the method in the Finnish language, outperforming traditional lemmatizers in example task of document similarity comparison, but the approach is language independent and can be trained for new languages with mild requirements.
%U https://aclanthology.org/2021.nodalida-main.25
%P 249-258

Markdown (Informal)

[Learning to Lemmatize in the Word Representation Space](https://aclanthology.org/2021.nodalida-main.25) (Lagus & Klami, NoDaLiDa 2021)

• Learning to Lemmatize in the Word Representation Space (Lagus & Klami, NoDaLiDa 2021)

ACL

• Jarkko Lagus and Arto Klami. 2021. Learning to Lemmatize in the Word Representation Space. In Proceedings of the 23rd Nordic Conference on Computational Linguistics (NoDaLiDa), pages 249–258, Reykjavik, Iceland (Online). Linköping University Electronic Press, Sweden.