Tristan Miller: migrated from https://www.ukp.tu-darmstadt.de/research/scientific-community/ukpedia/word-sense-disambiguation/

2014-12-12T11:42:57Z

migrated from https://www.ukp.tu-darmstadt.de/research/scientific-community/ukpedia/word-sense-disambiguation/

New page

[[Word sense disambiguation]] (WSD) is an open problem in natural language processing concerned with determining which sense (i.e., meaning) of a word is used in a particular context. This article provides provides links to important WSD-related publications, software, corpora, and other resources.

==Introductory material, overviews, and surveys==
* [http://en.wikipedia.org/wiki/Word_sense_disambiguation Word sense disambiguation] (Wikipedia)
* [http://www.scholarpedia.org/article/Word_sense_disambiguation Word sense disambiguation] (Scholarpedia)
* [http://aclweb.org/aclwiki/index.php?title=Word_sense_disambiguation Word sense disambiguation] (ACLWiki)
* Eneko Agirre and Philip Edmonds, editors. [http://www.wsdbook.org/ ''Word Sense Disambiguation: Algorithms and Applications''], volume 33 of Text, Speech, and Language Technology. Springer, 2006. ISBN 978-1-4020-6870-6.
* [http://www.d.umn.edu/%7Etpederse/WSDTutorial.html Advances in Word Sense Disambiguation tutorial] by Rada Mihalcea and Ted Pedersen (2005)
* Roberto Navigli. [http://dl.acm.org/citation.cfm?doid=1459352.1459355 Word sense disambiguation: A survey]. ''ACM Computing Surveys'', 41:10:1–10:69, February 2009. ISSN 0360-0300.
* Nancy Ide and Jean Véronis. [http://www.up.univ-mrs.fr/%7Everonis/pdf/1998wsd.pdf Introduction to the special issue on word sense disambiguation: The state of the art]. ''Computational Linguistics'', 24(1):1–40, 1998. ISSN 0891-2017.
* K. C. Litkowski. Computational lexicons and dictionaries. In Keith Brown, editor, ''Encyclopedia of Language and Linguistics'', pages 753–761. Elsevier Science, Oxford, second edition, 2005. ISBN 978-0-08-044299-0.
* Philip Edmonds. Lexical disambiguation. In Keith Brown, editor, ''Encyclopedia of Language and Linguistics'', pages 607–623. Elsevier Science, Oxford, second edition, 2005. ISBN 978-0-08-044299-0.
* David Jurafsky and James H. Martin. ''Speech and Language Processing'', chapter Computational Lexical Semantics. Prentice Hall, second edition, 2008. ISBN 978-0131873216.
* Christopher D. Manning and Hinrich Schütze. ''Foundations of Statistical Natural Language Processing'', chapter Word Sense Disambiguation, pages 229–264. The MIT Press, 1999. ISBN 978-0262133609.
* David Yarowsky. Word sense disambiguation. In Nitin Indurkhya and Fred J. Damerau, editors, ''Handbook of Natural Language Processing'', pages 315–338. Chapman and Hall/CRC, second edition, 2010. ISBN 978-1420085921.

==Conferences, workshops, and journals==
* [http://www.dcs.shef.ac.uk/research/ilash/iccl/ The International Committee on Computational Linguistics (ICCL)] and its conferences:
** [http://www.dcs.shef.ac.uk/research/ilash/iccl/ International Conference on Computational Linguistics (COLING)]
* [http://www.aclweb.org/ The Association for Computational Linguistics (ACL)] and its associated organizations, conferences, workshops, and special interest groups:
** [http://www.clres.com/siglex.html ACL SIGLEX], the umbrella organization for the [http://www.senseval.org/ Semeval and Senseval] evaluation exercises:
*** [http://www.itri.brighton.ac.uk/events/senseval/ARCHIVE/index.html Senseval-1] (1998)
*** [http://www.sle.sharp.co.uk/senseval2 Senseval-2] (2001)
*** [http://www.senseval.org/senseval3 Senseval-3] (2004)
*** [http://nlp.cs.swarthmore.edu/semeval Semeval-1] (2007)
*** [http://semeval2.fbk.eu/ Semeval-2] (2010)
*** [http://www.cs.york.ac.uk/semeval/ Semeval-3] (2013)
* [http://ixa2.si.ehu.es/clirwsd/ Robust WSD task] at the [http://clef-campaign.org/ Cross Language Evaluation Form (CLEF)]
* [http://www.mitpressjournals.org/loi/coli ''Computational Linguistics'']. MIT Press. ISSN 0891-2017.
** [http://www.aclweb.org/anthology-new/J/J98/ ''Computational Linguistics'', 24(1), 1998. Special issue on word sense disambiguation].
* [http://journals.cambridge.org/action/displayJournal?jid=NLE ''Natural Language Engineering'']. Cambridge University Press. ISSN 1351-3249.
**[http://journals.cambridge.org/action/displayIssue?decade=2000&jid=NLE&volumeId=8&issueId=04&iid=138358 ''Natural Language Engineering'', 8(4), 2002. Special issue on evaluating word sense disambiguation systems].

==Sense inventories and other lexical resources==
; [http://www.webdante.com/ DANTE]
: A lexical database for English
; [http://www.ibiblio.org/webster/ GCIDE_XML]
: The GNU version of the ''Collaborative International Dictionary of English'' (CIDE), presented in XML
; [http://www.itri.brighton.ac.uk/events/senseval/ARCHIVE/resources.html#lex HECTOR]
: A 35-word English dictionary used for Senseval-1
; ''Longman Dictionary of Contemporary English'' (LDOCE). Burnt Mill, Essex: Longman, 1978
: This proprietary dictionary saw considerable use by the WSD research community before less restrictively licensed resources became available.
; ''Roget's International Thesaurus''. New York: Harper Collins, 1992
: This proprietary thesaurus saw considerable use by the WSD research community before less restrictively licensed resources became available.
; [http://rogets.site.uottawa.ca/ The Open Roget's Project]
: A free implementation of the 1911 ''Roget's Thesaurus''.
===Wordnets and associated resources===
;[http://wordnet.princeton.edu/ WordNet]
: A lexical database for English
; [http://www.globalwordnet.org/gwa/wordnet_table.htm Wordnets in the world]
: A list of wordnets for various languages
; [http://xwn.hlt.utdallas.edu/ eXtended WordNet]
: A version of WordNet where the glosses are syntactically parsed, transformed into logic forms, and content words are semantically disambiguated
; [http://www.cse.unt.edu/%7Erada/downloads.html#wordnet Inter-version WordNet mappings]
: Mapping between synsets offsets in various WordNet versions
; [http://www.lsi.upc.edu/~nlp/meaning/downloads.html MCR]
: An integration of five local wordnets, the EuroWordNet Top Concept ontology, MultiWordNet Domains, and hundreds of thousands of new semantic relations and properties automatically acquired from corpora.

==Annotated corpora==
; [http://www.computing.dcu.ie/%7Easmeaton/SIGIR96-captions/ Alan Smeaton and Ian Quigley's image captions]
: 8816 WordNet 1.5-annotated instances of 2304 lemmas in 2714 image captions
; [http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC97T12 DSO Corpus of Sense-Tagged English]
: Sense-tagged word occurrences for 121 nouns and 70 verbs occurring in the Brown Corpus and ''Wall Street Journal'' corpus
; [http://www.itri.brighton.ac.uk/events/senseval/ARCHIVE/resources.html HECTOR (Senseval-1)]
: Separate training and test corpora with 35 word types annotated with their HECTOR senses. See also Ted Pedersen's conversions.
; interest
: ''Wall Street Journal'' articles with 2369 instances of "interest" annotated with their LDOCE senses. See Ted Pedersen's conversions.
; line, hard, serve
: ''Wall Street Journal'' articles with over 12,000 instances of "line", "hard", and "serve" tagged with a subset of their WordNet 1.5 senses. See Ted Pedersen's conversions.
; [http://www.cse.unt.edu/%7Erada/downloads.html#omwe Open Mind Word Expert sense-tagged data]
: Various data sets for English, Romanian, and Hindi
; [http://www.cse.unt.edu/%7Erada/downloads.html#sensevalsemcor Rada Mihalcea's Senseval-2 and Senseval-3 conversions into SemCor format]
: Senseval-2 and Senseval-3 English all-words data converted into SemCor format
; [http://www.cse.unt.edu/%7Erada/downloads.html#semcor SemCor]
: Brown Corpus texts annotated with WordNet 1.6 senses, and automatically mapped to WordNet 1.7, WordNet 1.7.1, WordNet 2.0, WordNet 2.1, WordNet 3.0
; [http://www.grsampson.net/Resources.html SEMiSUSANNE]
: 33 sense-tagged and structurally annotated documents from the Brown Corpus
; [http://ixa.si.ehu.es/Ixa/resources/sensecorpus Sensecorpus]
: Automatically extracted examples for all WordNet 1.6 noun senses and topic signatures built based on those examples
; [http://86.188.143.199/senseval2/Results/guidelines.htm#rawdata Senseval-2]
: Three all-words sense-annotated Penn Treebank II articles comprising in total some 5000 words of running text, plus some Penn Treebank II ''Wall Street Journal'' and British National Corpus text where 75 to 300 instances of a total of 73 nouns, adjectives, and verbs have been annotated with their WordNet 1.7 senses. See also Ted Pedersen's and Rada Mihalcea's conversions.
; [http://www.d.umn.edu/%7Etpederse/data.html Ted Pederson's Sense-tagged Text]
: Versions of the Senseval-1, Senseval-2, line, hard, serve, and interest data which have been converted to a common format (Senseval-2), POS tagged, and parsed.
; [http://www.cse.unt.edu/%7Erada/downloads.html#twa TWA sense-tagged data]
: Sense tagged data for six words with two-way ambiguities (bass, crane, motion, palm, plant, tank)
; [http://wordnet.princeton.edu/glosstag.shtml WordNet Gloss Disambiguation Project]
: A corpus of WordNet 3.0 glosses with word forms disambiguated to their WordNet 3.0 senses

==Software==
; [http://sourceforge.net/projects/cuitools/ CuiTools]
: A complete word sense disambiguation system that assigns senses to biomedical text based on the UMLS
; [https://code.google.com/p/dkpro-wsd/ DKPro WSD]
: A collection of software components for word sense disambiguation based on the Apache UIMA framework.
; [http://www.cse.unt.edu/%7Erada/downloads.html#gwsd GWSD: Unsupervised Graph-based Word Sense Disambiguation]
: A system for unsupervised all-words graph-based word sense disambiguation
; [http://alias-i.com/lingpipe/ LingPipe]
: A Java natural language processing toolkit. A [http://alias-i.com/lingpipe/demos/tutorial/wordSense/read-me.html tutorial on using LingPipe for word sense disambiguation] is available.
; [http://www.nltk.org/ Natural Language Toolkit (NLTK)]
: Python modules for NLP, including a module for reading Senseval-2 data
; [http://www.d.umn.edu/%7Etpederse/senseclusters.html SenseClusters]
: A package of (mostly) Perl programs that allows a user to cluster similar contexts together using unsupervised knowledge-lean methods.
; [http://www.cse.unt.edu/%7Erada/downloads.html#senselearner SenseLearner]
: An all-words word sense disambiguation tool
; [http://www.d.umn.edu/%7Etpederse/sensetools.html SenseTools]
: A suite of tools that allow for easy creation of supervised word sense disambiguation
; [http://www.d.umn.edu/%7Etpederse/tools.html Senseval-2 data format converters]
: Tools to convert between the following formats: Senseval-1, Senseval-2, Senseval-2 with conflated words, Headless Senseval-2, WePS, English Giga Word, plain text, National Library of Medicine Test Collection, Open Mind Data
; [http://senserelate.sourceforge.net/ WordNet::SenseRelate]
: Perl tools which use measures of semantic similarity and relatedness to perform word sense disambiguation
; [http://sourceforge.net/projects/wsdgate/ WSD Gate]
: A word sense disambiguation toolkit using GATE and WEKA
; [http://www.d.umn.edu/%7Etpederse/wsdshell.html WSD Shell]
: An improved version of the Duluth-Shell which was used as a driver for the Duluth Senseval-2 and Senseval-3 systems

Word sense disambiguation resources - Revision history

Tristan Miller: migrated from https://www.ukp.tu-darmstadt.de/research/scientific-community/ukpedia/word-sense-disambiguation/