ACL Wiki - User contributions [en]

Morphology software for English

2011-04-15T19:39:39Z

Mmaxwell: /* moved PC-KIMMO from proprietary software to here */

'''[[Software]] - Morphology and part of speech tagging'''

For languages other than English, see [[List of resources by language]].

== Morphology ==

===Free software===


*[http://clipdemos.umiacs.umd.edu/catvar/ Catvar 2.0] - The Categorial Variation Database for English (OSL)
*[[lttoolbox]] -- lexical processing tools for building morphological analysers/generators with XML specification files. Includes data for English (both analysis and disambiguation). (GPL)
*[http://www.sil.org/pckimmo/about_pc-kimmo.html PC-KIMMO] - a Two-level Processor for Morphological Analysis, including KGEN, KTEXT, and Englex
*[[SFST]] - Stuttgart Finite State Transducer Tools (GPL)
** Where is the data for English?
*[http://www.issco.unige.ch/en/research/projects/MULTEXT.html MULTEXT mmorph] - (unmaintained) two-level morphology, package includes some data for English and German, (GPL2 or later)

===Unknown license===
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/map/0.html MAP] - Cambridge/Edinburgh Morphological Analyzer and Dictionary System (gratis download, no license information)

===Proprietary software===


*[http://www.ru.nl/celex/ CELEX database] - Dutch, English, and German word forms
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/fonol/0.html FONOL] - Phonological Programming Language (non-commercial only)
*[http://services.canoo.com/MorphologyBrowser.html German Morphology Browser]
*[http://www.cs.technion.ac.il/~erelsgl/bxi/hmntx/teud.html Hebrew Morphological Parser]
*[http://bach.arts.kuleuven.ac.be/~piet/morlex/index.html MORLEX] - A lexical database for French
*[http://www.informatics.susx.ac.uk/research/nlp/carroll/morph.html morpha and morphg] - fast and robust morphological analysis and generation for English, from John A. Carroll (non-commercial only)
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/morfogen/0.html MORFOGEN] - a Morphology Grammar Builder and Dictionary Interface Tool
*[http://nlp.cs.nyu.edu/nomlex/index.html NOMLEX] - a dictionary of English nominalizations
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/tulip/0.html TULIP] - a two level phonological formalism
*[http://www.fsmbook.com Xerox/PARC] - finite-state morphological analysis/generation using xfst, lexc, twolc

==Part of speech tagging==

===Free software===

*[http://acopost.sourceforge.net/ ACOPOST - A Collection Of PoS Taggers] Maximum Entropy Tagger, Trigram Tagger, Transformation-based Tagger, Example-based tagger
*[http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=FLBJPOS LBJ POS Tagger] - Uses averaged perceptron based sequential model. Java API, Free, open source license.
*[http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/tagger/ GENiA]- part-of-speech tagging, shallow parsing, and named entity recognition for biomedical text. C++, BSD license.
*[http://nltk.sourceforge.net/ NLTK - Natural Language Toolkit] Regexp Tagger, N-Gram Tagger, Brill Tagger, HMM Tagger, plus a freely downloadable book with a chapter on tagging
*[http://opencog.org/wiki/RelEx RelEx] - provides English-language part-of-speech tagging, entity tagging, as well as other types of tags (gender, date, money ...), after performing a deep parse, so that tags agree with parse. Also provides resulting stems. Apache 2.0 License.
*[http://nlp.ipipan.waw.pl/Spejd/ Spejd - Shallow Parsing and Disambiguation Engine] a GPL tool for simultaneous rule-based morphosyntactic disambiguation and partial parsing
*[http://wiki.apertium.org/wiki/Tagger_training Tagger training] on the Apertium Wiki (HMM + constraint based)
* [http://beta.visl.sdu.dk/cg3.html VISL Constraint Grammar] rule based disambiguation (GPL)
** Is there a Free set of rules for English?

===Proprietary software===


==Combined morphology and tagging==

===Free software===


*[http://www.cis.upenn.edu/~xtag/swrelease.html XTAG] - tools for parsing and grammar development, including morphological analysis and tagging, as described in [http://www.cs.mu.oz.au/acl/C/C94/C94-2149.pdf XTAG System - A Wide Coverage Grammar for English] and [http://arxiv.org/abs/cmp-lg/9410024 A Freely Available Wide Coverage Morphological Analyzer for English]

===Proprietary software===



*[http://nlp.postech.ac.kr/DownLoad/k_api.html Korean morphological analyzer and part-of-speech tagger]
*[http://www.nlplab.cn/resource/CIP/neucsp.zip NEUCSP] - a tool for Chinese Word Segmentation and POS tagging

==See also==
*[[Part-of-speech tagging]]

[[Category:Morphology]]
[[Category:Software]]
[[Category:Resources for English]]

Morphology software for English

2011-04-15T19:39:00Z

Mmaxwell: /* PC-KIMMO is not Proprietary software, moving it to free software */

'''[[Software]] - Morphology and part of speech tagging'''

For languages other than English, see [[List of resources by language]].

== Morphology ==

===Free software===


*[http://clipdemos.umiacs.umd.edu/catvar/ Catvar 2.0] - The Categorial Variation Database for English (OSL)
*[[lttoolbox]] -- lexical processing tools for building morphological analysers/generators with XML specification files. Includes data for English (both analysis and disambiguation). (GPL)
*[[SFST]] - Stuttgart Finite State Transducer Tools (GPL)
** Where is the data for English?
*[http://www.issco.unige.ch/en/research/projects/MULTEXT.html MULTEXT mmorph] - (unmaintained) two-level morphology, package includes some data for English and German, (GPL2 or later)

===Unknown license===
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/map/0.html MAP] - Cambridge/Edinburgh Morphological Analyzer and Dictionary System (gratis download, no license information)

===Proprietary software===


*[http://www.ru.nl/celex/ CELEX database] - Dutch, English, and German word forms
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/fonol/0.html FONOL] - Phonological Programming Language (non-commercial only)
*[http://services.canoo.com/MorphologyBrowser.html German Morphology Browser]
*[http://www.cs.technion.ac.il/~erelsgl/bxi/hmntx/teud.html Hebrew Morphological Parser]
*[http://bach.arts.kuleuven.ac.be/~piet/morlex/index.html MORLEX] - A lexical database for French
*[http://www.informatics.susx.ac.uk/research/nlp/carroll/morph.html morpha and morphg] - fast and robust morphological analysis and generation for English, from John A. Carroll (non-commercial only)
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/morfogen/0.html MORFOGEN] - a Morphology Grammar Builder and Dictionary Interface Tool
*[http://nlp.cs.nyu.edu/nomlex/index.html NOMLEX] - a dictionary of English nominalizations
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/tulip/0.html TULIP] - a two level phonological formalism
*[http://www.fsmbook.com Xerox/PARC] - finite-state morphological analysis/generation using xfst, lexc, twolc

==Part of speech tagging==

===Free software===

*[http://acopost.sourceforge.net/ ACOPOST - A Collection Of PoS Taggers] Maximum Entropy Tagger, Trigram Tagger, Transformation-based Tagger, Example-based tagger
*[http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=FLBJPOS LBJ POS Tagger] - Uses averaged perceptron based sequential model. Java API, Free, open source license.
*[http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/tagger/ GENiA]- part-of-speech tagging, shallow parsing, and named entity recognition for biomedical text. C++, BSD license.
*[http://nltk.sourceforge.net/ NLTK - Natural Language Toolkit] Regexp Tagger, N-Gram Tagger, Brill Tagger, HMM Tagger, plus a freely downloadable book with a chapter on tagging
*[http://opencog.org/wiki/RelEx RelEx] - provides English-language part-of-speech tagging, entity tagging, as well as other types of tags (gender, date, money ...), after performing a deep parse, so that tags agree with parse. Also provides resulting stems. Apache 2.0 License.
*[http://nlp.ipipan.waw.pl/Spejd/ Spejd - Shallow Parsing and Disambiguation Engine] a GPL tool for simultaneous rule-based morphosyntactic disambiguation and partial parsing
*[http://wiki.apertium.org/wiki/Tagger_training Tagger training] on the Apertium Wiki (HMM + constraint based)
* [http://beta.visl.sdu.dk/cg3.html VISL Constraint Grammar] rule based disambiguation (GPL)
** Is there a Free set of rules for English?

===Proprietary software===


==Combined morphology and tagging==

===Free software===


*[http://www.cis.upenn.edu/~xtag/swrelease.html XTAG] - tools for parsing and grammar development, including morphological analysis and tagging, as described in [http://www.cs.mu.oz.au/acl/C/C94/C94-2149.pdf XTAG System - A Wide Coverage Grammar for English] and [http://arxiv.org/abs/cmp-lg/9410024 A Freely Available Wide Coverage Morphological Analyzer for English]

===Proprietary software===



*[http://nlp.postech.ac.kr/DownLoad/k_api.html Korean morphological analyzer and part-of-speech tagger]
*[http://www.nlplab.cn/resource/CIP/neucsp.zip NEUCSP] - a tool for Chinese Word Segmentation and POS tagging

==See also==
*[[Part-of-speech tagging]]

[[Category:Morphology]]
[[Category:Software]]
[[Category:Resources for English]]