ACL Wiki - User contributions [en]

Morphology software for English

2012-11-04T04:06:17Z

Ipodsoft: /* Free software */

'''[[Tools and Software for English]] - Morphology and part of speech tagging'''

For languages other than English, see [[List of resources by language]].

== Morphology ==

===Free software===


*[http://clipdemos.umiacs.umd.edu/catvar/ Catvar 2.0] - The Categorial Variation Database for English (OSL)
*[http://www.ling.helsinki.fi/kieliteknologia/tutkimus/hfst/ HFST] - Helsinki Finite-State Transducer Technology - FST library, command line tools, hfst-twolc (a rule compiler for two-level rules), and several spellers and morphological analyzers (GPL)
*[http://en.wikipedia.org/wiki/Foma_%28software%29 FOMA] - finite-state toolkit (similar to Xerox XFST), created and maintained by Måns Huldén (GPL)
*[[lttoolbox]] -- lexical processing tools for building morphological analysers/generators with XML specification files. Includes data for English (both analysis and disambiguation). (GPL)
*[http://www.sil.org/pckimmo/about_pc-kimmo.html PC-KIMMO] - a Two-level Processor for Morphological Analysis, including KGEN, KTEXT, and Englex
*[[SFST]] - Stuttgart Finite State Transducer Tools (GPL)
** Where is the data for English?
*[http://www.issco.unige.ch/en/research/projects/MULTEXT.html MULTEXT mmorph] - (unmaintained) two-level morphology, package includes some data for English and German, (GPL2 or later)

'''Source(s):''' [http://www.downloadranking.com Software solutions]

===Unknown license===
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/map/0.html MAP] - Cambridge/Edinburgh Morphological Analyzer and Dictionary System (gratis download, no license information)

===Proprietary software===


*[http://www.ru.nl/celex/ CELEX database] - Dutch, English, and German word forms
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/fonol/0.html FONOL] - Phonological Programming Language (non-commercial only)
*[http://services.canoo.com/MorphologyBrowser.html German Morphology Browser]
*[http://www.cs.technion.ac.il/~erelsgl/bxi/hmntx/teud.html Hebrew Morphological Parser]
*[http://bach.arts.kuleuven.ac.be/~piet/morlex/index.html MORLEX] - A lexical database for French
*[http://www.informatics.susx.ac.uk/research/nlp/carroll/morph.html morpha and morphg] - fast and robust morphological analysis and generation for English, from John A. Carroll (non-commercial only)
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/morfogen/0.html MORFOGEN] - a Morphology Grammar Builder and Dictionary Interface Tool
*[http://nlp.cs.nyu.edu/nomlex/index.html NOMLEX] - a dictionary of English nominalizations
*[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/ai-repository/ai/areas/nlp/morph/tulip/0.html TULIP] - a two level phonological formalism
*[http://www.fsmbook.com Xerox/PARC] - finite-state morphological analysis/generation using xfst, lexc, twolc

==Part of speech tagging==

===Free software===

*[http://acopost.sourceforge.net/ ACOPOST - A Collection Of PoS Taggers] Maximum Entropy Tagger, Trigram Tagger, Transformation-based Tagger, Example-based tagger
*[http://cogcomp.cs.illinois.edu/page/software_view/3 Illinois LBJ POS Tagger] - Uses averaged [http://en.wikipedia.org/wiki/Perceptron Perceptron] based sequential model. Java API, Free, open source license.
*[http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/tagger/ GENiA]- part-of-speech tagging, shallow parsing, and named entity recognition for biomedical text. C++, BSD license.
*[http://nltk.sourceforge.net/ NLTK - Natural Language Toolkit] Regexp Tagger, N-Gram Tagger, Brill Tagger, HMM Tagger, plus a freely downloadable book with a chapter on tagging
*[http://opencog.org/wiki/RelEx RelEx] - provides English-language part-of-speech tagging, entity tagging, as well as other types of tags (gender, date, money ...), after performing a deep parse, so that tags agree with parse. Also provides resulting stems. Apache 2.0 License.
*[http://nlp.ipipan.waw.pl/Spejd/ Spejd - Shallow Parsing and Disambiguation Engine] a GPL tool for simultaneous rule-based morphosyntactic disambiguation and partial parsing
*[http://wiki.apertium.org/wiki/Tagger_training Tagger training] on the Apertium Wiki (HMM + constraint based)
* [http://beta.visl.sdu.dk/cg3.html VISL Constraint Grammar] rule based disambiguation (GPL)
** Is there a Free set of rules for English?

===Proprietary software===


==Combined morphology and tagging==

===Free software===


*[http://www.cis.upenn.edu/~xtag/swrelease.html XTAG] - tools for parsing and grammar development, including morphological analysis and tagging, as described in [http://www.cs.mu.oz.au/acl/C/C94/C94-2149.pdf XTAG System - A Wide Coverage Grammar for English] and [http://arxiv.org/abs/cmp-lg/9410024 A Freely Available Wide Coverage Morphological Analyzer for English]

===Proprietary software===



*[http://nlp.postech.ac.kr/DownLoad/k_api.html Korean morphological analyzer and part-of-speech tagger]
*[http://www.nlplab.cn/resource/CIP/neucsp.zip NEUCSP] - a tool for Chinese Word Segmentation and POS tagging

==See also==
*[[Part-of-speech tagging]]

[[Category:Morphology]]
[[Category:Software]]
[[Category:Resources for English]]

State of the art

2012-11-04T04:04:17Z

Ipodsoft:

The purpose of this section of the ACL wiki is to be a repository of ''k''-best state-of-the-art results (i.e., methods and software) for various core natural language processing tasks.

As a side effect, this should hopefully evolve into a knowledge base of standard evaluation methods and datasets for various tasks, as well as encourage more effort into reproducibility of results. This will help newcomers to a field appreciate what has been done so far and what the main tasks are, and will help keep active researchers informed on fields other than their specific research. The next time you need a system for PP attachment, or wonder what is the current state of word sense disambiguation, this will be the place to visit.

'''Source(s):''' [http://www.downloadranking.com State of the art]

Please contribute! (This is also a good place for you to display your results!)

As a historical point of reference, you may want to refer to the [http://web.archive.org/web/20100325144600/http://cslu.cse.ogi.edu/HLTsurvey/ Survey of the State of the Art in Human Language Technology] ([http://www.lt-world.org/hlt_survey/master.pdf also available as PDF]), edited by R. Cole, J. Mariani, H. Uszkoreit, G. B. Varile, A. Zaenen, A. Zampolli, V. Zue, 1996.


* [[Anaphora Resolution (State of the art)|Anaphora Resolution]] (stub)
* [[Attributional and Relational Similarity (State of the art)|Attributional and Relational Similarity]]
* [[Automatic Summarization (State of the art)|Automatic Summarization]]
* [[Chunking (State of the art)|Chunking]] (stub)
* [[Dependency Parsing (State of the art)|Dependency Parsing]] (stub)
* [[Document Classification (State of the art)|Document Classification]] (stub)
* [[Language Identification (State of the art)|Language Identification]] (stub)
* [[Named Entity Recognition (State of the art)|Named Entity Recognition]]
* [[Noun-Modifier Semantic Relations (State of the art)|Noun-Modifier Semantic Relations]]
* [[NP Chunking (State of the art)|NP Chunking]]
* [[Paraphrase Identification (State of the art)|Paraphrase Identification]]
* [[Parsing (State of the art)|Parsing]]
* [[POS Induction (State of the art) |POS Induction]]
* [[POS Tagging (State of the art) |POS Tagging]]
* [[PP Attachment (State of the art)|PP Attachment]] (stub)
* [[Semantic Role Labeling (State of the art)|Semantic Role Labeling]] (stub)
* [[Sentiment Analysis (State of the art)|Sentiment Analysis]] (stub)
* [[Speech Recognition (State of the art)|Speech Recognition]] (article request)
* [[Temporal Expression Recognition and Normalisation (State of the art)|Temporal Expression Recognition and Normalisation]] (stub)
* [[Cleaneval (State of the art)| Web Corpus Cleaning]] (stub)
* [[Word Segmentation (State of the art)|Word Segmentation]] (stub)
* [[Word Sense Disambiguation (State of the art)|Word Sense Disambiguation]] (stub)


[[Category:State of the art]]

Category:Software

2012-11-04T04:00:49Z

Ipodsoft:

[[Category:Tools and Software]]

'''Source(s):''' [http://www.downloadranking.com Software solutions]