ACL Wiki - User contributions [en]

Parsing (State of the art)

2013-10-28T20:23:50Z

Dmcc: Update links to newer versions

* '''Performance measure:''' PARSEVAL - the [http://nlp.cs.nyu.edu/evalb/ evalb] program
* '''Training data:''' sections 2-21 of Wall Street Journal corpus
* '''Testing data:''' section 23 of Wall Street Journal corpus

== Table of results ==

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publications
! Software
! Results (PARSEVAL)
! Comments
|-
| Charniak & Johnson's Parser
| Lexicalized N-Best PCFG + Discriminative reranking
| Johnson and Charniak (2005)
| [https://github.com/BLLIP/bllip-parser Download]
| 91.4%
| also works well on Brown
|-
| Self-trained Charniak & Johnson Parser
| Above + self-training on ~2 million raw sentences from NANC
| McClosky, Charniak, and Johnson (2006)
| [http://nlp.stanford.edu/~mcclosky/selftraining.html Download]
| 92.1%
| also works well on Brown
|-
| Collins' Parser
| Lexicalized PCFG
| Collins (1999), Bikel (2004)
| [http://www.cis.upenn.edu/~dbikel/software.html Dan Bikel's implementation]
| ?
| ?
|-
| Berkeley Parser
| Automatically induced PCFG
| Petrov et al. (2006), Petrov and Klein (2007)
| [http://nlp.cs.berkeley.edu/Main.html#Parsing Berkeley Parser]
| 90.1%
| works well also for Chinese and German
|-
| Link Grammar
| Dependency grammar
| Temperley, Sleator, Lafferty, others (1995-2006)
| [http://www.abisource.com/projects/link-grammar/ Actively supported project]
| ?
| Persian, Arabic, Chinese, German, Russian dictionaries have been developed.
|-
|}

== References ==

Bikel, D. (2004). ''[http://www.cis.upenn.edu/~dbikel/papers/thesis.pdf On The Parameter Space of Generative Lexicalized Statistical Parsing Models]''. PhD Thesis, Computer and Information Science, University of Pennsylvania.

Collins, M. (1999). ''[http://people.csail.mit.edu/mcollins/papers/thesis.ps Head-driven Statistical Models for Natural Language Parsing]''. PhD Thesis, Computer and Information Science, University of Pennsylvania.

Charniak, E. and Johnson, M. (2005). [http://acl.ldc.upenn.edu/P/P05/P05-1022.pdf Coarse-to-fine n-best parsing and MaxEnt discriminative reranking]. ''Proceedings of the 43rd Annual Meeting of the ACL'', pages 173–180, Ann Arbor, June 2005.

McClosky, D., Charniak, E., and Johnson, M. (2006) [http://www.aclweb.org/anthology/N/N06/N06-1020.pdf Effective Self-Training for Parsing]. ''Proceedings of HLT/NAACL 2006'', pages 152-159, New York City, USA, June 2006.

Petrov, S., Barrett, L., Thibaux, R., and Klein, D. (2006). [http://nlp.cs.berkeley.edu/pubs/Petrov-Barrett-Thibaux-Klein_2006_Learning_paper.pdf Learning accurate, compact, and interpretable tree annotation]. ''Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the ACL'', pages 433–440, Sydney.

Petrov, S., and Klein, D. (2007). [http://nlp.cs.berkeley.edu/pubs/Petrov-Klein_2007_Inference_paper.pdf Improved inference for unlexicalized parsing]. ''Proceedings of NAACL 2007'', pages 404-411.

Sleator, Daniel & Davy Temperly (1993) "[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/link/pub/www/papers/ps/LG-IWPT93.pdf Parsing English with a Link Grammar]", ''Third International Workshop on Parsing Technologies''.

== See also ==

* [[State of the art]]

== External links ==

* PARSEVAL - the [http://nlp.cs.nyu.edu/evalb/ evalb] program

[[Category:State of the art]]

Parsers for English

2008-06-02T22:03:30Z

Dmcc: shameless plug (BLLIP parser)

For languages other than English, see [[List of resources by language]].

==Free software==


* [http://www.yorku.ca/jmason/asdindex.htm ASD grammars and parser]
* [http://www.cis.upenn.edu/~dbikel/software.html Bikel Parser]
* [http://bllip.cs.brown.edu/resources.shtml#software BLLIP (Charniak and Johnson) Reranking Parser]
* [http://www.delph-in.net/ DELPH-IN], Deep Linguistic Processing with HPSG (Head-Driven Phrase Structure Grammar)
* [http://www.link.cs.cmu.edu/link/ Link Grammar Parser -- a dependency parser] from CMU. The latest, supported versions are hosted [http://www.abisource.com/projects/link-grammar/ here], at Abiword. Open source, BSD license.
* [http://openccg.sf.net OpenCCG parser and grammar development environment for Combinatory Categorial Grammar]
* [http://nlp.ipipan.waw.pl/Spejd/ Spejd - Shallow Parsing and Disambiguation Engine] a GPL tool for simultaneous partial parsing and rule-based morphosyntactic disambiguation
* [http://www.coli.uni-saarland.de/projects/salsa/shal/ Shalmaneser] (GPL)
* [http://nlp.stanford.edu/software/lex-parser.shtml Stanford Parser] (GPL)



==Proprietary software==


* [http://svn.ask.it.usyd.edu.au/trac/candc C&C parser for Combinatory Categorial Grammar]
* [[Minipar]]



[[Category:Parsers|*]]

Parsing (State of the art)

2008-05-23T19:40:52Z

Dmcc: Add self-trained Charniak and Johnson parser, fix citation

* '''Performance measure:''' PARSEVAL - the [http://nlp.cs.nyu.edu/evalb/ evalb] program
* '''Training data:''' sections 2-22 of Wall Street Journal corpus
* '''Testing data:''' section 23 of Wall Street Journal corpus

== Table of results ==

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publications
! Software
! Results (PARSEVAL)
! Comments
|-
| Charniak & Johnson's Parser
| Lexicalized N-Best PCFG + Discriminative reranking
| Johnson and Charniak (2005)
| [http://www.cog.brown.edu/~mj/Software.htm Download]
| 91.4%
| also works well on Brown
|-
| Self-trained Charniak & Johnson Parser
| Above + self-training on ~2 million raw sentences from NANC
| McClosky, Charniak, and Johnson (2006)
| [http://www.cs.brown.edu/~dmccm/selftraining Download]
| 92.1%
| also works well on Brown
|-
| Collins' Parser
| Lexicalized PCFG
| Collins (1999), Bikel (2004)
| [http://www.cis.upenn.edu/~dbikel/software.html Dan Bikel's implementation]
| ?
| ?
|-
| Berkeley Parser
| Automatically induced PCFG
| Petrov et al. (2006), Petrov and Klein (2007)
| [http://nlp.cs.berkeley.edu/Main.html#Parsing Berkeley Parser]
| 90.1%
| works well also for Chinese and German
|-
| Link Grammar
| Dependency grammar
| Temperley, Sleator, Lafferty, others (1995-2006)
| [http://www.abisource.com/projects/link-grammar/ Actively supported project]
| ?
| Persian, Arabic, Chinese, German, Russian dictionaries have been developed.
|-
|}

== References ==

Bikel, D. (2004). ''[http://www.cis.upenn.edu/~dbikel/papers/thesis.pdf On The Parameter Space of Generative Lexicalized Statistical Parsing Models]''. PhD Thesis, Computer and Information Science, University of Pennsylvania.

Collins, M. (1999). ''[http://people.csail.mit.edu/mcollins/papers/thesis.ps Head-driven Statistical Models for Natural Language Parsing]''. PhD Thesis, Computer and Information Science, University of Pennsylvania.

Charniak, E. and Johnson, M. (2005). [http://acl.ldc.upenn.edu/P/P05/P05-1022.pdf Coarse-to-fine n-best parsing and MaxEnt discriminative reranking]. ''Proceedings of the 43rd Annual Meeting of the ACL'', pages 173–180, Ann Arbor, June 2005.

McClosky, D., Charniak, E., and Johnson, M. (2006) [http://www.aclweb.org/anthology/N/N06/N06-1020.pdf Effective Self-Training for Parsing]. ''Proceedings of HLT/NAACL 2006'', pages 152-159, New York City, USA, June 2006.

Petrov, S., Barrett, L., Thibaux, R., and Klein, D. (2006). [http://www.eecs.berkeley.edu/~petrov/data/acl06.pdf Learning accurate, compact, and interpretable tree annotation]. ''Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the ACL'', pages 433–440, Sydney.

Petrov, S., and Klein, D. (2007). [http://www.eecs.berkeley.edu/~petrov/data/naacl07.pdf Improved inference for unlexicalized parsing]. ''Proceedings of NAACL 2007'', pages 404-411.

Sleator, Daniel & Davy Temperly (1993) "[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/link/pub/www/papers/ps/LG-IWPT93.pdf Parsing English with a Link Grammar]", ''Third International Workshop on Parsing Technologies''.

== See also ==

* [[State of the art]]

== External links ==

* PARSEVAL - the [http://nlp.cs.nyu.edu/evalb/ evalb] program

[[Category:State of the art]]