Parsing (State of the art): Difference between revisions

From ACL Wiki
Jump to navigation Jump to search
← Older editNewer edit →
No edit summary
No edit summary
Line 1: Line 1:
== "Standard" measure: ==
* '''Performance measure:''' PARSEVAL - the [http://nlp.cs.nyu.edu/evalb/ evalb] program
PARSEVAL -- the evalb[http://nlp.cs.nyu.edu/evalb/] program.
* '''Training data:''' sections 2-22 of Wall Street Journal corpus
* '''Testing data:''' section 23 of Wall Street Journal corpus


== "Standard" datasets: ==
* Training: WSJ sections 2-22
* Testing: WSJ section 23


{{StateOfTheArtTable}}
{| border="1" cellpadding="5" cellspacing="1" width="100%"
 
|-
| Johnson & Charniak's Parser || Lexicalized N-Best PCFG + Discriminative re-reanking || Mark Johnson and Eugene Charniak, ACL 2005 [http://acl.ldc.upenn.edu/P/P05/P05-1022.pdf] || Available [http://www.cog.brown.edu/~mj/Software.htm] || 91.4 || Works well also on Brown  
! System name
! Short description
! Main publications
! Software
! Results (PARSEVAL)
! Comments
|-
| Johnson & Charniak's Parser
| Lexicalized N-Best PCFG + Discriminative re-reanking
| Mark Johnson and Eugene Charniak, ACL 2005 [http://acl.ldc.upenn.edu/P/P05/P05-1022.pdf]
| Available [http://www.cog.brown.edu/~mj/Software.htm]
| 91.4%
| works well also on Brown  
|-
|-
| Collins' Parser || Lexicalized PCFG || Collins' Thesis [http://people.csail.mit.edu/mcollins/papers/thesis.ps], Bikel's Thesis [http://www.cis.upenn.edu/~dbikel/papers/thesis.pdf] || Dan Bikel's Implementation [http://www.cis.upenn.edu/~dbikel/software.html] || ??? ||  
| Collins' Parser
| Lexicalized PCFG
| Collins' Thesis [http://people.csail.mit.edu/mcollins/papers/thesis.ps], Bikel's Thesis [http://www.cis.upenn.edu/~dbikel/papers/thesis.pdf]
| Dan Bikel's Implementation [http://www.cis.upenn.edu/~dbikel/software.html]
| ???
|  
|-
|-
| Berkeley Parser || Automatically induced PCFG || Petrov, Barrett, Thibaux and Klein, ACL 2006 [http://www.eecs.berkeley.edu/~petrov/data/acl06.pdf], Petrov and Klein, NAACL 2007 [http://www.eecs.berkeley.edu/~petrov/data/naacl07.pdf] || Available [http://nlp.cs.berkeley.edu/Main.html#Parsing] || 90.1 ||
| Berkeley Parser
Works well also for Chinese and German
| Automatically induced PCFG
| Petrov, Barrett, Thibaux and Klein, ACL 2006 [http://www.eecs.berkeley.edu/~petrov/data/acl06.pdf], Petrov and Klein, NAACL 2007 [http://www.eecs.berkeley.edu/~petrov/data/naacl07.pdf]
| Available [http://nlp.cs.berkeley.edu/Main.html#Parsing]
| 90.1%
| works well also for Chinese and German
|-
|-
|}
|}

Revision as of 17:21, 27 June 2007

  • Performance measure: PARSEVAL - the evalb program
  • Training data: sections 2-22 of Wall Street Journal corpus
  • Testing data: section 23 of Wall Street Journal corpus


System name Short description Main publications Software Results (PARSEVAL) Comments
Johnson & Charniak's Parser Lexicalized N-Best PCFG + Discriminative re-reanking Mark Johnson and Eugene Charniak, ACL 2005 [1] Available [2] 91.4% works well also on Brown
Collins' Parser Lexicalized PCFG Collins' Thesis [3], Bikel's Thesis [4] Dan Bikel's Implementation [5] ???
Berkeley Parser Automatically induced PCFG Petrov, Barrett, Thibaux and Klein, ACL 2006 [6], Petrov and Klein, NAACL 2007 [7] Available [8] 90.1% works well also for Chinese and German
Retrieved from "https://www.aclweb.org/aclwiki/index.php?title=Parsing_(State_of_the_art)&oldid=3866"