ACL Wiki - User contributions [en]

Best paper awards

2021-07-05T16:36:44Z

ChristopherManning: Add other 2018 best papers

=ACL=

A few items are still missing. Please help complete this table and link papers to PDFs in the [http://www.aclweb.org/anthology/ ACL Anthology].

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Author'''
|'''Paper Title'''
|-
|2001
|Eugene Charniak
|[http://www.aclweb.org/anthology/P01-1017 Immediate-head parsing for language modeling]
|-
|2001
|Ulrich Germann, Michael Jahr, Kevin Knight, Daniel Marcu, and Kenji Yamada
|[http://www.aclweb.org/anthology/P01-1030 Fast Decoding and Optimal Decoding for Machine Translation]
|-
|2002
|Franz Och and Hermann Ney
|[http://www.aclweb.org/anthology/P02-1038 Discriminative Training and Maximum Entropy Models for Statistical Machine Translation]
|-
|2003
|Dan Klein and Chris Manning
|[http://www.aclweb.org/anthology/P03-1054 Accurate Unlexicalized Parsing]
|-
|2003
|Yukiko Nakano, Gabe Reinstein, Tom Stocky, and Justine Cassell
|[http://www.aclweb.org/anthology/P03-1070 Towards a Model of Face-to-Face Grounding]
|-
|2004
|Diana McCarthy, Rob Koeling, Julie Weeds, and John Carroll
|[http://www.aclweb.org/anthology/P04-1036 Finding Predominant Word Senses in Untagged Text]
|-
|2005
|David Chiang
|[http://www.aclweb.org/anthology/P05-1033 A hierarchical phrase-based model for statistical machine translation]
|-
|2006
|Rion Snow, Dan Jurafsky, and Andrew Y. Ng
|[http://www.aclweb.org/anthology/P06-1101 Semantic taxonomy induction from heterogenous evidence]
|-
|2007
|Y. W. Wong and R. J. Mooney
|[http://www.aclweb.org/anthology/P07-1121 Learning synchronous grammars for semantic parsing with lambda calculus]
|-
|2008
|Liang Huang
|[http://www.aclweb.org/anthology/P08-1067 Forest Reranking: Discriminative Parsing with Non-Local Features]
|-
|2008
|Libin Shen, Jinxi Xu and Ralph Weischedel
|[http://www.aclweb.org/anthology/P08-1066 A New String-to-Dependency Machine Translation Algorithm with a Target Dependency Language Model]
|-
|2009
|Andre Martins, Noah Smith and Eric Xing
|[http://www.aclweb.org/anthology/P09-1039 Concise Integer Linear Programming Formulations for Dependency Parsing]
|-
|2009
|S.R.K. Branavan, Harr Chen, Luke Zettlemoyer and Regina Barzilay
|[http://www.aclweb.org/anthology/P09-1010 Reinforcement Learning for Mapping Instructions to Actions]
|-
|2009
|Adam Pauls and Dan Klein
|[http://www.aclweb.org/anthology/P09-1108 K-Best A* Parsing]
|-
|2010 (Long)
|Matthew Gerber and Joyce Chai
|[http://www.aclweb.org/anthology/P10-1160 Beyond NomBank: A Study of Implicit Arguments for Nominal Predicates]
|-
|2010 (Short)
|Michael Lamar, Yariv Maron, Mark Johnson and Elie Bienenstock
|[http://www.aclweb.org/anthology/P10-2040 SVD and Clustering for Unsupervised POS Tagging]
|-
|2010 (Student)
|David Elson, Nicholas Dames and Kathleen McKeown
|[http://www.aclweb.org/anthology/P10-1015 Extracting Social Networks from Literary Fiction]
|-
|2011
|Dipanjan Das and Slav Petrov
|[http://www.aclweb.org/anthology/P11-1061 Unsupervised Part-of-Speech Tagging with Bilingual Graph-Based Projections]
|-
|2012 (Long)
|Hiroyuki Shindo, Yusuke Miyao, Akinori Fujino and Masaaki Nagata
|[http://www.aclweb.org/anthology/P12-1046 Bayesian Symbol-Refined Tree Substitution Grammars for Syntactic Parsing]
|-
|2012 (Student)
|Fan Bu, Hang Li and Xiaoyan Zhu
|[http://www.aclweb.org/anthology/P12-1047 String Re-writing Kernel]
|-
|2013
|Haonan Yu and Jeffrey Mark Siskind
|[http://www.aclweb.org/anthology/P13-1006 Grounded Language Learning from Video Described with Sentences]
|-
|2013 (Student)
|Abdellah Fourtassi and Emmanuel Dupoux
|[http://www.aclweb.org/anthology/P13-3024 A corpus-based evaluation method for Distributional Semantic Models]
|-
|2014
|Jacob Devlin, Rabih Zbib, Zhongqiang Huang, Thomas Lamar, Richard Schwartz and John Makhoul
|[http://www.aclweb.org/anthology/P14-1129 Fast and Robust Neural Network Joint Models for Statistical Machine Translation]
|-
|2014 (Short)
|Jean Mark Gawron
|[http://www.aclweb.org/anthology/P14-2049 Improving sparse word similarity models with asymmetric similarity measures]
|-
|2014 (Student)
|Tao Lei, Yu Xin, Yuan Zhang, Regina Barzilay and Tommi Jaakkola
|[http://www.aclweb.org/anthology/P14-1130 Low-Rank Tensors for Scoring Dependency Structures]
|-
|2015
|Yvette Graham
|[https://www.aclweb.org/anthology/E17-2057/ Improving Evaluation of Machine Translation Quality Estimation]
|-
|2015
|Emma Strubell, Luke Vilnis, Kate Silverstein, Andrew McCallum,
|[https://www.aclweb.org/anthology/P15-1015/ Learning Dynamic Feature Selection for Fast Sequential Prediction]
|-
|2016
|E.Dario Gutiérrez, Roger Levy, Benjamin Bergen
|[https://www.aclweb.org/anthology/P16-1225/ Finding Non-Arbitrary Form-Meaning Systematicity Using String-Metric Learning for Kernel Regression]
|-
|2017
|Ryan Cotterell, Jason Eisner
|[https://www.aclweb.org/anthology/P17-1109/ Probabilistic Typology: Deep Generative Models of Vowel Inventories]
|-
|2018
|John Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan Brennan
|[https://www.aclweb.org/anthology/P18-1254/ Finding syntax in human encephalography with beam search]
|-
|2018
|Sudha Rao and Hal Daumé III
|[https://aclanthology.org/P18-1255/ Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Information]
|-
|2018
|Andre Cianflone, Yulan Feng, Jad Kabbara and Jackie Chi Kit Cheung
|[https://aclanthology.org/P18-1256/ Let’s do it “again”: A First Computational Approach to Detecting Adverbial Presupposition Triggers]
|-
|2019
|Wen Zhang, Yang Feng, Fandong Meng, Di You and Qun Liu
|[https://www.aclweb.org/anthology/P19-1426/ Bridging the Gap between Training and Inference for Neural Machine Translation]
|-
|}

=NAACL=

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Author'''
|'''Paper Title'''
|-
|2004
|Regina Barzilay, MIT, and Lillian Lee, Cornell
|[http://www.aclweb.org/anthology/ Catching the Drift: Probabilistic Content Models, with Applications to Generation and Summarization]
|-
|2006
|Mehryar Mohri and Brian Roark
|[http://www.aclweb.org/anthology/N06-1040 Probabilistic Context-Free Grammar Induction Based on Structural Zeros]
|-
|2006
|Aria Haghighi and Dan Klein
|[http://www.aclweb.org/anthology/N06-1041 Prototype-Driven Learning for Sequence Models]
|-
|2007
|Antti-Veikko Rosti, Bing Xiang, Spyros Matsoukas, Richard Schwartz, Necip Fazil Ayan and Bonnie Dorr
|[http://www.aclweb.org/anthology/N07-1029 Combining Outputs from Multiple Machine Translation Systems]
|-
|2009
|Hoifung Poon, Colin Cherry and Kristina Toutanova
|[http://www.aclweb.org/anthology/N09-1024 Unsupervised Morphological Segmentation with Log-Linear Models]
|-
|2009
|David Chiang, Kevin Knight and Wei Wang
|[http://www.aclweb.org/anthology/N09-1025 11,001 New Features for Statistical Machine Translation]
|-
|2010 (long)
|Aria Haghighi and Dan Klein
|[http://www.aclweb.org/anthology/N10-1061 Coreference Resolution in a Modular, Entity-Centered Model]
|-
|2010 (short)
|Jennifer Foster
|[http://www.aclweb.org/anthology/N10-1060 “cba to check the spelling”: Investigating Parser Performance on Discussion Forum Posts]
|-
|2012 (full)
|Alexander Rush and Slav Petrov
|[http://www.aclweb.org/anthology/N12-1054 Vine Pruning for Efficient Multi-Pass Dependency Parsing]
|-
|2012 (short)
|Jacob Devlin and Spyros Matsoukas
|[http://www.aclweb.org/anthology/N12-1059 Trait-Based Hypothesis Selection for Machine Translation]
|-
|2012 (student)
|Oscar Taeckstroem, Ryan McDonald and Jakob Uszkoreit
|[http://www.aclweb.org/anthology/N12-1052 Cross-lingual Word Clusters for Direct Transfer of Linguistic Structure]
|-
|2013 (full)
|no award given
|
|-
|2013 (short)
|Marta Recasens, Marie-Catherine de Marneffe and Christopher Potts
|[http://www.aclweb.org/anthology/N13-1071 The Life and Death of Discourse Entities: Identifying Singleton Mentions]
|-
|2013 (student)
|Bradley Hauer and Greg Kondrak
|[http://www.aclweb.org/anthology/N13-1072 Automatic Generation of English Respellings]
|-
|2015 (long)
|Radu Soricut and Franz Och
|[http://aclweb.org/anthology/N/N15/N15-1186.pdf Unsupervised Morphology Induction Using Word Embeddings]
|-
|2015 (student)
|Vinodh Krishnan and Jacob Eisenstein
|[http://aclweb.org/anthology/N/N15/N15-1185.pdf "You’re Mr. Lebowski, I’m the Dude”: Inducing Address Term Formality in Signed Social Networks]
|-
|2015 (student)
|Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar, Chris Dyer, Eduard Hovy, Noah A. Smith
|[http://aclweb.org/anthology/N/N15/N15-1184.pdf Retrofitting Word Vectors to Semantic Lexicons]
|-
|2016
|Mohit Iyyer, Anupam Guha, Snigdha Chaturvedi, Jordan Boyd-Graber and Hal Daumé III
|[https://www.aclweb.org/anthology/N16-1180/ Feuding Families and Former Friends; Unsupervised Learning for Dynamic Fictional Relationships]
|-
|2016
|Jacob Andreas, Marcus Rohrbach, Trevor Darrell and Dan Klein
|[https://www.aclweb.org/anthology/N16-1181/ Learning to Compose Neural Networks for Question Answering]
|-
|2018
|Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer
|[https://www.aclweb.org/anthology/N18-1202/ Deep contextualized word representations]
|-
|2019
|Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova
|[https://www.aclweb.org/anthology/N19-1423/ BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding]
|-
|}

=EMNLP=

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Author'''
|'''Paper Title'''
|-
|2002
|Michael Collins
|[http://www.aclweb.org/anthology/W02-1001 Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms]
|-
|2002
|Frank Keller, Maria Lapata, and Olga Ourioupina
|[http://www.aclweb.org/anthology/W02-1030 Using the Web to Overcome Data Sparseness]
|-
|2003
|Peng Xu, Ahmad Emami and Frederick Jelinek
|[http://www.aclweb.org/anthology/W03-1021 Training Connectionist Models for the Structured Language Model]
|-
|2004
|Ben Taskar, Dan Klein, Michael Collins, Daphne Koller, and Christopher Manning
|[http://www.aclweb.org/anthology/W04-3201 Max-Margin Parsing]
|-
|2005 (best student paper)
|Ryan McDonald, Fernando Pereira, Kiril Ribarov and Jan Hajic
|[http://www.aclweb.org/anthology/H05-1066 Non-Projective Dependency Parsing using Spanning Tree Algorithms]
|-
|2006
|no award given
|
|-
|2007
|James Clarke and Maria Lapata
|[http://www.aclweb.org/anthology/D07-1001 Modelling Compression with Discourse Constraints]
|-
|2008
|no award given
|
|-
|2009
|Hoifung Poon and Pedro Domingos
|[http://www.aclweb.org/anthology/D09-1001 Unsupervised semantic parsing]
|-
|2010
|Terry Koo, Alexander M. Rush, Michael Collins, Tommi Jaakkola, and David Sontag
|[http://www.aclweb.org/anthology/D10-1125 Dual Decomposition for Parsing with Non-Projective Head Automata]
|-
|2011
|Wei Lu and Hwee Tou Ng
|[http://www.aclweb.org/anthology/D11-1149 A Probabilistic Forest-to-String Model for Language Generation from Typed Lambda Calculus Expressions]
|-
|2012
|Annie Louis and Ani Nenkova
|[http://www.aclweb.org/anthology/D12-1106 A Coherence Model Based on Syntactic Patterns]
|-
|2013
|Valentin Spitkovsky, Hiyan Alshawi and Daniel Jurafsky
|[http://www.aclweb.org/anthology/D13-1204 Breaking Out of Local Optima with Count Transforms and Model Recombination: A Study in Grammar Induction]
|-
|2014
|Vivek Srikumar, Pei-Chun Chen, Abby Vander Linden, Brittany Harding, Brad Huang, Peter Clark and Christopher D. Manning
|[https://www.aclweb.org/anthology/D14-1159/ Modeling Biological Processes for Reading Comprehension]
|-
|2015
|Yoav Artzi, Kenton Lee and Luke Zettlemoyer
|[https://www.aclweb.org/anthology/D15-1198/ Broad-coverage CCG Semantic Parsing with AMR]
|-
|2015
|Tsung-Hsien Wen, Milica Gasic, Nikola Mrkši´c, Pei-Hao Su, David Vandyke and Steve Young
|[https://www.aclweb.org/anthology/D15-1199/ Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems]
|-
|2016
|Karthik Narasimhan, Adam Yala and Regina Barzilay
|[https://www.aclweb.org/anthology/D16-1261/ Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning]
|-
|2016
|Kenton Lee, Mike Lewis and Luke Zettlemoyer
|[https://www.aclweb.org/anthology/D16-1262/ Global Neural CCG Parsing with Optimality Guarantees]
|-
|2017
|Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez and Kai-Wei Chang
|[https://www.aclweb.org/anthology/D17-1323/ Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints]
|-
|2017
|Andrew Yates, Arman Cohan and Nazli Goharian
|[https://www.aclweb.org/anthology/D17-1322/ Depression and Self-Harm Risk Assessment in Online Forums]
|-
|2018
|Emma Strubell, Patrick Verga, Daniel Andor, David Weiss and Andrew McCallum
|[https://www.aclweb.org/anthology/D18-1548/ Linguistically-Informed Self-Attention for Semantic Role Labeling]
|-
|2019
|Xiang Lisa Li and Jason Eisner
|[https://www.aclweb.org/anthology/D19-1276/ Specializing Word Embeddings (for Parsing) by Information Bottleneck]
|-
|}

=IJCNLP=
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Author'''
|'''Paper Title'''
|-
|2005
|John Carroll and Stephan Oepen
|[http://www.aclweb.org/anthology/I05-1015 High Efficiency Realization for a Wide-Coverage Unification Grammar]
|-
|2009
|Andre Martins, Noah Smith and Eric Xing
|[http://www.aclweb.org/anthology/P09-1039 Concise Integer Linear Programming Formulations for Dependency Parsing]
|-
|2009
|S.R.K. Branavan, Harr Chen, Luke Zettlemoyer and Regina Barzilay
|[http://www.aclweb.org/anthology/P09-1010 Reinforcement Learning for Mapping Instructions to Actions]
|-
|2009
|Adam Pauls and Dan Klein
|[http://www.aclweb.org/anthology/P09-1108 K-Best A* Parsing]
|-
|2011
|Caecilia Zirn, Mathias Niepert, Heiner Stuckenschmidt, and Michael Strube
|[http://www.aclweb.org/anthology/I11-1038 Fine-Grained Sentiment Analysis with Structural Features]
|-
|2011
|Siva Reddy, Ioannis Klapaftis, Diana McCarthy and Suresh Manandhar
|[http://www.aclweb.org/anthology/I11-1079 Dynamic and Static Prototype Vectors for Semantic Composition]
|-
|2013
|Houda Bouamor, Behrang Mohit and Kemal Oflazer
|[http://www.aclweb.org/anthology/I13-1031 SuMT: A Framework of Summarization and MT]
|-
|}
[[Category:Awards]]

Conference Invited Speakers

2017-06-30T14:53:01Z

ChristopherManning: Update/complete invited speakers

==ACL Conference==

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Invited Speakers'''
|-
|2000
|Susan E. Brennan, Roger K. Moore, Jun'ichi Tsujii
|-
|2001
|Jean-Luc Gauvain, Richard Durbin
|-
|2003
|Cynthia Fisher, Ariel Rubinstein, Donia Scott
|-
|2004
|Jack Mostow, Anne Cutler
|-
|2005
|Michael Jordan, Justine Cassell
|-
|2006
|Daniel Marcu, Sally McConnell-Ginet
|-
|2007
|Tom Mitchell, Barney Pell
|-
|2008
|Marc Swerts, Susan Dumais
|-
|2009
|Qiang Yang, Bonnie Webber
|-
|2010
|Andrei Broder, Zenzi M Griffin
|-
|2011
|David Ferrucci, Lera Boroditsky
|-
|2012
|Aravind K. Joshi, Mark Johnson
|-
|2013
|Harald Baayen, Chantel Prat
|-
|2014
|Corinna Cortes, Zoran Popovic
|-
|2015
|Marti Hearst, Jiawei Han
|-
|2016
|Amber Boydstun, Mark Steedman
|-
|2017
|Mirella Lapata, Noah Smith
|}

==NAACL Conference==

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Invited Speakers'''
|-
|2001
|Tom Mitchell, Aravind Joshi, Jon Kleinberg
|-
|2002 with ACL
|-
|2003 with HLT
|Elissa Newport
|-
|2004 with HLT
|Andrei Broder, Jill Burstein
|-
|2005 with ACL
|-
|2006 with HLT
|Joshua Goodman, Diane Litman
|-
|2007 NAACL HLT
|Franz Josef Och, Luis von Ahn
|-
|2008 with ACL
|-
|2009 NAACL HLT
| Antonio Torralba, Dan Jurafsky
|-
|2010 NAACL HLT
| David Temperley, Steve Renals
|-
|2011 with ACL
|-
|2012 NAACL HLT
| Eduard Hovy, James W. Pennebaker
|-
|2013 NAACL HLT
|Gina R Kuperberg, Kathleen R McKeown
|-
|2014 with ACL
|-
|2015 NAACL HLT
|Lillian Lee, Fei-fei Li
|-
|2016 NAACL HLT
| Ehud Reiter, Regina Barzilay
|-
|2017 with ACL
|}

==EMNLP Conference==

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Invited Speakers'''
|-
|2002
|Dan Roth
|-
|2003
|Kevin Knight
|-
|2004
|Ken Church
|-
|2005 with HLT
|Larry Hunter, Sanjeev Khudanpur, Ellen Voorhees
|-
|2006
|Jane Simpson, James McElvenny, Tom Honeyman
|-
|2007
|LouAnn Gerken, Piotr Indyk
|-
|2008
|Oren Etzioni, Tom Griffiths, Fernando Pereira
|-
|2009
|Richard Sproat
|-
|2010
|Kevin Knight, Andrew Ng, Amit Singhal
|-
|2011
|David McAllester
|-
|2012
|Eric Xing, Patrick Pantel
|-
|2013
|Fernando Pereira, Andrew Ng
|-
|2014
|Salim Roukos, Thorsten Joachims,
|-
|2015
|Yoshua Bengiio, Justin Grimmer
|-
|2016
|Christopher Potts, Adnreas Stolcke, Stefanie Tellex
|-
|2017
|Nando de Freitas, Sharon Goldwater, Dan Jurafsky
|}

==[http://www.cicling.org CICLing] Conference==

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Invited Speakers'''
|-
|2000
|Richard Kittredge, Igor Mel’cuk
|-
|2001
|Graeme Hirst, Sylvain Kahane, Ruslan Mitkov
|-
|2002
|Ivan Sag, Yorick Wilks
|-
|2003
|Eric Brill, Aravind Joshi, Adam Kilgarriff, Ted Pedersen
|-
|2004
|Ricardo Baeza-Yates, Nick Campbell, Martin Kay, Philip Resnik
|-
|2005
|Christian Boitet, Kevin Knight, Daniel Marcu, Ellen Riloff
|-
|2006
|Eduard Hovy, Nancy Ide, Rada Mihalcea
|-
|2007
|Gregory Grefenstette, Kathleen McKeown, Raymond Mooney
|-
|2008
|Ido Dagan, Eva Hajičová, Alon Lavie, Kemal Oflazer
|-
|2009
|Jill Burstein, Ken Church, Dekang Lin
|}

Conference Chairs

2015-02-09T04:40:10Z

ChristopherManning: Fill in 2014 and 2012

For more conference chairs, see [[Additional conference chairs]].

==ACL Conference==

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''General Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2015 w/IJCNLP
|Yuji Matsumoto
|Chengqing Zong, Michael Strube
|Le Sun (CAS), Yang Liu (Tsinghua)
|-
|2014
|Daniel Marcu
|Kristina Toutanova, Hua Wu
|David Yarowsky
|-
|2013
|Hinrich Schuetze
|Pascale Fung, Massimo Poesio
|Svetla Koeva
|-
|2012 w/IJCNLP
|Haizhou Li
|Chin-Yew Lin, Miles Osborne
|Gary Geunbae Lee, Jong C. Park
|-
|2011
|Dekang Lin
|Rada Mihalcea, Yuji Matsumoto
|Brian Roark
|-
|2010
|Jan Hajic
|Sandra Carberry, Stephen Clark
|Joakim Nivre
|-
|2009 w/ IJCNLP
|Keh-Yih Su
|Jian Su, Janyce Wiebe
|Haizhou Li
|-
|2008 w/ NAACL HLT
|Kathleen McKeown
|Johanna Moore, Simone Teufel, Sadaoki Furui (speech), James Allan (IR)
|Chris Brew
|-
|2007
|John Carroll
|Annie Zaenen, Antal van den Bosch
|Eva Hajicova
|-
|2006 w/ COLING
|Nicoletta Calzolari
|Claire Cardie, Pierre Isabelle
|Robert Dale, Cecile Paris
|-
|2005 w/ NAACL
|Kevin Knight
|Hwee Tou Ng, Kemal Oflazer
|Dragomir Radev
|-
|2004
|Donia Scott
|Walter Daelemans, Marilyn Walker
|Toni Badia
|-
|2003
|Jun'ichi Tsujii
|Erhard Hinrichs, Dan Roth
|Kenji Araki
|-
|2002 w/ NAACL
|Pierre Isabelle
|Eugene Charniak, Dekang Lin
|Martha Palmer
|-
|2001
|Bonnie Webber
|Norbert Reithinger, Giorgio Satta
|Patrick Saint-Dizier
|-
|2000
|Hitoshi Iida
|K. Vijay-Shanker, Chang-Ning Huang
|Dekai Wu
|-
|1999
|
|Robert Dale, Ken Church
|Bonnie Dorr
|-
|1998 w/COLING
|
|Christian Boitet, Pete Whitelock
|Pierre Isabelle
|-
|1997
|
|Philip Cohen, Wolfgang Wahlster
|Maria Felisa Verdejo
|-
|1996
|
|Aravind Joshi, Martha Palmer
|Douglas Appelt, Geoffrey Pullum
|-
|1995
|
|Hans Uszkoreit
|Robert Berwick
|-
|1994
|
|James Pustejovsky
|Janyce Wiebe
|-
|1993
|
|Lenhart Schubert
|Terry Patten, Robert Kasper
|-
|1992
|
|Henry Thompson
|Sandra Carberry, Dan Chester, Kathleen McCoy
|-
|1991
|
|Douglas Appelt
|Peter Norvig
|-
|1990
|
|Robert Berwick
|Rich Thomason
|-
|1989
|
|Julia Hirschberg
|Richard Rosenberg
|-
|1988
|
|Jerry Hobbs
|William Rappaport
|-
|1987
|
|Candy Sidner
|Douglas Appelt
|-
|1986
|
|Alan Biermann
|Kathleen McKeown, Cecile Paris
|-
|1985
|
|William Mann
|Martha Evens, Victor Yngve
|-
|1984
|
|
|
|-
|1983
|
|Mitch Marcus
|Jon Allen
|-
|1982
|
|Madeleine Bates
|C. Raymond Perrault
|-
|1981
|
|C. Raymond Perrault
|Jerry Kaplan
|-
|1980
|Norman Sondheimer ?
|Gary Hendrix
|Kathleen McKeown
|-
|1979
|
|Norman Sondheimer
|Jim Levin
|}

==NAACL Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''General Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2015
|Rada Mihalcea
|Joyce Chai, Anoop Sarkar
|Priscilla Rasmussen
|-
|2013
|Lucy Vanderwende
|Katrin Kirchhoff, Hal Daume
|Priscilla Rasmussen
|-
|2012
|Jennifer Chu-Carroll
|Srinivas Bangalore, Eric Fosler-Lussier, Ellen Riloff
|Priscilla Rasmussen
|-
|2011 w/ACL
|
|
|
|-
|2010
|Ronald Kaplan
|Jill Burstein, Mary Harper, Gerald Penn
|David Chiang, Eduard Hovy, Jonathan May, Jason Riesa
|-
|2009
|Mari Ostendorf
|Michael Collins, Lucy Vanderwende, Doug Oard, Shri Narayanan
|Martha Palmer and James Martin
|-
|2008 w/ ACL
|
|
|
|-
|2007 w/ HLT
|Candace Sidner
|Tanja Schultz, Matthew Stone, ChengXiang Zhai
|James Allen, Daniel Gildea, Lenhart Schubert
|-
|2006 w/ HLT
|Robert C. Moore
|Jennifer Chu-Carroll, Jeff Bilmes, Mark Sanderson
|Satoshi Sekine
|-
|2005 w/ ACL
|
|
|
|-
|2004 w/ HLT
|Julia Hirschberg
|Susan Dumais, Daniel Marcu, Salim Roukos
|Christine Doran
|-
|2003 w/ HLT
||Eduard Hovy
|Marti Hearst, Mari Ostendorf
|Dekang Lin
|-
|2002 w/ ACL
|
|
|
|-
|2001
|Lori Levin
|Kevin Knight
|Alon Lavie
|-
|2000 w/ ANLP
|Marie Meteer
|Janyce Wiebe, Sergei Nirenburg
|Rick Wojcik
|}

==ANLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2000 w/ NAACL
|
|
|
|-
|1997
|
|Ralph Grishman
|John White
|-
|1994
|
|
|
|-
|1992
|
|
|
|-
|1988
|
|
|
|-
|1983
|
|
|
|}

==EACL Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2014
|Shuly Wintner
|Sharon Goldwater, Stefan Riezler
|Lars Borin, Aarne Ranta
|-
|2012
|Walter Daelemans
|Mirella Lapata,Lluís Màrquez
|Marc El-Beze
|-
|2009
|
|
|
|-
|2006
|
|Diana McCarthy, Shuly Wintner
|Bernardo Magnini, Alberto Lavelli
|-
|2003
|Claire Gardent
|Ann Copestake, Jan Hajic
|Ferenc Kiefer
|-
|-
|1999
|
|Henry Thompson, Alex Lascarides
|Koenraad de Smedt
|-
|1997 w/ ACL
|
|
|
|-
|1993
|
|Steven Krauwer, Michael Moortgat, Louis des Tombe
|Renee Pohlmann
|-
|1991
|
|Jurgen Kunze, Dorothee Reimann
|
|-
|1989
|
|Harold Somers, Mary McGee Wood
|
|-
|1987
|
|Bente Maegaard
|Rolf Christensen
|-
|1985
|
|Maghi King
|Michael Rosner
|-
|1983
|Antonio Zampolli
|Giacomo Ferrari|
|
|}

==COLING Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2006 w/ ACL
|
|
|
|-
|2004
|Martin Kay
|Sergei Nirenburg
|Margaret King
|-
|2002
|
|Winfried Lenders
|Chu-Ren Huang, Sharon Wang
|-
|2000
|
|Martin Kay
|Hans Uszkoreit
|-
|1998 w/ ACL
|
|
|
|-
|1996
|
|J. Tsujii
|B. Maegaard
|-
|1990
|
|
|
|-
|1988
|
|
|
|-
|1984
|
|
|
|}

==IJCNLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2011
|Kam-Fai Wong
|Haifeng Wang, David Yarowsky
|Virach Sornlertlamvanich, Hitoshi Isahara
|-
|2009 w/ ACL
|Keh-Yih Su
|Jian Su, Janyce Wiebe
|Haizhou Li
|-
|2008
|Jong-Hyeok Lee
|Yuji Matsumoto, Ann Copestake
|Rajeev Sangal
|-
|2005
|Key-Sun Choi
|Robert Dale, Kam-fai Wong
|Jong-Hyeok Lee
|-
|2004
|Guangnan Ni, Benjamin Tsou
|Keh-Yih Su, Jun-ichi Tsujii
|Youqi Cao
|}

==HLT Conference==

Note: starting in 2007, "HLT" became the name of the NAACL conference (and, hopefully, of the ACL conferences when in NA). There is currently no body that represents a conference called "HLT" other than the NAACL Board.

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2006 w/ NAACL
|
|
|
|-
|2005 w/ EMNLP
|
|
|
|-
|2004 w/ NAACL
|
|
|
|-
|2003 w/ NAACL
|
|
|
|-
|2002
|Mitch Marcus, David Yarowsky
|
|
|-
|2001
|James Allan, Mitch Marcus
|
|
|}

==EMNLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''General Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2014
|Alessandro Moschitti
|Bo Pang, Walter Daelemans
|Kareem Darwish
|-
|2013
|David Yarowsky
|Tim Baldwin, Anna Korhonen
|
|-
|2012
|
|Jun'ichi Tsujii, James Henderson, Marius Pasca
|Gary Geunbae Lee, Jong C. Park
|-
|2011
|
|Paola Merlo, Regina Barzilay, Mark Johnson
|Bonnie Webber
|-
|2010
|
|Hang Li, Lluís Màrquez
|Regina Barzilay
|-
|2009
|
|Philipp Koehn, Rada Mihalcea
|Haizhou Li
|-
|2008
|
|Mirella Lapata, Hwee Tou Ng
|Priscilla Rasmussen
|-
|2007 w/ CoNLL
|
|Jason Eisner
|Jan Hajic
|-
|2006
|
|Dan Jurafsky, Eric Gaussier
|James Curran
|-
|2005
|
|Chris Brew, Lee-Feng Chien, Katrin Kirchhoff
|Priscilla Rasmussen
|-
|2004
|
|Dekang Lin, Dekai Wu
|
|-
|2003
|
|Michael Collins, Mark Steedman
|
|-
|2002
|
|Jan Hajic, Yuji Matsumoto
|
|-
|2001
|
|Lillian Lee, Donna Harman
|
|-
|2000
|
|Hinrich Schuetze, Keh-Yih Su
|
|-
|1999
|
|Pascale Fung, Joe Zhou
|
|-
|1998 held as EMNLP
|
|Nancy Ide, Atro Voutilainen
|
|-
|1998 held as VLC
|
|Eugene Charniak
|
|-
|1997 held as EMNLP
|
|Claire Cardie, Ralph Weischedel
|
|-
|1997 held as VLC
|
|Huang Changning, Ken Church, Joe Zhou
|
|-
|1996 held as EMNLP
|
|Eric Brill, Kenneth Church
|
|-
|1996 held as VLC
|
|Eva Ejerhed, Ido Dagan
|
|-
|1995 held as VLC
|
|Kenneth Church, David Yarowsky
|Robert Berwick
|-
|1994 held as VLC
|
|Pierre Isabelle, Kenneth Church
|
|-
|1993 held as VLC
|
|Kenneth Church
|Terry Patten, Robert Kasper
|}

POS Tagging (State of the art)

2013-05-06T03:57:22Z

ChristopherManning: Edit license info

==Test collections==
* '''Performance measure:''' per token accuracy. (The convention is for this to be measured on all tokens, including punctuation tokens and other unambiguous tokens.)
* '''English'''
** '''Penn Treebank''' ''Wall Street Journal'' (WSJ) release 3 (LDC99T42). The splits of data for this task were not standardized early on (unlike for parsing) and early work uses various data splits defined by counts of tokens or by sections. Most work from 2002 on adopts the following data splits, introduced by Collins (2002):
*** '''Training data:''' sections 0-18
*** '''Development test data:''' sections 19-21
*** '''Testing data:''' sections 22-24

* '''French'''
** '''French TreeBank''' (FTB, Abeillé et al; 2003) ''Le Monde'', December 2007 version, 28-tag tagset (CC tagset, Crabbé and Candito, 2008). Classical data split (10-10-80):
*** '''Training data:''' sentences 2471 to 12351
*** '''Development test data:''' sentences 1236 to 2470
*** '''Testing data:''' sentences 1 to 1235

== Tables of results ==

===WSJ===

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publication
! Software
! Extra Data?***
! All tokens
! Unknown words
! License
|-
| TnT*
| Hidden markov model
| Brants (2000)
| [http://www.coli.uni-saarland.de/~thorsten/tnt/ TnT]
| No
| 96.46%
| 85.86%
| Academic/research use only ([http://www.coli.uni-saarland.de/~thorsten/tnt/tnt-license.html license])
|-
| MElt
| MEMM with external lexical information
| Denis and Sagot (2009)
| [https://gforge.inria.fr/projects/lingwb/ Alpage linguistic workbench]
| No
| 96.96%
| 91.29%
| CeCILL-C
|-
| GENiA Tagger**
| Maximum entropy cyclic dependency network
| Tsuruoka, et al (2005)
| [http://www.nactem.ac.uk/tsujii/GENIA/tagger/ GENiA]
| No
| 97.05%
| Not available
| Gratis for non-commercial usage
|-
| Averaged Perceptron
| Averaged Perception discriminative sequence model
| Collins (2002)
| Not available
| No
| 97.11%
| Not available
| Unknown
|-
| Maxent easiest-first
| Maximum entropy bidirectional easiest-first inference
| Tsuruoka and Tsujii (2005)
| [http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/postagger/ Easiest-first]
| No
| 97.15%
| Not available
| Unknown
|-
| SVMTool
| SVM-based tagger and tagger generator
| Giménez and Márquez (2004)
| [http://www.lsi.upc.es/~nlp/SVMTool/ SVMTool]
| No
| 97.16%
| 89.01%
| LGPL 2.1
|-
| LAPOS
| Perceptron based training with lookahead
| Tsuruoka, Miyao, and Kazama (2011)
| [http://www.logos.t.u-tokyo.ac.jp/~tsuruoka/lapos/ LAPOS]
| No
| 97.22%
| Not available
| MIT
|-
| Morče/COMPOST
| Averaged Perceptron
| Spoustová et al. (2009)
| [http://ufal.mff.cuni.cz/compost COMPOST]
| No
| 97.23%
| Not available
| Non-free ([http://ufal.mff.cuni.cz/compost/register.php academic-only])
|-
| Morče/COMPOST
| Averaged Perceptron
| Spoustová et al. (2009)
| [http://ufal.mff.cuni.cz/compost COMPOST]
| Yes
| 97.44%
| Not available
| Unknown
|-
| Stanford Tagger 1.0
| Maximum entropy cyclic dependency network
| Toutanova et al. (2003)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| No
| 97.24%
| 89.04%
| GPL v2+
|-
| Stanford Tagger 2.0
| Maximum entropy cyclic dependency network
| Manning (2011)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| No
| 97.29%
| 89.70%
| GPL v2+
|-
| Stanford Tagger 2.0
| Maximum entropy cyclic dependency network
| Manning (2011)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| Yes
| 97.32%
| 90.79%
| GPL v2+
|-
| LTAG-spinal
| Bidirectional perceptron learning
| Shen et al. (2007)
| [http://www.cis.upenn.edu/~xtag/spinal/ LTAG-spinal]
| No
| 97.33%
| Not available
| Unknown
|-
| SCCN
| Semi-supervised condensed nearest neighbor
| Søgaard (2011)
| [http://cst.dk/anders/scnn/ SCCN]
| Yes
| 97.50%
| Not available
| Unknown
|}

(*) TnT: Accuracy is as reported by Giménez and Márquez (2004) for the given test collection. Brants (2000) reports 96.7% token accuracy and 85.5% unknown word accuracy on a 10-fold cross-validation of the Penn WSJ corpus.

(**) GENiA: Results are for models trained and tested on the given corpora (to be comparable to other results). The distributed GENiA tagger is trained on a mixed training corpus and gets 96.94% on WSJ, and 98.26% on GENiA biomedical English.

(***) Extra data: Whether system training exploited (usually large amounts of) extra unlabeled text, such as by semi-supervised learning, self-training, or using distributional similarity features, beyond the standard supervised training data.

===FTB===

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publication
! Software
! Extra Data?***
! All tokens
! Unknown words
! License
|-
| Morfette
| Perceptron with external lexical information*
| Chrupała et al. (2008), Seddah et al. (2010)
| [http://sites.google.com/site/morfetteweb/ Morfette]
| No
| 97.68%
| 90.52%
| New BSD
|-
| SEM
| CRF with external lexical information*
| Constant et al. (2011)
| [http://www.univ-orleans.fr/lifo/Members/Isabelle.Tellier/SEM.html SEM]
| No
| 97.7%
| Not available
| "GNU"(?)
|-
| MElt
| MEMM with external lexical information*
| Denis and Sagot (2009)
| [https://gforge.inria.fr/projects/lingwb/ Alpage linguistic workbench]
| No
| 97.80%
| 91.77%
| CeCILL-C
|}

(*) External lexical information from the Lefff lexicon (Sagot 2010, [https://gforge.inria.fr/frs/?group_id=482 Alexina project])

== References ==

* Brants, Thorsten. 2000. [http://acl.ldc.upenn.edu/A/A00/A00-1031.pdf TnT -- A Statistical Part-of-Speech Tagger]. "6th Applied Natural Language Processing Conference".

* Chrupała, Grzegorz, Dinu, Georgiana and van Genabith, Josef. 2008. [http://www.lrec-conf.org/proceedings/lrec2008/pdf/594_paper.pdf Learning Morphology with Morfette]. "LREC 2008".

* Collins, Michael. 2002. [http://people.csail.mit.edu/mcollins/papers/tagperc.pdf Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms]. ''EMNLP 2002''.

* Constant, Matthieu, Tellier, Isabelle, Duchier, Denys, Dupont, Yoann, Sigogne, Anthony, and Billot, Sylvie. [http://www.lirmm.fr/~lopez/TALN2011/Longs-TALN+RECITAL/Tellier_taln11_submission_54.pdf Intégrer des connaissances linguistiques dans un CRF : application à l'apprentissage d'un segmenteur-étiqueteur du français]. "TALN'11"

* Denis, Pascal and Sagot, Benoît. 2009. [http://alpage.inria.fr/~sagot/pub/paclic09tagging.pdf Coupling an annotated corpus and a morphosyntactic lexicon for state-of-the-art POS tagging with less human effort]. "PACLIC 2009"

* Giménez, J., and Márquez, L. 2004. [http://www.lsi.upc.es/~nlp/SVMTool/lrec2004-gm.pdf SVMTool: A general POS tagger generator based on Support Vector Machines]. ''Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC'04)''. Lisbon, Portugal.

* Manning, Christopher D. 2011. Part-of-Speech Tagging from 97% to 100%: Is It Time for Some Linguistics? In Alexander Gelbukh (ed.), Computational Linguistics and Intelligent Text Processing, 12th International Conference, CICLing 2011, Proceedings, Part I. Lecture Notes in Computer Science 6608, pp. 171--189. Springer.

* Seddah, Djamé, Chrupała, Grzegorz, Çetinoglu, Özlem and Candito, Marie. 2010. [http://aclweb.org/anthology-new/W/W10/W10-1410.pdf Lemmatization and Lexicalized Statistical Parsing of Morphologically Rich Languages: the Case of French] "SPMRL 2010 (NAACL 2010 workshop)"

* Shen, L., Satta, G., and Joshi, A. 2007. [http://acl.ldc.upenn.edu/P/P07/P07-1096.pdf Guided learning for bidirectional sequence classification]. ''Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL 2007)'', pages 760-767.

* Søgaard, Anders. 2011. Semi-supervised condensed nearest neighbor for part-of-speech tagging. The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT). Portland, Oregon.

* Spoustová, Drahomíra "Johanka", Jan Hajič, Jan Raab and Miroslav Spousta. 2009. Semi-supervised Training for the Averaged Perceptron POS Tagger. Proceedings of the 12 EACL, pages 763-771.

* Toutanova, K., Klein, D., Manning, C.D., Yoram Singer, Y. 2003. [http://nlp.stanford.edu/kristina/papers/tagging.pdf Feature-rich part-of-speech tagging with a cyclic dependency network]. ''Proceedings of HLT-NAACL 2003'', pages 252-259.

* Tsuruoka, Yoshimasa, Yuka Tateishi, Jin-Dong Kim, Tomoko Ohta, John McNaught, Sophia Ananiadou, and Jun'ichi Tsujii. 2005. "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/pci05.pdf Developing a Robust Part-of-Speech Tagger for Biomedical Text, Advances in Informatics]" - ''10th Panhellenic Conference on Informatics'', '''LNCS 3746''', pp. 382-392, 2005

* Tsuruoka, Yoshimasa, Yusuke Miyao, and Jun’ichi Kazama. 2011. "[http://aclweb.org/anthology-new/W/W11/W11-0328.pdf Learning with Lookahead: Can History-Based Models Rival Globally Optimized Models?]" ''Proceedings of the Fifteenth Conference on Computational Natural Language Learning'', pp 238–246, 2011.

* Tsuruoka, Yoshimasa and Jun'ichi Tsujii. 2005. "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/emnlp05bidir.pdf Bidirectional Inference with the Easiest-First Strategy for Tagging Sequence Data]", ''Proceedings of HLT/EMNLP 2005'', pp. 467-474.

== See also ==
* [[POS Induction (State of the art)]]
* [[Part-of-speech tagging]]
* [[State of the art]]

[[Category:State of the art]]

POS Tagging (State of the art)

2012-07-02T07:43:17Z

ChristopherManning: /* WSJ */

==Test collections==
* '''Performance measure:''' per token accuracy. (The convention is for this to be measured on all tokens, including punctuation tokens and other unambiguous tokens.)
* '''English'''
** '''Penn Treebank''' ''Wall Street Journal'' (WSJ) release 3 (LDC99T42). The splits of data for this task were not standardized early on (unlike for parsing) and early work uses various data splits defined by counts of tokens or by sections. Most work from 2002 on adopts the following data splits, introduced by Collins (2002):
*** '''Training data:''' sections 0-18
*** '''Development test data:''' sections 19-21
*** '''Testing data:''' sections 22-24

* '''French'''
** '''French TreeBank''' (FTB, Abeillé et al; 2003) ''Le Monde'', December 2007 version, 28-tag tagset (CC tagset, Crabbé and Candito, 2008). Classical data split (10-10-80):
*** '''Training data:''' sentences 2471 to 12351
*** '''Development test data:''' sentences 1236 to 2470
*** '''Testing data:''' sentences 1 to 1235

== Tables of results ==

===WSJ===

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publication
! Software
! Extra Data?***
! All tokens
! Unknown words
| License
|-
| TnT*
| Hidden markov model
| Brants (2000)
| [http://www.coli.uni-saarland.de/~thorsten/tnt/ TnT]
| No
| 96.46%
| 85.86%
| Unknown
|-
| MElt
| MEMM with external lexical information
| Denis and Sagot (2009)
| [https://gforge.inria.fr/projects/lingwb/ Alpage linguistic workbench]
| No
| 96.96%
| 91.29%
| Unknown
|-
| GENiA Tagger**
| Maximum entropy cyclic dependency network
| Tsuruoka, et al (2005)
| [http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/tagger/ GENiA]
| No
| 97.05%
| Not available
| Gratis for non-commercial usage
|-
| Averaged Perceptron
| Averaged Perception discriminative sequence model
| Collins (2002)
| Not available
| No
| 97.11%
| Not available
| Unknown
|-
| Maxent easiest-first
| Maximum entropy bidirectional easiest-first inference
| Tsuruoka and Tsujii (2005)
| [http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/postagger/ Easiest-first]
| No
| 97.15%
| Not available
| Unknown
|-
| SVMTool
| SVM-based tagger and tagger generator
| Giménez and Márquez (2004)
| [http://www.lsi.upc.es/~nlp/SVMTool/ SVMTool]
| No
| 97.16%
| 89.01%
| Unknown
|-
| Morče/COMPOST
| Averaged Perceptron
| Spoustová et al. (2009)
| [http://ufal.mff.cuni.cz/compost]
| No
| 97.23%
| Not available
| Unknown
|-
| Stanford Tagger 1.0
| Maximum entropy cyclic dependency network
| Toutanova et al. (2003)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| No
| 97.24%
| 89.04%
| GPL v2+
|-
| Stanford Tagger 2.0
| Maximum entropy cyclic dependency network
| Manning (2011)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| No
| 97.29%
| 89.70%
| GPL v2+
|-
| Stanford Tagger 2.0
| Maximum entropy cyclic dependency network
| Manning (2011)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| Yes
| 97.32%
| 90.79%
| GPL v2+
|-
| LTAG-spinal
| Bidirectional perceptron learning
| Shen et al. (2007)
| [http://www.cis.upenn.edu/~xtag/spinal/ LTAG-spinal]
| No
| 97.33%
| Not available
| Unknown
|-
| Morče/COMPOST
| Averaged Perceptron
| Spoustová et al. (2009)
| [http://ufal.mff.cuni.cz/compost]
| Yes
| 97.44%
| Not available
| Unknown
|-
| SCCN
| Semi-supervised condensed nearest neighbor
| Søgaard (2011)
| [http://cst.dk/anders/scnn/ SCCN]
| Yes
| 97.50%
| Not available
| Unknown
|}

(*) TnT: Accuracy is as reported by Giménez and Márquez (2004) for the given test collection. Brants (2000) reports 96.7% token accuracy and 85.5% unknown word accuracy on a 10-fold cross-validation of the Penn WSJ corpus.

(**) GENiA: Results are for models trained and tested on the given corpora (to be comparable to other results). The distributed GENiA tagger is trained on a mixed training corpus and gets 96.94% on WSJ, and 98.26% on GENiA biomedical English.

(***) Extra data: Whether system training exploited (usually large amounts of) extra unlabeled text, such as by semi-supervised learning, self-training, or using distributional similarity features, beyond the standard supervised training data.

===FTB===

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publication
! Software
! Extra Data?***
! All tokens
! Unknown words
|-
| Morfette
| Perceptron with external lexical information*
| Chrupała et al. (2008), Seddah et al. (2010)
| [http://sites.google.com/site/morfetteweb/ Morfette]
| No
| 97.68%
| 90.52%
|-
| SEM
| CRF with external lexical information*
| Constant et al. (2011)
| [http://www.univ-orleans.fr/lifo/Members/Isabelle.Tellier/SEM.html SEM]
| No
| 97.7%
| Not available
|-
| MElt
| MEMM with external lexical information*
| Denis and Sagot (2009)
| [https://gforge.inria.fr/projects/lingwb/ Alpage linguistic workbench]
| No
| 97.80%
| 91.77%
|}

(*) External lexical information from the Lefff lexicon (Sagot 2010, [https://gforge.inria.fr/frs/?group_id=482 Alexina project])

== References ==

* Brants, Thorsten. 2000. [http://acl.ldc.upenn.edu/A/A00/A00-1031.pdf TnT -- A Statistical Part-of-Speech Tagger]. "6th Applied Natural Language Processing Conference".

* Chrupała, Grzegorz, Dinu, Georgiana and van Genabith, Josef. 2008. [http://www.lrec-conf.org/proceedings/lrec2008/pdf/594_paper.pdf Learning Morphology with Morfette]. "LREC 2008".

* Collins, Michael. 2002. [http://people.csail.mit.edu/mcollins/papers/tagperc.pdf Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms]. ''EMNLP 2002''.

* Constant, Matthieu, Tellier, Isabelle, Duchier, Denys, Dupont, Yoann, Sigogne, Anthony, and Billot, Sylvie. [http://www.lirmm.fr/~lopez/TALN2011/Longs-TALN+RECITAL/Tellier_taln11_submission_54.pdf Intégrer des connaissances linguistiques dans un CRF : application à l'apprentissage d'un segmenteur-étiqueteur du français]. "TALN'11"

* Denis, Pascal and Sagot, Benoît. 2009. [http://alpage.inria.fr/~sagot/pub/paclic09tagging.pdf Coupling an annotated corpus and a morphosyntactic lexicon for state-of-the-art POS tagging with less human effort]. "PACLIC 2009"

* Giménez, J., and Márquez, L. 2004. [http://www.lsi.upc.es/~nlp/SVMTool/lrec2004-gm.pdf SVMTool: A general POS tagger generator based on Support Vector Machines]. ''Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC'04)''. Lisbon, Portugal.

* Manning, Christopher D. 2011. Part-of-Speech Tagging from 97% to 100%: Is It Time for Some Linguistics? In Alexander Gelbukh (ed.), Computational Linguistics and Intelligent Text Processing, 12th International Conference, CICLing 2011, Proceedings, Part I. Lecture Notes in Computer Science 6608, pp. 171--189. Springer.

* Seddah, Djamé, Chrupała, Grzegorz, Çetinoglu, Özlem and Candito, Marie. 2010. [http://aclweb.org/anthology-new/W/W10/W10-1410.pdf Lemmatization and Lexicalized Statistical Parsing of Morphologically Rich Languages: the Case of French] "SPMRL 2010 (NAACL 2010 workshop)"

* Shen, L., Satta, G., and Joshi, A. 2007. [http://acl.ldc.upenn.edu/P/P07/P07-1096.pdf Guided learning for bidirectional sequence classification]. ''Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL 2007)'', pages 760-767.

* Søgaard, Anders. 2011. Semi-supervised condensed nearest neighbor for part-of-speech tagging. The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL-HLT). Portland, Oregon.

* Spoustová, Drahomíra "Johanka", Jan Hajič, Jan Raab and Miroslav Spousta. 2009. Semi-supervised Training for the Averaged Perceptron POS Tagger. Proceedings of the 12 EACL, pages 763-771.

* Toutanova, K., Klein, D., Manning, C.D., Yoram Singer, Y. 2003. [http://nlp.stanford.edu/kristina/papers/tagging.pdf Feature-rich part-of-speech tagging with a cyclic dependency network]. ''Proceedings of HLT-NAACL 2003'', pages 252-259.

* Tsuruoka, Yoshimasa, Yuka Tateishi, Jin-Dong Kim, Tomoko Ohta, John McNaught, Sophia Ananiadou, and Jun'ichi Tsujii. 2005. "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/pci05.pdf Developing a Robust Part-of-Speech Tagger for Biomedical Text, Advances in Informatics]" - ''10th Panhellenic Conference on Informatics'', '''LNCS 3746''', pp. 382-392, 2005

* Tsuruoka, Yoshimasa and Jun'ichi Tsujii. 2005. "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/emnlp05bidir.pdf Bidirectional Inference with the Easiest-First Strategy for Tagging Sequence Data]", ''Proceedings of HLT/EMNLP 2005'', pp. 467-474.

== See also ==
* [[POS Induction (State of the art)]]
* [[Part-of-speech tagging]]
* [[State of the art]]

[[Category:State of the art]]

POS Tagging (State of the art)

2011-09-13T15:49:31Z

ChristopherManning: /* References */

POS Tagging (State of the art)

2011-09-13T15:46:27Z

ChristopherManning: /* Test collections */

POS Tagging (State of the art)

2011-09-13T15:44:39Z

ChristopherManning: /* WSJ */

Conference Chairs

2011-02-22T07:02:58Z

ChristopherManning:

For more conference chairs, see [[Additional conference chairs]].

==ACL Conference==

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2011
|Dekang Lin
|Rada Mihalcea, Yuji Matsumoto
|Brian Roark
|-
|2010
|Jan Hajic
|Sandra Carberry, Stephen Clark
|Joakim Nivre
|-
|2009 w/ IJCNLP
|Keh-Yih Su
|Jian Su, Janyce Wiebe
|Haizhou Li
|-
|2008 w/ NAACL HLT
|Kathleen McKeown
|Johanna Moore, Simone Teufel, Sadaoki Furui (speech), James Allan (IR)
|Chris Brew
|-
|2007
|John Carroll
|Annie Zaenen, Antal van den Bosch
|Eva Hajicova
|-
|2006 w/ COLING
|Nicoletta Calzolari
|Claire Cardie, Pierre Isabelle
|Robert Dale, Cecile Paris
|-
|2005 w/ NAACL
|Kevin Knight
|Hwee Tou Ng, Kemal Oflazer
|Dragomir Radev
|-
|2004
|Donia Scott
|Walter Daelemans, Marilyn Walker
|Toni Badia
|-
|2003
|Jun'ichi Tsujii
|Erhard Hinrichs, Dan Roth
|Kenji Araki
|-
|2002 w/ NAACL
|Pierre Isabelle
|Eugene Charniak, Dekang Lin
|Martha Palmer
|-
|2001
|Bonnie Webber
|Norbert Reithinger, Giorgio Satta
|Patrick Saint-Dizier
|-
|2000
|Hitoshi Iida
|K. Vijay-Shanker, Chang-Ning Huang
|Dekai Wu
|-
|1999
|
|Robert Dale, Ken Church
|Bonnie Dorr
|-
|1998 w/COLING
|
|Christian Boitet, Pete Whitelock
|Pierre Isabelle
|-
|1997
|
|Philip Cohen ,Wolfgang Wahlster
|Maria Felisa Verdejo
|-
|1996
|
|Aravind Joshi, Martha Palmer
|Douglas Appelt, Geoffrey Pullum
|-
|1995
|
|Hans Uszkoreit
|Robert Berwick
|-
|1994
|
|James Pustejovsky
|Janyce Wiebe
|-
|1993
|
|Lenhart Schubert
|Terry Patten, Robert Kasper
|-
|1992
|
|Henry Thompson
|Sandra Carberry, Dan Chester, Kathleen McCoy
|-
|1991
|
|Douglas Appelt
|Peter Norvig
|-
|1990
|
|Robert Berwick
|Rich Thomason
|-
|1989
|
|Julia Hirschberg
|Richard Rosenberg
|-
|1988
|
|Jerry Hobbs
|William Rappaport
|-
|1987
|
|Candy Sidner
|Douglas Appelt
|-
|1986
|
|Alan Biermann
|Kathleen McKeown, Cecile Paris
|-
|1985
|
|William Mann
|Martha Evens, Victor Yngve
|-
|1984
|
|
|
|-
|1983
|
|Mitch Marcus
|Jon Allen
|-
|1982
|
|Madeleine Bates
|C. Raymond Perrault
|-
|1981
|
|C. Raymond Perrault
|Jerry Kaplan
|-
|1980
|Norman Sondheimer ?
|Gary Hendrix
|Kathleen McKeown
|-
|1979
|
|Norman Sondheimer
|Jim Levin
|}

==NAACL Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2010
|Ronald Kaplan
|Jill Burstein, Mary Harper, Gerald Penn
|David Chiang, Eduard Hovy, Jonathan May, Jason Riesa
|-
|2009
|Mari Ostendorf
|Michael Collins, Lucy Vanderwende, Doug Oard, Shri Narayanan
|Martha Palmer and James Martin
|-|-
|2008 w/ ACL
|
|
|
|-
|2007 w/ HLT
|Candace Sidner
|Tanja Schultz, Matthew Stone, ChengXiang Zhai
|James Allen, Daniel Gildea, Lenhart Schubert
|-
|2006 w/ HLT
|Robert C. Moore
|Jennifer Chu-Carroll, Jeff Bilmes, Mark Sanderson
|Satoshi Sekine
|-
|2005 w/ ACL
|
|
|
|-
|2004 w/ HLT
|Julia Hirschberg
|Susan Dumais, Daniel Marcu, Salim Roukos
|Christine Doran
|-
|2003 w/ HLT
||Eduard Hovy
|Marti Hearst, Mari Ostendorf
|Dekang Lin
|-
|2002 w/ ACL
|
|
|
|-
|2001
|Lori Levin
|Kevin Knight
|Alon Lavie
|-
|2000 w/ ANLP
|Marie Meteer
|Janyce Wiebe, Sergei Nirenburg
|Rick Wojcik
|}

==ANLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2000 w/ NAACL
|
|
|
|-
|1997
|
|Ralph Grishman
|John White
|-
|1994
|
|
|
|-
|1992
|
|
|
|-
|1988
|
|
|
|-
|1983
|
|
|
|}

==EACL Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2009
|
|
|
|-
|2006
|
|Diana McCarthy, Shuly Wintner
|Bernardo Magnini, Alberto Lavelli
|-
|2003
|Claire Gardent
|Ann Copestake, Jan Hajic
|Ferenc Kiefer
|-
|-
|1999
|
|Henry Thompson, Alex Lascarides
|Koenraad de Smedt
|-
|1997 w/ ACL
|
|
|
|-
|1993
|
|Steven Krauwer, Michael Moortgat, Louis des Tombe
|Renee Pohlmann
|-
|1991
|
|Jurgen Kunze, Dorothee Reimann
|
|-
|1989
|
|Harold Somers, Mary McGee Wood
|
|-
|1987
|
|Bente Maegaard
|Rolf Christensen
|-
|1985
|
|Maghi King
|Michael Rosner
|-
|1983
|Antonio Zampolli
|Giacomo Ferrari|
|
|}

==COLING Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2006 w/ ACL
|
|
|
|-
|2004
|Martin Kay
|Sergei Nirenburg
|Margaret King
|-
|2002
|
|Winfried Lenders
|Chu-Ren Huang, Sharon Wang
|-
|2000
|
|Martin Kay
|Hans Uszkoreit
|-
|1998 w/ ACL
|
|
|
|-
|1996
|
|J. Tsujii
|B. Maegaard
|-
|1990
|
|
|
|-
|1988
|
|
|
|-
|1984
|
|
|
|}

==IJCNLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2009 w/ ACL
|Keh-Yih Su
|Jian Su, Janyce Wiebe
|Haizhou Li
|-
|2008
|Jong-Hyeok Lee
|Yuji Matsumoto, Ann Copestake
|Rajeev Sangal
|-
|2005
|Key-Sun Choi
|Robert Dale, Kam-fai Wong
|Jong-Hyeok Lee
|-
|2004
|Guangnan Ni, Benjamin Tsou
|Keh-Yih Su, Jun-ichi Tsujii
|Youqi Cao
|}

==HLT Conference==

Note: starting in 2007, "HLT" became the name of the NAACL conference (and, hopefully, of the ACL conferences when in NA). There is currently no body that represents a conference called "HLT" other than the NAACL Board.

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2006 w/ NAACL
|
|
|
|-
|2005 w/ EMNLP
|
|
|
|-
|2004 w/ NAACL
|
|
|
|-
|2003 w/ NAACL
|
|
|
|-
|2002
|Mitch Marcus, David Yarowsky
|
|
|-
|2001
|James Allan, Mitch Marcus
|
|
|}

==EMNLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2010
|Hang Li, Lluís Màrquez
|Regina Barzilay
|-
|2009
|Philipp Koehn, Rada Mihalcea
|Haizhou Li
|-
|2008
|Mirella Lapata, Hwee Tou Ng
|Priscilla Rasmussen
|-
|2007 w/ CoNLL
|Jason Eisner
|Jan Hajic
|-
|2006
|Dan Jurafsky, Eric Gaussier
|James Curran
|-
|2005
|Chris Brew, Lee-Feng Chien, Katrin Kirchhoff
|Priscilla Rasmussen
|-
|2004
|Dekang Lin, Dekai Wu
|
|-
|2003
|Michael Collins, Mark Steedman
|
|-
|2002
|Jan Hajic, Yuji Matsumoto
|
|-
|2001
|Lillian Lee, Donna Harman
|
|-
|2000
|Hinrich Schuetze, Keh-Yih Su
|
|-
|1999
|Pascale Fung, Joe Zhou
|
|-
|1998 held as EMNLP
|Nancy Ide
|
|-
|1998 held as VLC
|
|
|-
|1997 held as EMNLP
|
|
|-
|1997 held as VLC
|Huang Changning, Ken Church, Joe Zhou
|
|-
|1996 held as EMNLP
|
|
|-
|1996 held as VLC
|Eva Ejerhed, Ido Dagan
|
|-
|1995 held as VLC
|Hans Uszkoreit
|Robert Berwick
|-
|1994 held as VLC
|
|
|-
|1993 held as VLC
|Lenhart Schubert
|Terry Patten, Robert Kasper
|}

Conference Chairs

2011-02-22T06:30:36Z

ChristopherManning:

For more conference chairs, see [[Additional conference chairs]].

==ACL Conference==

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2011
|Dekang Lin
|Rada Mihalcea, Yuji Matsumoto
|Brian Roark
|-
|2010
|Jan Hajic
|Sandra Carberry, Stephen Clark
|Joakim Nivre
|-
|2009 w/ IJCNLP
|Keh-Yih Su
|Jian Su, Janyce Wiebe
|Haizhou Li
|-
|2008 w/ NAACL HLT
|Kathleen McKeown
|Johanna Moore, Simone Teufel, Sadaoki Furui (speech), James Allan (IR)
|Chris Brew
|-
|2007
|John Carroll
|Annie Zaenen, Antal van den Bosch
|Eva Hajicova
|-
|2006 w/ COLING
|Nicoletta Calzolari
|Claire Cardie, Pierre Isabelle
|Robert Dale, Cecile Paris
|-
|2005 w/ NAACL
|Kevin Knight
|Hwee Tou Ng, Kemal Oflazer
|Dragomir Radev
|-
|2004
|Donia Scott
|Walter Daelemans, Marilyn Walker
|Toni Badia
|-
|2003
|Jun'ichi Tsujii
|Erhard Hinrichs, Dan Roth
|Kenji Araki
|-
|2002 w/ NAACL
|Pierre Isabelle
|Eugene Charniak, Dekang Lin
|Martha Palmer
|-
|2001
|Bonnie Webber
|Norbert Reithinger, Giorgio Satta
|Patrick Saint-Dizier
|-
|2000
|Hitoshi Iida
|K. Vijay-Shanker, Chang-Ning Huang
|Dekai Wu
|-
|1999
|
|Robert Dale, Ken Church
|Bonnie Dorr
|-
|1998 w/COLING
|
|Christian Boitet, Pete Whitelock
|Pierre Isabelle
|-
|1997
|
|Philip Cohen ,Wolfgang Wahlster
|Maria Felisa Verdejo
|-
|1996
|
|Aravind Joshi, Martha Palmer
|Douglas Appelt, Geoffrey Pullum
|-
|1995
|
|Hans Uszkoreit
|Robert Berwick
|-
|1994
|
|James Pustejovsky
|Janyce Wiebe
|-
|1993
|
|Lenhart Schubert
|Terry Patten, Robert Kasper
|-
|1992
|
|Henry Thompson
|Sandra Carberry, Dan Chester, Kathleen McCoy
|-
|1991
|
|Douglas Appelt
|Peter Norvig
|-
|1990
|
|Robert Berwick
|Rich Thomason
|-
|1989
|
|Julia Hirschberg
|Richard Rosenberg
|-
|1988
|
|Jerry Hobbs
|William Rappaport
|-
|1987
|
|Candy Sidner
|Douglas Appelt
|-
|1986
|
|Alan Biermann
|Kathleen McKeown, Cecile Paris
|-
|1985
|
|William Mann
|Martha Evens, Victor Yngve
|-
|1984
|
|
|
|-
|1983
|
|Mitch Marcus
|Jon Allen
|-
|1982
|
|Madeleine Bates
|C. Raymond Perrault
|-
|1981
|
|C. Raymond Perrault
|Jerry Kaplan
|-
|1980
|Norman Sondheimer ?
|Gary Hendrix
|Kathleen McKeown
|-
|1979
|
|Norman Sondheimer
|Jim Levin
|}

==NAACL Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2009
|Mari Ostendorf
|Michael Collins, Lucy Vanderwende, Doug Oard, and Shri Narayanan
|Martha Palmer and James Martin
|-|-
|2008 w/ ACL
|
|
|
|-
|2007 w/ HLT
|Candace Sidner
|Tanja Schultz, Matthew Stone, ChengXiang Zhai
|James Allen, Daniel Gildea, Lenhart Schubert
|-
|2006 w/ HLT
|Robert C. Moore
|Jennifer Chu-Carroll, Jeff Bilmes, Mark Sanderson
|Satoshi Sekine
|-
|2005 w/ ACL
|
|
|
|-
|2004 w/ HLT
|Julia Hirschberg
|Susan Dumais, Daniel Marcu, Salim Roukos
|Christine Doran
|-
|2003 w/ HLT
||Eduard Hovy
|Marti Hearst, Mari Ostendorf
|Dekang Lin
|-
|2002 w/ ACL
|
|
|
|-
|2001
|Lori Levin
|Kevin Knight
|Alon Lavie
|-
|2000 w/ ANLP
|Marie Meteer
|Janyce Wiebe, Sergei Nirenburg
|Rick Wojcik
|}

==ANLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2000 w/ NAACL
|
|
|
|-
|1997
|
|Ralph Grishman
|John White
|-
|1994
|
|
|
|-
|1992
|
|
|
|-
|1988
|
|
|
|-
|1983
|
|
|
|}

==EACL Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2009
|
|
|
|-
|2006
|
|Diana McCarthy, Shuly Wintner
|Bernardo Magnini, Alberto Lavelli
|-
|2003
|Claire Gardent
|Ann Copestake, Jan Hajic
|Ferenc Kiefer
|-
|-
|1999
|
|Henry Thompson, Alex Lascarides
|Koenraad de Smedt
|-
|1997 w/ ACL
|
|
|
|-
|1993
|
|Steven Krauwer, Michael Moortgat, Louis des Tombe
|Renee Pohlmann
|-
|1991
|
|Jurgen Kunze, Dorothee Reimann
|
|-
|1989
|
|Harold Somers, Mary McGee Wood
|
|-
|1987
|
|Bente Maegaard
|Rolf Christensen
|-
|1985
|
|Maghi King
|Michael Rosner
|-
|1983
|Antonio Zampolli
|Giacomo Ferrari|
|
|}

==COLING Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2006 w/ ACL
|
|
|
|-
|2004
|Martin Kay
|Sergei Nirenburg
|Margaret King
|-
|2002
|
|Winfried Lenders
|Chu-Ren Huang, Sharon Wang
|-
|2000
|
|Martin Kay
|Hans Uszkoreit
|-
|1998 w/ ACL
|
|
|
|-
|1996
|
|J. Tsujii
|B. Maegaard
|-
|1990
|
|
|
|-
|1988
|
|
|
|-
|1984
|
|
|
|}

==IJCNLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2009 w/ ACL
|Keh-Yih Su
|Jian Su, Janyce Wiebe
|Haizhou Li
|-
|2008
|Jong-Hyeok Lee
|Yuji Matsumoto, Ann Copestake
|Rajeev Sangal
|-
|2005
|Key-Sun Choi
|Robert Dale, Kam-fai Wong
|Jong-Hyeok Lee
|-
|2004
|Guangnan Ni, Benjamin Tsou
|Keh-Yih Su, Jun-ichi Tsujii
|Youqi Cao
|}

==HLT Conference==

Note: starting in 2007, "HLT" became the name of the NAACL conference (and, hopefully, of the ACL conferences when in NA). There is currently no body that represents a conference called "HLT" other than the NAACL Board.

{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Conference Chair'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2006 w/ NAACL
|
|
|
|-
|2005 w/ EMNLP
|
|
|
|-
|2004 w/ NAACL
|
|
|
|-
|2003 w/ NAACL
|
|
|
|-
|2002
|Mitch Marcus, David Yarowsky
|
|
|-
|2001
|James Allan, Mitch Marcus
|
|
|}

==EMNLP Conference==
{| border="1" cellspacing="0" cellpadding="5"
|'''Year'''
|'''Program Chair'''
|'''Local Arrangements Chair'''
|-
|2010
|Hang Li, Lluís Màrquez
|Regina Barzilay
|-
|2009
|Philipp Koehn, Rada Mihalcea
|Haizhou Li
|-
|2008
|Mirella Lapata, Hwee Tou Ng
|Priscilla Rasmussen
|-
|2007 w/ CoNLL
|Jason Eisner
|Jan Hajic
|-
|2006
|Dan Jurafsky, Eric Gaussier
|James Curran
|-
|2005
|Chris Brew, Lee-Feng Chien, Katrin Kirchhoff
|Priscilla Rasmussen
|-
|2004
|Dekang Lin, Dekai Wu
|
|-
|2003
|Michael Collins, Mark Steedman
|
|-
|2002
|Jan Hajic, Yuji Matsumoto
|
|-
|2001
|Lillian Lee, Donna Harman
|
|-
|2000
|Hinrich Schuetze, Keh-Yih Su
|
|-
|1999
|Pascale Fung, Joe Zhou
|
|-
|1998 held as EMNLP
|Nancy Ide
|
|-
|1998 held as VLC
|
|
|-
|1997 held as EMNLP
|
|
|-
|1997 held as VLC
|Huang Changning, Ken Church, Joe Zhou
|
|-
|1996 held as EMNLP
|
|
|-
|1996 held as VLC
|Eva Ejerhed, Ido Dagan
|
|-
|1995 held as VLC
|Hans Uszkoreit
|Robert Berwick
|-
|1994 held as VLC
|
|
|-
|1993 held as VLC
|Lenhart Schubert
|Terry Patten, Robert Kasper
|}

Parsing (State of the art)

2010-01-03T00:28:31Z

ChristopherManning: Corrected training data range

* '''Performance measure:''' PARSEVAL - the [http://nlp.cs.nyu.edu/evalb/ evalb] program
* '''Training data:''' sections 2-21 of Wall Street Journal corpus
* '''Testing data:''' section 23 of Wall Street Journal corpus

== Table of results ==

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publications
! Software
! Results (PARSEVAL)
! Comments
|-
| Charniak & Johnson's Parser
| Lexicalized N-Best PCFG + Discriminative reranking
| Johnson and Charniak (2005)
| [http://www.cog.brown.edu/~mj/Software.htm Download]
| 91.4%
| also works well on Brown
|-
| Self-trained Charniak & Johnson Parser
| Above + self-training on ~2 million raw sentences from NANC
| McClosky, Charniak, and Johnson (2006)
| [http://www.cs.brown.edu/~dmccm/selftraining Download]
| 92.1%
| also works well on Brown
|-
| Collins' Parser
| Lexicalized PCFG
| Collins (1999), Bikel (2004)
| [http://www.cis.upenn.edu/~dbikel/software.html Dan Bikel's implementation]
| ?
| ?
|-
| Berkeley Parser
| Automatically induced PCFG
| Petrov et al. (2006), Petrov and Klein (2007)
| [http://nlp.cs.berkeley.edu/Main.html#Parsing Berkeley Parser]
| 90.1%
| works well also for Chinese and German
|-
| Link Grammar
| Dependency grammar
| Temperley, Sleator, Lafferty, others (1995-2006)
| [http://www.abisource.com/projects/link-grammar/ Actively supported project]
| ?
| Persian, Arabic, Chinese, German, Russian dictionaries have been developed.
|-
|}

== References ==

Bikel, D. (2004). ''[http://www.cis.upenn.edu/~dbikel/papers/thesis.pdf On The Parameter Space of Generative Lexicalized Statistical Parsing Models]''. PhD Thesis, Computer and Information Science, University of Pennsylvania.

Collins, M. (1999). ''[http://people.csail.mit.edu/mcollins/papers/thesis.ps Head-driven Statistical Models for Natural Language Parsing]''. PhD Thesis, Computer and Information Science, University of Pennsylvania.

Charniak, E. and Johnson, M. (2005). [http://acl.ldc.upenn.edu/P/P05/P05-1022.pdf Coarse-to-fine n-best parsing and MaxEnt discriminative reranking]. ''Proceedings of the 43rd Annual Meeting of the ACL'', pages 173–180, Ann Arbor, June 2005.

McClosky, D., Charniak, E., and Johnson, M. (2006) [http://www.aclweb.org/anthology/N/N06/N06-1020.pdf Effective Self-Training for Parsing]. ''Proceedings of HLT/NAACL 2006'', pages 152-159, New York City, USA, June 2006.

Petrov, S., Barrett, L., Thibaux, R., and Klein, D. (2006). [http://www.eecs.berkeley.edu/~petrov/data/acl06.pdf Learning accurate, compact, and interpretable tree annotation]. ''Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the ACL'', pages 433–440, Sydney.

Petrov, S., and Klein, D. (2007). [http://www.eecs.berkeley.edu/~petrov/data/naacl07.pdf Improved inference for unlexicalized parsing]. ''Proceedings of NAACL 2007'', pages 404-411.

Sleator, Daniel & Davy Temperly (1993) "[http://www.cs.cmu.edu/afs/cs.cmu.edu/project/link/pub/www/papers/ps/LG-IWPT93.pdf Parsing English with a Link Grammar]", ''Third International Workshop on Parsing Technologies''.

== See also ==

* [[State of the art]]

== External links ==

* PARSEVAL - the [http://nlp.cs.nyu.edu/evalb/ evalb] program

[[Category:State of the art]]

POS Tagging (State of the art)

2010-01-03T00:23:46Z

ChristopherManning: Clean up citations and performance numbers for Tsuruoka taggers; add current Stanford tagger performance.

POS Tagging (State of the art)

2010-01-02T19:37:37Z

ChristopherManning: Adding unknown words accuracies, where available.

POS Tagging (State of the art)

2010-01-02T04:34:28Z

ChristopherManning:

* '''Performance measure:''' per token accuracy. (The convention is for this to be measured on all tokens, including punctuation tokens and other unambiguous tokens.)

==Test collections==
* '''English'''
** '''Penn Treebank''' ''Wall Street Journal'' (WSJ). The splits of data for this data set were not standardized early on (unlike for parsing) and early work uses various data splits defined by counts of tokens or by sections. Most work from 2002 on adopts the following data splits, introduced by Collins (2002):
*** '''Training data:''' sections 0-18
*** '''Development test data:''' sections 19-21
*** '''Testing data:''' sections 22-24

== Tables of results ==

===WSJ===

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publications
! Software
! All tokens
! Unknown words
|-
| Averaged Perceptron
| Averaged Perception discriminative sequence model
| Collins (2002)
| Not available
| 97.11%
| Not available
|-
| SVMTool
| SVM-based tagger and tagger generator
| Giménez and Márquez (2004)
| [http://www.lsi.upc.es/~nlp/SVMTool/ SVMTool]
| 97.16%
| 89.01%
|-
| Stanford Tagger 1.0
| maximum entropy cyclic dependency network
| Toutanova et al. (2003)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| 97.24%
|-
| LTAG-spinal
| bidirectional perceptron learning
| Shen et al. (2007)
| [http://www.cis.upenn.edu/~xtag/spinal/ LTAG-spinal]
| 97.33%
|-
| GENiA Tagger
| ?
| Tsuruoka, et al (2005)
| [http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/tagger/ GENiA]
| 96.94% on WSJ, 98.26% on biomed.
|-
|}

== References ==

* Collins, Michael. 2002. [http://people.csail.mit.edu/mcollins/papers/tagperc.pdf Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms]. ''EMNLP 2002''.

* Giménez, J., and Márquez, L. 2004. [http://www.lsi.upc.es/~nlp/SVMTool/lrec2004-gm.pdf SVMTool: A general POS tagger generator based on Support Vector Machines]. ''Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC'04)''. Lisbon, Portugal.

* Shen, L., Satta, G., and Joshi, A. 2007. [http://acl.ldc.upenn.edu/P/P07/P07-1096.pdf Guided learning for bidirectional sequence classification]. ''Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL 2007)'', pages 760-767.

* Toutanova, K., Klein, D., Manning, C.D., Yoram Singer, Y. 2003. [http://nlp.stanford.edu/kristina/papers/tagging.pdf Feature-rich part-of-speech tagging with a cyclic dependency network]. ''Proceedings of HLT-NAACL 2003'', pages 252-259.

* Tsuruoka, Yoshimasa, Yuka Tateishi, Jin-Dong Kim, Tomoko Ohta, John McNaught, Sophia Ananiadou, and Jun'ichi Tsujii. 2005. "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/pci05.pdf Developing a Robust Part-of-Speech Tagger for Biomedical Text, Advances in Informatics]" - ''10th Panhellenic Conference on Informatics'', '''LNCS 3746''', pp. 382-392, 2005

* Tsuruoka, Yoshimasa and Jun'ichi Tsujii. 2005. "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/emnlp05bidir.pdf Bidirectional Inference with the Easiest-First Strategy for Tagging Sequence Data]", ''Proceedings of HLT/EMNLP 2005'', pp. 467-474.

== See also ==
* [[Part-of-speech tagging]]
* [[State of the art]]

[[Category:State of the art]]

POS Tagging (State of the art)

2010-01-02T03:09:30Z

ChristopherManning:

* '''Performance measure:''' per token accuracy. (The convention is for this to be measured on all tokens, including punctuation tokens and other unambiguous tokens.)
* '''Training data:''' sections 0-18 of Wall Street Journal corpus
* '''Testing data:''' sections 22-24 of Wall Street Journal corpus

== Table of results ==

{| border="1" cellpadding="5" cellspacing="1" width="100%"
|-
! System name
! Short description
! Main publications
! Software
! Results
|-
| SVMTool
| SVM-based tagger and tagger generator
| Giménez and Márquez (2004)
| [http://www.lsi.upc.es/~nlp/SVMTool/ SVMTool]
| 97.16%
|-
| Stanford Tagger
| learning with cyclic dependency network
| Toutanova et al. (2003)
| [http://nlp.stanford.edu/software/tagger.shtml Stanford Tagger]
| 97.24%
|-
| LTAG-spinal
| bidirectional perceptron learning
| Shen et al. (2007)
| [http://www.cis.upenn.edu/~xtag/spinal/ LTAG-spinal]
| 97.33%
|-
| GENiA Tagger
| ?
| Tsuruoka, et al (2005)
| [http://www-tsujii.is.s.u-tokyo.ac.jp/GENIA/tagger/ GENiA]
| 96.94% on WSJ, 98.26% on biomed.
|-
|}

== References ==

* Giménez, J., and Márquez, L. (2004). [http://www.lsi.upc.es/~nlp/SVMTool/lrec2004-gm.pdf SVMTool: A general POS tagger generator based on Support Vector Machines]. ''Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC'04)''. Lisbon, Portugal.

* Shen, L., Satta, G., and Joshi, A. (2007). [http://acl.ldc.upenn.edu/P/P07/P07-1096.pdf Guided learning for bidirectional sequence classification]. ''Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (ACL 2007)'', pages 760-767.

* Toutanova, K., Klein, D., Manning, C.D., Yoram Singer, Y. (2003) [http://nlp.stanford.edu/kristina/papers/tagging.pdf Feature-rich part-of-speech tagging with a cyclic dependency network]. ''Proceedings of HLT-NAACL 2003'', pages 252-259.

* Yoshimasa Tsuruoka, Yuka Tateishi, Jin-Dong Kim, Tomoko Ohta, John McNaught, Sophia Ananiadou, and Jun'ichi Tsujii, "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/pci05.pdf Developing a Robust Part-of-Speech Tagger for Biomedical Text, Advances in Informatics]" - ''10th Panhellenic Conference on Informatics'', '''LNCS 3746''', pp. 382-392, 2005

* Yoshimasa Tsuruoka and Jun'ichi Tsujii, "[http://www-tsujii.is.s.u-tokyo.ac.jp/~tsuruoka/papers/emnlp05bidir.pdf Bidirectional Inference with the Easiest-First Strategy for Tagging Sequence Data]", ''Proceedings of HLT/EMNLP 2005'', pp. 467-474.

== See also ==
* [[Part-of-speech tagging]]
* [[State of the art]]

[[Category:State of the art]]