Difference between revisions of "Competitions and Challenges"

From ACL Wiki
Jump to navigation Jump to search
m (Reverted edits by Creek (talk) to last revision by Ioan)
 
(47 intermediate revisions by 12 users not shown)
Line 1: Line 1:
== Active Competitions and Challenges ==
+
The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year,
 +
it is placed under the year in which it was or will be completed.
  
* The 3rd [[Recognizing Textual Entailment|PASCAL Recognizing Textual Entailment Challenge and Resources Pool]]
 
* [[SemEval-2007]]
 
  
== Past Competitions and Challenges ==
+
== 2012 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [[SemEval 3]] - in planning, with tentative schedule
 +
 
 +
== 2011 ==
 +
* [http://clef2011.org/ CLEF 2011]
 +
 
 +
== 2010 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://semeval2.fbk.eu/semeval2.php SemEval 2010]
 +
* [http://nlp.uned.es/weps/weps-3/ WePS 3: searching information about entities in the Web]
 +
 
 +
== 2009 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://evalita.itc.it/ EVALITA 2009] - Evaluation of NLP Tools for Italian
 +
* [http://www.nist.gov/tac/2009/ TAC 2009] Text Analysis Conference
 +
* [http://nlp.uned.es/weps/weps-2/ WePS 2: Second Web People Search Evaluation Workshop]
 +
 
 +
== 2008 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2008/ ACE 2008] - Automatic Content Extraction (task: entity/relation detection and recognition)
 +
* [http://clef.isti.cnr.it/2008.html CLEF 2008] - Cross Language Evaluation Forum
 +
* [http://ltrc.iiit.ac.in/ner-ssea-08 NER-SSEAL 2008] - IJCNLP Workshop on NER for South and South East Asian Languages
 +
* [http://www.nist.gov/tac/tracks/2008/ TAC 2008] - Text Analysis Conference
 +
 
 +
== 2007 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
 
 +
* [http://www.nist.gov/speech/tests/ace/ace07/ ACE 2007] - Automatic Content Extraction 2007
 +
* [http://cleaneval.sigwac.org.uk/ CLEANEVAL 2007] - Cleaning pages for Web corpus creation
 +
* [http://www.clef-campaign.org/ CLEF 2007] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2007/call.html DUC-2007] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://evalita.itc.it/ EVALITA 2007] - Evaluation of NLP Tools for Italian
 +
* [http://www.computationalmedicine.org/challenge/index.php Medical NLP Challenge] - The Computational Medicine Center's 2007 Medical Natural Language Processing Challenge
 +
* [http://www.cis.hut.fi/morphochallenge2007/ Morpho Challenge 2007] - unsupervised segmentation of words into morphemes
 +
* [http://www.pascal-network.org/Challenges/RTE3 RTE-3] - Third Recognising Textual Entailment Challenge ([[Recognizing Textual Entailment|RTE-3 Resources Pool]])
 +
* [http://nlp.cs.swarthmore.edu/semeval/index.shtml SemEval-2007] - 4th International Workshop on Semantic Evaluations
 +
* [http://www.cs.utk.edu/tmw07/ SIAM Text Mining Competition] - document classification
 +
* [http://challenge.spock.com Spock Challenge] - (task: name discrimination/disambiguation in Web text)
 +
* [http://trec.nist.gov/ TREC 2007] Text REtrieval Conference
 +
 
 +
== 2006 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
 
 +
* [http://www.clef-campaign.org/ CLEF 2006] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2006/call.html DUC-2006] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://www.pascal-network.org/Challenges/RTE2/ RTE-2] - Second Recognising Textual Entailment Challenge
 +
* [http://trec.nist.gov/ TREC 2006] Text REtrieval Conference
 +
 
 +
== 2005 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
 
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2005/ ACE 2005] - Automatic Content Extraction
 +
* [http://www.clef-campaign.org/ CLEF 2005] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2005/call.html DUC-2005] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://www.cis.hut.fi/morphochallenge2005/ Morpho Challenge 2005] - unsupervised segmentation of words into morphemes
 +
* [http://www.pascal-network.org/Challenges/RTE/ RTE-1] - Recognising Textual Entailment Challenge
 +
* [http://trec.nist.gov/ TREC 2005] Text REtrieval Conference
 +
 
 +
== 2004 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
 
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2004/ ACE 2004] - Automatic Content Extraction
 +
* [http://www.clef-campaign.org/ CLEF 2004] - Cross Language Evaluation Forum
 +
* [http://duc.nist.gov/duc2004/call.html DUC-2004] - Document Understanding Conference (task: [[Text Summarization]])
 +
* [http://www.senseval.org/ Senseval 3] - evaluation exercises for [[Word Sense Disambiguation]]
 +
* [http://trec.nist.gov/ TREC 2004] Text REtrieval Conference
 +
 
 +
== 2003 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://www.itl.nist.gov./iad/894.01/tests/ace/2003/ ACE 2003] - Automatic Content Extraction
 +
* [http://duc.nist.gov/duc2003/call.html DUC-2003] - Document Understanding Conference (task: [[Text Summarization]])
 +
 
 +
== 2002 ==
 +
<!-- Please keep this list in alphabetical order -->
 +
* [http://duc.nist.gov/duc2002/call.html DUC-2002] - Document Understanding Conference (task: [[Text Summarization]])

Latest revision as of 05:14, 25 June 2012

The competitions and challenges below are categorized by year. In cases in where an event begins in one year and ends in a later year, it is placed under the year in which it was or will be completed.


2012

  • SemEval 3 - in planning, with tentative schedule

2011

2010

2009

2008

  • ACE 2008 - Automatic Content Extraction (task: entity/relation detection and recognition)
  • CLEF 2008 - Cross Language Evaluation Forum
  • NER-SSEAL 2008 - IJCNLP Workshop on NER for South and South East Asian Languages
  • TAC 2008 - Text Analysis Conference

2007

2006

2005

2004

2003

2002