Difference between revisions of "Textual Entailment Resource Pool"

From ACL Wiki
Jump to navigation Jump to search
Line 23: Line 23:
  
 
== Knowledge Resources ==
 
== Knowledge Resources ==
The [[RTE Knowledge Resources]] page presents a list of knowledge resources that have been used in the RTE challanges. It also gives access to the """Ablation test""" held in last challange and to the RTE-6 Call for Resources. The content of the page is as follows:  
+
The [[RTE Knowledge Resources]] page presents a list of knowledge resources that have been used in the RTE challanges. It also gives access to the '''Ablation tests''' held in last challange and to the RTE-6 Call for Resources. The content of the page is as follows:  
  
 
* Call for Resources
 
* Call for Resources

Revision as of 04:14, 18 June 2010

Textual entailment systems rely on many different types of NLP resources, including term banks, paraphrase lists, parsers, named-entity recognizers, etc. With so many resources being continuously released and improved, it can be difficult to know which particular resource to use when developing a system.

In response, the Recognizing Textual Entailment (RTE) shared task community initiated a new activity for building this Textual Entailment Resource Pool. RTE participants and any other member of the NLP community are encouraged to contribute to the pool.

In an effort to determine the relative impact of the resources, RTE participants are strongly encouraged to report, whenever possible, the contribution to the overall performance of each utilized resource. Formal qualitative and quantitative results should be included in a separate section of the system report as well as posted on the talk pages of this Textual Entailment Resource Pool.

Adding a new resource is very easy. See how to use existing templates to do this in Help:Using Templates.

Complete RTE Systems

RTE data sets

Knowledge Resources

The RTE Knowledge Resources page presents a list of knowledge resources that have been used in the RTE challanges. It also gives access to the Ablation tests held in last challange and to the RTE-6 Call for Resources. The content of the page is as follows:

  • Call for Resources
  • Ablation Tests
  • Publicly available Resources
  • Not available Resources
  • Footnotes

Tools

Parsers

Role Labelling

Entity Recognition Tools

Similarity / Relatedness Tools

  • UKB: Open source WordNet-based similarity/relatedness tool, includes also pre-computed semantic vectors for all words

Corpus Readers

  • NLTK provides a corpus reader for the data from RTE Challenges 1, 2, and 3 - see the Corpus Readers Guide for more information.

Related Libraries

  • PyPES general purpose library containing evaluation environment for RTE and McPIET text inference engine based on the ERG (English Resource Grammar)

Links