ACL Wiki - User contributions [en]

Textual Entailment Resource Pool

2009-06-22T14:55:49Z

Mehdad: /* Complete RTE Systems */

[[Textual Entailment|Textual entailment]] systems rely on many different types of [[Natural Language Processing|NLP]] resources, including term banks, paraphrase lists, parsers, named-entity recognizers, etc. With so many resources being continuously released and improved, it can be difficult to know which particular resource to use when developing a system.

In response, the [[Recognizing Textual Entailment|Recognizing Textual Entailment (RTE)]] shared task community initiated a new activity for building this ''Textual Entailment Resource Pool''. RTE participants and any other member of the NLP community are encouraged to contribute to the pool.

In an effort to determine the relative impact of the resources, RTE participants are strongly encouraged to report, whenever possible, the contribution to the overall performance of each utilized resource. Formal qualitative and quantitative results should be included in a separate section of the system report as well as posted on the talk pages of this Textual Entailment Resource Pool.

'''Adding''' a new resource is very easy. See how to '''use existing templates''' to do this in [[Help:Using Templates]].

== Complete RTE Systems ==

* [http://project.cgm.unive.it/html/venses.html VENSES] (from Ca' Foscari University of Venice, Italy)
* [http://svn.ask.it.usyd.edu.au/trac/candc/wiki/nutcracker Nutcracker] (available for download)
* [http://l2r.cs.uiuc.edu/~cogcomp/kindleDemo.php Entailment Demo] (from the University of Illinois at Urbana-Champaign)
* [http://edits.fbk.eu/ EDITS - Edit Distance Textual Entailment Suite] (open source software developed by [http://hlt.fbk.eu/ Human Language Technology (HLT) group at FBK-Irst])

== RTE data sets ==
* [http://www.coli.uni-saarland.de/projects/salsa/fate FrameNet manually annotated RTE 2006 Test Set.] Provided by [http://www.coli.uni-saarland.de/projects/salsa/ SALSA project, Saarland University.]
* [http://www.cs.biu.ac.il/~nlp/files/RTE_2006_Aligned.zip Manually Word Aligned RTE 2006 Data Sets.] Provided by [http://research.microsoft.com/nlp/ the Natural Language Processing Group, Microsoft Research.]
* [http://www-nlp.stanford.edu/projects/contradiction/ RTE data sets annotated for a 3-way decision: entails, contradicts, unknown.] Provided by Stanford NLP Group.
* [http://www.cs.utexas.edu/~pclark/bpi-test-suite/ BPI RTE data set] - 250 pairs, focusing on world knowledge. Provided jointly by [http://www.boeing.com/phantom/math_ct/index.html Boeing], [http://wordnet.cs.princeton.edu/ Princeton], and [http://www.isi.edu ISI].

== Knowledge Resources ==
[[RTE Knowledge Resources]]

== Tools ==

=== Parsers ===
* [http://svn.ask.it.usyd.edu.au/trac/candc C&C parser for Combinatory Categorial Grammar]
* [[Minipar]]
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=SP Shallow Parser] - from the University of Illinois at Urbana-Champaign, see a [http://l2r.cs.uiuc.edu/~cogcomp/shallow_parse_demo.php web demo] of this tool

=== Role Labelling ===
* [http://cemantix.org/assert ASSERT]
* [http://www.coli.uni-saarland.de/projects/salsa/shal/ Shalmaneser]
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=SRL Semantic Role Labeler] - from the University of Illinois at Urbana-Champaign, see a [http://l2r.cs.uiuc.edu/~cogcomp/srl-demo.php web demo] of this tool

=== Entity Recognition Tools ===
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=NE CCG Named Entity Tagger] - see a [http://l2r.cs.uiuc.edu/~cogcomp/ne_demo.php web demo] of this tool
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=CORANKER CCG Multi-lingual Named Entity Discovery Tool] - see a [http://l2r.cs.uiuc.edu/~cogcomp/ne_matcher_demo.php web demo] of this tool

=== Corpus Readers ===
* [http://nltk.org NLTK] provides a corpus reader for the data from RTE Challenges 1, 2, and 3 - see the [http://nltk.org/doc/guides/corpus.html#rte Corpus Readers] Guide for more information.

== Links ==
* [http://homepages.inf.ed.ac.uk/jbos/rte/ Textual Entailment site by Johan Bos]
* [http://ai-nlp.info.uniroma2.it/te/ Textual Entailment at the University of Rome "Tor Vergata"]
[[Category:Textual Entailment Portal]]
* [http://l2r.cs.uiuc.edu/~cogcomp/entailment-module-demos.php CCG Textual Entailment System Component demos]

Textual Entailment Resource Pool

2009-06-22T14:54:36Z

Mehdad: /* Complete RTE Systems */

[[Textual Entailment|Textual entailment]] systems rely on many different types of [[Natural Language Processing|NLP]] resources, including term banks, paraphrase lists, parsers, named-entity recognizers, etc. With so many resources being continuously released and improved, it can be difficult to know which particular resource to use when developing a system.

In response, the [[Recognizing Textual Entailment|Recognizing Textual Entailment (RTE)]] shared task community initiated a new activity for building this ''Textual Entailment Resource Pool''. RTE participants and any other member of the NLP community are encouraged to contribute to the pool.

In an effort to determine the relative impact of the resources, RTE participants are strongly encouraged to report, whenever possible, the contribution to the overall performance of each utilized resource. Formal qualitative and quantitative results should be included in a separate section of the system report as well as posted on the talk pages of this Textual Entailment Resource Pool.

'''Adding''' a new resource is very easy. See how to '''use existing templates''' to do this in [[Help:Using Templates]].

== Complete RTE Systems ==

* [http://project.cgm.unive.it/html/venses.html VENSES] (from Ca' Foscari University of Venice, Italy)
* [http://svn.ask.it.usyd.edu.au/trac/candc/wiki/nutcracker Nutcracker] (available for download)
* [http://l2r.cs.uiuc.edu/~cogcomp/kindleDemo.php Entailment Demo] (from the University of Illinois at Urbana-Champaign)
* [http://edits.fbk.eu/ EDITS - Edit Distance Textual Entailment Suite] (open source software developed by [http://hlt.fbk.eu/ Human Language Technology (HLT)] group at FBK-Irst)

== RTE data sets ==
* [http://www.coli.uni-saarland.de/projects/salsa/fate FrameNet manually annotated RTE 2006 Test Set.] Provided by [http://www.coli.uni-saarland.de/projects/salsa/ SALSA project, Saarland University.]
* [http://www.cs.biu.ac.il/~nlp/files/RTE_2006_Aligned.zip Manually Word Aligned RTE 2006 Data Sets.] Provided by [http://research.microsoft.com/nlp/ the Natural Language Processing Group, Microsoft Research.]
* [http://www-nlp.stanford.edu/projects/contradiction/ RTE data sets annotated for a 3-way decision: entails, contradicts, unknown.] Provided by Stanford NLP Group.
* [http://www.cs.utexas.edu/~pclark/bpi-test-suite/ BPI RTE data set] - 250 pairs, focusing on world knowledge. Provided jointly by [http://www.boeing.com/phantom/math_ct/index.html Boeing], [http://wordnet.cs.princeton.edu/ Princeton], and [http://www.isi.edu ISI].

== Knowledge Resources ==
[[RTE Knowledge Resources]]

== Tools ==

=== Parsers ===
* [http://svn.ask.it.usyd.edu.au/trac/candc C&C parser for Combinatory Categorial Grammar]
* [[Minipar]]
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=SP Shallow Parser] - from the University of Illinois at Urbana-Champaign, see a [http://l2r.cs.uiuc.edu/~cogcomp/shallow_parse_demo.php web demo] of this tool

=== Role Labelling ===
* [http://cemantix.org/assert ASSERT]
* [http://www.coli.uni-saarland.de/projects/salsa/shal/ Shalmaneser]
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=SRL Semantic Role Labeler] - from the University of Illinois at Urbana-Champaign, see a [http://l2r.cs.uiuc.edu/~cogcomp/srl-demo.php web demo] of this tool

=== Entity Recognition Tools ===
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=NE CCG Named Entity Tagger] - see a [http://l2r.cs.uiuc.edu/~cogcomp/ne_demo.php web demo] of this tool
* [http://l2r.cs.uiuc.edu/~cogcomp/asoftware.php?skey=CORANKER CCG Multi-lingual Named Entity Discovery Tool] - see a [http://l2r.cs.uiuc.edu/~cogcomp/ne_matcher_demo.php web demo] of this tool

=== Corpus Readers ===
* [http://nltk.org NLTK] provides a corpus reader for the data from RTE Challenges 1, 2, and 3 - see the [http://nltk.org/doc/guides/corpus.html#rte Corpus Readers] Guide for more information.

== Links ==
* [http://homepages.inf.ed.ac.uk/jbos/rte/ Textual Entailment site by Johan Bos]
* [http://ai-nlp.info.uniroma2.it/te/ Textual Entailment at the University of Rome "Tor Vergata"]
[[Category:Textual Entailment Portal]]
* [http://l2r.cs.uiuc.edu/~cogcomp/entailment-module-demos.php CCG Textual Entailment System Component demos]

Textual Entailment Portal

2009-06-05T14:34:00Z

Mehdad: /* Papers in recent conferences and other workshops */

This page serves as a community portal for everything related to Textual Entailment.

== Textual Entailment Resource Pool ==
[[Textual Entailment Resource Pool]]

== PASCAL Challenges ==

[[Recognizing Textual Entailment|Recognizing Textual Entailment (RTE)]] has been proposed recently as a generic task that captures major semantic inference needs across many natural language processing applications.

== References on Textual Entailment ==
''You are welcome to update this list with new papers on textual entailment (please keep the new references in the same format, and maintain the alphabetical order).''

=== Workshops ===

[http://acl.ldc.upenn.edu/W/W05/#W05-1200 ACL 2005 Workshop on Empirical Modeling of Semantic Equivalence and Entailment, 2005]

[http://www.pascal-network.org/Challenges/RTE/ First PASCAL Recognising Textual Entailment Challenge (RTE-1), 2005]

[http://www.pascal-network.org/Challenges/RTE2/ Second PASCAL Recognising Textual Entailment Challenge (RTE-2), 2006]

[http://nlp.uned.es/QA/ave Answer Validation Exercise at CLEF 2006 (AVE 2006)]

[http://www.pascal-network.org/Challenges/RTE3/ Third PASCAL Recognising Textual Entailment Challenge (RTE-3), 2007]

=== Papers in recent conferences and other workshops ===

J. Bos & K. Markert. 2005. Recognising Textual Entailment with Logical Inference. Proceedings of EMNLP 2005.

R. Braz, R. Girju, V. Punyakanok, D. Roth, and M. Sammons. 2005. An Inference Model for Semantic Entailment in Natural Language. Twentieth National Conference on Artificial Intelligence (AAAI-05)

R. Braz, R. Girju, V. Punyakanok, D. Roth, and M. Sammons. 2005. Knowledge Representation for Semantic Entailment and Question-Answering. IJCAI-05 Workshop on Knowledge and Reasoning for Answering Questions.

C. Corley, A. Csomai and R. Mihalcea. 2005. Text Semantic Similarity, with Applications.
RANLP-05.

I. Dagan and O. Glickman. 2004. Probabilistic textual entailment: Generic applied modeling of language variability. In PASCAL Workshop on Learning Methods for Text Understanding and Mining, Grenoble.

I. Dagan, O. Glickman, A. Gliozzo, E. Marmorshtein and C. Strapparava. 2006. Direct Word Sense Matching for Lexical Substitution. COLING-ACL 2006

R. Delmonte, 2005. VENSES - a Linguistically-Based System for Semantic Evaluation, PLN, Procesamiento del Lenguaje Natural, Revista n° 35, ISSN:1135-5948, pp. 449-450.

R. Delmonte, 2005. Simulare la comprensione del linguaggio con VENSES. presented at Workshop "Scienze Cognitive Applicate", Facolt? di Psicologia dell'Universit? Roma "La Sapienza", 12/13-12-2005.

M. Geffet and I. Dagan. 2004. Feature Vector Quality and Distributional Similarity. Proceedings of The 20th International Conference on Computational Linguistics (COLING).

M. Geffet and I. Dagan. 2005. "The Distributional Inclusion Hypotheses and Lexical Entailment", ACL 2005, Michigan, USA.

O. Glickman, I. Dagan and M. Koppel. 2005. A Probabilistic Classification Approach for Lexical Textual Entailment, Twentieth National Conference on Artificial Intelligence (AAAI-05)

O. Glickman, E. Shnarch and I. Dagan. 2006. Lexical Reference: a Semantic Matching Subtask. EMNLP 2006 (poster).

A. Haghighi, A. Y. Ng, and C. D. Manning. 2005. Robust Textual Inference via Graph Matching. HLT-EMNLP 2005.

S. Harabagiu and A. Hickl. 2006. Methods for Using Textual Entailment in Open-Domain Question Answering. COLING-ACL 2006

J. Herrera, A. Peñas, F. Verdejo, 2006. Textual Entailment Recognition Based on Dependency Analysis and WordNet. MLCW 2005. LNAI 3944. 231-239.

V. Jijkoun and M. de Rijke. 2006. Recognizing Textual Entailment: Is Lexical Similarity Enough?, In: I. Dagan, F. Dalche, J. Quinonero Candela, B. Magnini, editors, Evaluating Predictive Uncertainty, Textual Entailment and Object Recognition Systems, LNAI 3944, pages 449-460, Springer Verlag.

M. Kouylekov and B. Magnini. 2005. Tree Edit Distance for Textual Entailment. RANLP 2005.

B. MacCartney, T. Grenager, M. de Marneffe, D. Cer and C. D. Manning. 2006. Learning to Recognize Features of Valid Textual Entailments. HLT-NAACL 2006.

S. Mirkin, I. Dagan, M. Geffet. 2006. Integrating Pattern-based and Distributional Similarity Methods for Lexical Entailment Acquisition. COLING-ACL 2006 (poster)

C. Monz and M. de Rijke. 2001. Light-Weight Entailment Checking for Computational Semantics, In: P. Blackburn and M. Kohlhase, editors, International workshop on Inference in Computational Semantics (ICoS-3).

R. Nairn, C. Condoravdi, and L. Karttunen. 2006. Computing relative polarity for textual inference. International workshop on Inference in Computational Semantics (ICoS-5).

M. T. Pazienza, M. Pennacchiotti and F. M. Zanzotto . 2006. Discovering asymmetric entailment relations between verbs using selectional preferences. COLING-ACL 2006

V. Pekar. 2006. Acquisition of Verb Entailment from Text. HLT-NAACL 2006

A. Peñas, A. Rodrigo, F. Verdejo. 2006. SPARTE, a Test Suite for Recognising Textual Entailment in Spanish. Computational Linguistics and Intelligent Text Processing, CICLing 2006. LNCS 3878. 275-286

R. Raina, A. Y. Ng, and C. Manning. 2005. Robust textual inference via learning and abductive reasoning. Twentieth National Conference on Artificial Intelligence (AAAI-05)

L. Romano, M. Kouylekov, I. Szpektor, I. Dagan and A. Lavelli. 2006. Investigating a Generic Paraphrase-based Approach for Relation Extraction. EACL 2006.

V. Rus, A. Graesser and K. Desai. 2005. Lexico-Syntactic Subsumption for Textual Entailment. RANLP 2005.

R. Snow, L. Vanderwende and A. Menezes. 2006. Effectively Using Syntax for Recognizing False Entialment. HLT-NAACL 2006.

M. Tatu and D. Moldovan. 2005. A Semantic Approach to Recognizing Textual Entailment. HLT-EMNLP 2005.

M. Tatu and D. Moldovan. 2006. A Logic-based Semantic Approach to Recognizing Textual Entailment. COLING-ACL 2006 (poster).

F. M. Zanzotto and A. Moschitti. 2006. Automatic learning of textual entailments with cross-pair similarities. COLING-ACL 2006

Y. Mehdad, B. Magnini. 2009. A Word Overlap Baseline for the Recognizing Textual Entailment Task. Available at http://hlt.fbk.eu/sites/hlt.fbk.eu/files/baseline.pdf

[[Category:Textual Entailment Portal]]

Textual Entailment Portal

2009-06-05T14:25:27Z

Mehdad: /* Papers in recent conferences and other workshops */

Textual Entailment Portal

2009-06-05T14:17:55Z

Mehdad: /* Papers in recent conferences and other workshops */

This page serves as a community portal for everything related to Textual Entailment.

== Textual Entailment Resource Pool ==
[[Textual Entailment Resource Pool]]

== PASCAL Challenges ==

[[Recognizing Textual Entailment|Recognizing Textual Entailment (RTE)]] has been proposed recently as a generic task that captures major semantic inference needs across many natural language processing applications.

== References on Textual Entailment ==
''You are welcome to update this list with new papers on textual entailment (please keep the new references in the same format, and maintain the alphabetical order).''

=== Workshops ===

[http://acl.ldc.upenn.edu/W/W05/#W05-1200 ACL 2005 Workshop on Empirical Modeling of Semantic Equivalence and Entailment, 2005]

[http://www.pascal-network.org/Challenges/RTE/ First PASCAL Recognising Textual Entailment Challenge (RTE-1), 2005]

[http://www.pascal-network.org/Challenges/RTE2/ Second PASCAL Recognising Textual Entailment Challenge (RTE-2), 2006]

[http://nlp.uned.es/QA/ave Answer Validation Exercise at CLEF 2006 (AVE 2006)]

[http://www.pascal-network.org/Challenges/RTE3/ Third PASCAL Recognising Textual Entailment Challenge (RTE-3), 2007]

=== Papers in recent conferences and other workshops ===

J. Bos & K. Markert. 2005. Recognising Textual Entailment with Logical Inference. Proceedings of EMNLP 2005.

R. Braz, R. Girju, V. Punyakanok, D. Roth, and M. Sammons. 2005. An Inference Model for Semantic Entailment in Natural Language. Twentieth National Conference on Artificial Intelligence (AAAI-05)

R. Braz, R. Girju, V. Punyakanok, D. Roth, and M. Sammons. 2005. Knowledge Representation for Semantic Entailment and Question-Answering. IJCAI-05 Workshop on Knowledge and Reasoning for Answering Questions.

C. Corley, A. Csomai and R. Mihalcea. 2005. Text Semantic Similarity, with Applications.
RANLP-05.

I. Dagan and O. Glickman. 2004. Probabilistic textual entailment: Generic applied modeling of language variability. In PASCAL Workshop on Learning Methods for Text Understanding and Mining, Grenoble.

I. Dagan, O. Glickman, A. Gliozzo, E. Marmorshtein and C. Strapparava. 2006. Direct Word Sense Matching for Lexical Substitution. COLING-ACL 2006

R. Delmonte, 2005. VENSES - a Linguistically-Based System for Semantic Evaluation, PLN, Procesamiento del Lenguaje Natural, Revista n° 35, ISSN:1135-5948, pp. 449-450.

R. Delmonte, 2005. Simulare la comprensione del linguaggio con VENSES. presented at Workshop "Scienze Cognitive Applicate", Facolt? di Psicologia dell'Universit? Roma "La Sapienza", 12/13-12-2005.

M. Geffet and I. Dagan. 2004. Feature Vector Quality and Distributional Similarity. Proceedings of The 20th International Conference on Computational Linguistics (COLING).

M. Geffet and I. Dagan. 2005. "The Distributional Inclusion Hypotheses and Lexical Entailment", ACL 2005, Michigan, USA.

O. Glickman, I. Dagan and M. Koppel. 2005. A Probabilistic Classification Approach for Lexical Textual Entailment, Twentieth National Conference on Artificial Intelligence (AAAI-05)

O. Glickman, E. Shnarch and I. Dagan. 2006. Lexical Reference: a Semantic Matching Subtask. EMNLP 2006 (poster).

A. Haghighi, A. Y. Ng, and C. D. Manning. 2005. Robust Textual Inference via Graph Matching. HLT-EMNLP 2005.

S. Harabagiu and A. Hickl. 2006. Methods for Using Textual Entailment in Open-Domain Question Answering. COLING-ACL 2006

J. Herrera, A. Peñas, F. Verdejo, 2006. Textual Entailment Recognition Based on Dependency Analysis and WordNet. MLCW 2005. LNAI 3944. 231-239.

V. Jijkoun and M. de Rijke. 2006. Recognizing Textual Entailment: Is Lexical Similarity Enough?, In: I. Dagan, F. Dalche, J. Quinonero Candela, B. Magnini, editors, Evaluating Predictive Uncertainty, Textual Entailment and Object Recognition Systems, LNAI 3944, pages 449-460, Springer Verlag.

M. Kouylekov and B. Magnini. 2005. Tree Edit Distance for Textual Entailment. RANLP 2005.

B. MacCartney, T. Grenager, M. de Marneffe, D. Cer and C. D. Manning. 2006. Learning to Recognize Features of Valid Textual Entailments. HLT-NAACL 2006.

S. Mirkin, I. Dagan, M. Geffet. 2006. Integrating Pattern-based and Distributional Similarity Methods for Lexical Entailment Acquisition. COLING-ACL 2006 (poster)

C. Monz and M. de Rijke. 2001. Light-Weight Entailment Checking for Computational Semantics, In: P. Blackburn and M. Kohlhase, editors, International workshop on Inference in Computational Semantics (ICoS-3).

R. Nairn, C. Condoravdi, and L. Karttunen. 2006. Computing relative polarity for textual inference. International workshop on Inference in Computational Semantics (ICoS-5).

M. T. Pazienza, M. Pennacchiotti and F. M. Zanzotto . 2006. Discovering asymmetric entailment relations between verbs using selectional preferences. COLING-ACL 2006

V. Pekar. 2006. Acquisition of Verb Entailment from Text. HLT-NAACL 2006

A. Peñas, A. Rodrigo, F. Verdejo. 2006. SPARTE, a Test Suite for Recognising Textual Entailment in Spanish. Computational Linguistics and Intelligent Text Processing, CICLing 2006. LNCS 3878. 275-286

R. Raina, A. Y. Ng, and C. Manning. 2005. Robust textual inference via learning and abductive reasoning. Twentieth National Conference on Artificial Intelligence (AAAI-05)

L. Romano, M. Kouylekov, I. Szpektor, I. Dagan and A. Lavelli. 2006. Investigating a Generic Paraphrase-based Approach for Relation Extraction. EACL 2006.

V. Rus, A. Graesser and K. Desai. 2005. Lexico-Syntactic Subsumption for Textual Entailment. RANLP 2005.

R. Snow, L. Vanderwende and A. Menezes. 2006. Effectively Using Syntax for Recognizing False Entialment. HLT-NAACL 2006.

M. Tatu and D. Moldovan. 2005. A Semantic Approach to Recognizing Textual Entailment. HLT-EMNLP 2005.

M. Tatu and D. Moldovan. 2006. A Logic-based Semantic Approach to Recognizing Textual Entailment. COLING-ACL 2006 (poster).

F. M. Zanzotto and A. Moschitti. 2006. Automatic learning of textual entailments with cross-pair similarities. COLING-ACL 2006

Y. Mehdad and B. Magnini. 2009. A Word Overlap Baseline for the Recognizing Textual Entailment Task. [[baseline.pdf]]

[[Category:Textual Entailment Portal]]