ACL Wiki - User contributions [en]

SemEval Portal

2010-11-09T04:31:46Z

Alvations: /* SemEval on Wikipedia */

__FORCETOC__
This page serves as a community portal for everything related to Semantic Evaluation ('''SemEval''').
==Semantic Evaluation Exercises==

The purpose of the SemEval exercises and [http://www.senseval.org SENSEVAL] is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007 (SemEval-1), the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation. This portal will be used to provide a comprehensive view of the issues involved in semantic evaluations.

==Upcoming and Past Events==

{| border="1" cellpadding="7" cellspacing="0"
|-
! Event
! Year
! Location
! Notes
|-
| [[SemEval 3]]
| align="center" | to be determined
| to be determined
| - discussion at [http://groups.google.com/group/semeval3 SemEval 3 Group]
|-
| [http://semeval2.fbk.eu/semeval2.php SemEval 2]
| align="center" | 2010
| Uppsala, Sweden
| - [http://aclweb.org/anthology-new/S/S10/ proceedings]
|-
| [http://nlp.cs.swarthmore.edu/semeval/index.php SemEval 1]
| align="center" | 2007
| Prague, Czech Republic
| - [http://aclweb.org/anthology-new/S/S07/ proceedings] - copy of website at [http://web.archive.org/web/20080727062358/http://nlp.cs.swarthmore.edu/semeval/index.php Internet Archive]
|-
| [http://www.senseval.org/senseval3 SENSEVAL 3]
| align="center" | 2004
| Barcelona, Spain
| - [http://aclweb.org/anthology-new/W/W04/#0800 proceedings]
|-
| [http://www.sle.sharp.co.uk/senseval2 SENSEVAL 2]
| align="center" | 2001
| Toulouse, France
| - main link provides links to results, data, system descriptions, task descriptions, and workshop program - copy of website at [http://web.archive.org/web/20050507011044/http://www.sle.sharp.co.uk/senseval2/ Internet Archive]
|-
| [http://www.itri.brighton.ac.uk/events/senseval/ARCHIVE/index.html SENSEVAL 1]
| align="center" | 1998
| East Sussex, UK
| - papers in [http://www.springerlink.com/content/0010-4817/34/1-2/ Computers and the Humanities], subscribers or pay per view
|-
|}

==Tasks in Semantic Evaluation==

The major tasks in semantic evaluation include:
*Word-sense disambiguation (lexical sample)
*Word-sense disambiguation (all-words)
*Multi-lingual or cross-lingual word-sense disambiguation
*Subcategorization acquistion
*Semantic role labeling
*Word-sense induction
*Semantic relation identification
*Metonymy resolution
*Temporal information processing
*Lexical substitution
*Evaluation of lexical resources
*Coreference resolution
*Sentiment analysis
This list is expected to grow as the field progresses.

==Organization==

[http://www.clres.com/siglex.html SIGLEX, the ACL Special Interest Group on the Lexicon] is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises. [http://www.senseval.org/ SENSEVAL] is the home page for SENSEVAL 1-3. Each exercise is usually organized by two individuals, who make the call for tasks and handle the overall administration. Within the general guidelines, each task is then organized and run by individuals or groups.

==SemEval on Wikipedia==

On [http://en.wikipedia.org/wiki/Main_Page Wikipedia], a [http://en.wikipedia.org/wiki/SemEval SemEval] page had been created and it is calling for contributions and suggestions on how to improve the Wikipedia page, to advocate SemEval, and to further the understanding of computational semantics.

Currently, there are [http://en.wikipedia.org/wiki/Wikipedia:Articles_for_deletion/SemEval#SemEval discussions on the possible deletion] of the wikipedia page on SemEval, please help to verify the [http://en.wikipedia.org/wiki/Wikipedia:Notability notability] and suggestions to improve the [http://en.wikipedia.org/wiki/SemEval SemEval wikipage].

[[Category:SemEval Portal]]

SemEval Portal

2010-10-27T15:53:41Z

Alvations:

__FORCETOC__
This page serves as a community portal for everything related to Semantic Evaluation ('''SemEval''').
==Semantic Evaluation Exercises==

The purpose of the SemEval exercises and [http://www.senseval.org SENSEVAL] is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007 (SemEval-1), the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation. This portal will be used to provide a comprehensive view of the issues involved in semantic evaluations.

==Upcoming and Past Events==

{| border="1" cellpadding="7" cellspacing="0"
|-
! Event
! Year
! Location
! Notes
|-
| [[SemEval 3]]
| align="center" | to be determined
| to be determined
| - discussion at [http://groups.google.com/group/semeval3 SemEval 3 Group]
|-
| [http://semeval2.fbk.eu/semeval2.php SemEval 2]
| align="center" | 2010
| Uppsala, Sweden
| - [http://aclweb.org/anthology-new/S/S10/ proceedings]
|-
| [http://nlp.cs.swarthmore.edu/semeval/index.php SemEval 1]
| align="center" | 2007
| Prague, Czech Republic
| - [http://aclweb.org/anthology-new/S/S07/ proceedings] - copy of website at [http://web.archive.org/web/20080727062358/http://nlp.cs.swarthmore.edu/semeval/index.php Internet Archive]
|-
| [http://www.senseval.org/senseval3 SENSEVAL 3]
| align="center" | 2004
| Barcelona, Spain
| - [http://aclweb.org/anthology-new/W/W04/#0800 proceedings]
|-
| [http://www.sle.sharp.co.uk/senseval2 SENSEVAL 2]
| align="center" | 2001
| Toulouse, France
| - main link provides links to results, data, system descriptions, task descriptions, and workshop program - copy of website at [http://web.archive.org/web/20050507011044/http://www.sle.sharp.co.uk/senseval2/ Internet Archive]
|-
| [http://www.itri.brighton.ac.uk/events/senseval/ARCHIVE/index.html SENSEVAL 1]
| align="center" | 1998
| East Sussex, UK
| - papers in [http://www.springerlink.com/content/0010-4817/34/1-2/ Computers and the Humanities], subscribers or pay per view
|-
|}

==Tasks in Semantic Evaluation==

The major tasks in semantic evaluation include:
*Word-sense disambiguation (lexical sample)
*Word-sense disambiguation (all-words)
*Multi-lingual or cross-lingual word-sense disambiguation
*Subcategorization acquistion
*Semantic role labeling
*Word-sense induction
*Semantic relation identification
*Metonymy resolution
*Temporal relation identification
*Lexical substitution
*Evaluation of lexical resources
*Coreference resolution
*Sentiment analysis
This list is expected to grow as the field progresses.

==Organization==

[http://www.clres.com/siglex.html SIGLEX, the ACL Special Interest Group on the Lexicon] is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises. [http://www.senseval.org/ SENSEVAL] is the home page for SENSEVAL 1-3. Each exercise is usually organized by two individuals, who make the call for tasks and handle the overall administration. Within the general guidelines, each task is then organized and run by individuals or groups.

==[http://en.wikipedia.org/wiki/SemEval, Semeval] on Wiki==

On the public wikipedia, a [http://en.wikipedia.org/wiki/SemEval, SemEval] page had been created for Semeval and it is calling for inputs and suggestions on how to improve the wiki page to advocate, educate, proliferate SemEval / Senseval; to further the public and academics's understanding of computational semantics.

[[Category:SemEval Portal]]

SemEval Portal

2010-10-27T15:52:38Z

Alvations: SemEval on Wikipedia

__FORCETOC__
This page serves as a community portal for everything related to Semantic Evaluation ('''SemEval''').
==Semantic Evaluation Exercises==

The purpose of the SemEval exercises and [http://www.senseval.org SENSEVAL] is to evaluate semantic analysis systems. The first three evaluations, Senseval-1 through Senseval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. Beginning with the 4th workshop, SemEval-2007 (SemEval-1), the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation. This portal will be used to provide a comprehensive view of the issues involved in semantic evaluations.

==Upcoming and Past Events==

{| border="1" cellpadding="7" cellspacing="0"
|-
! Event
! Year
! Location
! Notes
|-
| [[SemEval 3]]
| align="center" | to be determined
| to be determined
| - discussion at [http://groups.google.com/group/semeval3 SemEval 3 Group]
|-
| [http://semeval2.fbk.eu/semeval2.php SemEval 2]
| align="center" | 2010
| Uppsala, Sweden
| - [http://aclweb.org/anthology-new/S/S10/ proceedings]
|-
| [http://nlp.cs.swarthmore.edu/semeval/index.php SemEval 1]
| align="center" | 2007
| Prague, Czech Republic
| - [http://aclweb.org/anthology-new/S/S07/ proceedings] - copy of website at [http://web.archive.org/web/20080727062358/http://nlp.cs.swarthmore.edu/semeval/index.php Internet Archive]
|-
| [http://www.senseval.org/senseval3 SENSEVAL 3]
| align="center" | 2004
| Barcelona, Spain
| - [http://aclweb.org/anthology-new/W/W04/#0800 proceedings]
|-
| [http://www.sle.sharp.co.uk/senseval2 SENSEVAL 2]
| align="center" | 2001
| Toulouse, France
| - main link provides links to results, data, system descriptions, task descriptions, and workshop program - copy of website at [http://web.archive.org/web/20050507011044/http://www.sle.sharp.co.uk/senseval2/ Internet Archive]
|-
| [http://www.itri.brighton.ac.uk/events/senseval/ARCHIVE/index.html SENSEVAL 1]
| align="center" | 1998
| East Sussex, UK
| - papers in [http://www.springerlink.com/content/0010-4817/34/1-2/ Computers and the Humanities], subscribers or pay per view
|-
|}

==Tasks in Semantic Evaluation==

The major tasks in semantic evaluation include:
*Word-sense disambiguation (lexical sample)
*Word-sense disambiguation (all-words)
*Multi-lingual or cross-lingual word-sense disambiguation
*Subcategorization acquistion
*Semantic role labeling
*Word-sense induction
*Semantic relation identification
*Metonymy resolution
*Temporal relation identification
*Lexical substitution
*Evaluation of lexical resources
*Coreference resolution
*Sentiment analysis
This list is expected to grow as the field progresses.

==Organization==

[http://www.clres.com/siglex.html SIGLEX, the ACL Special Interest Group on the Lexicon] is the umbrella organization for the SemEval semantic evaluations and the SENSEVAL word-sense evaluation exercises. [http://www.senseval.org/ SENSEVAL] is the home page for SENSEVAL 1-3. Each exercise is usually organized by two individuals, who make the call for tasks and handle the overall administration. Within the general guidelines, each task is then organized and run by individuals or groups.

==[http://en.wikipedia.org/wiki/SemEval, Semeval] on Wiki==

On the public wikipedia, a [http://en.wikipedia.org/wiki/SemEval, SemEval] page had been created for Semeval and it is calling for inputs and suggestions on how to improve the wiki page to advocate, educate, proliferate SemEval / Senseval. Eventually to to further the understanding of computational semantics\

[[Category:SemEval Portal]]