Abstract Meaning Representation Parsing is a new shared task at
SemEval this year. Given a sentence of plain English text, systems
will attempt to produce an accurate semantic interpretation, as
represented by the AMR standard.
Overview
========
Abstract Meaning Representation (AMR) is a compact, readable,
whole-sentence semantic annotation. Annotation components include
entity identification and typing, PropBank semantic roles, individual
entities playing multiple roles, entity grounding via wikification, as
well as treatments of modality, negation, etc. With the recent public
release of a sizeable corpus of English/AMR pairs, there
has been substantial interest in creating parsers to recover this
formalism from plain text. Several parsers have already been released
and more may be on their way soon. It seems an appropriate time to
conduct a carefully guided shared task so that this nascent community
may cleanly evaluate their various approaches side by side under
controlled scenarios.
Rules
=====
Participants will be provided with parallel English-AMR training
data. They will have to parse new English data and return the obtained
AMRs. Participants may use any resources at their disposal (but may
not hand-annotate the blind data or hire other human beings to
hand-annotate the blind data). The SemEval trophy goes to the system
with the highest Smatch score.
Trophy?
=======
Yes. The winning system will receive bragging rights as well as a
trophy, courtesy of the task organizers.
Key Dates
=========
Training Data and code release: Now!
Evaluation start: January 10, 2016
Evaluation end: January 31, 2016
Paper submission due: February 28, 2016
SemEval workshop: Summer 2016
Participate
===========
Website: http://alt.qcri.org/semeval2016/task8
Register: http://goo.gl/forms/cGkRocFFph
Mailing List:
https://groups.google.com/a/isi.edu/forum/#!forum/semeval-2016-task-8-am...