evaluation

Framing the Israel War on Gaza: A Shared Task on News Media Narratives (FIGNEWS 2024)

Abbreviated Title: 
Shared Task on News Media Narratives (FIGNEWS 2024)
Call for Participation
Submission Deadline: 
10 May 2024
Event Dates: 
16 Aug 2024
Location: 
Thailand
City: 
Bangkok
State: 
Country: 
Thailand
Contact: 
Wajdi Zaghouani
Contact Email: 
wajdiz [at] gmail.com

Calling all NLP, Digital Humanities and media analysis enthusiasts! Participate in the "Framing the Israel War on Gaza" (FIGNEWS) shared task and play a pivotal role in shaping media narrative research. Engage in creating guidelines, annotating a diverse multilingual corpus, and pushing the boundaries of NLP!

Task Highlights:

1. Guidelines Creation: Craft comprehensive annotation guidelines and set a benchmark in NLP research.

ACL-Sponsored Event: 
1

The First Workshop on Data Contamination (CONDA2024)

Abbreviated Title: 
CONDA2024
Call for Papers
Submission Deadline: 
17 May 2024
Event Dates: 
16 Aug 2024
Location: 
ACL2024
City: 
Bangkok
Country: 
Thailand
Contact: 
Oscar Sainz
Iker García Ferrero
Eneko Agirre
Jon Ander Campos
Alon Jacovi
Yanai Elazar
Yoav Goldberg
Contact Email: 
conda-workshop [at] googlegroups.com

We invite you to participate and submit your work to the First Workshop on Data Contamination (CONDA) co-located with ACL 2024 in Bangkok, Thailand.

ACL-Sponsored Event: 
1

Second CfP: The 4th Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP 2023)

Abbreviated Title: 
Eval4NLP 2023
Call for Papers
Submission Deadline: 
25 Aug 2023
Location: 
AACL 2023
City: 
Bali
State: 
Indonesia
Country: 
Indonesia
Contact: 
Daniel Deutsch
Rotem Dror
Juri Opitz
Contact Email: 
dandeutsch [at] google.com
rtmdrr [at] seas.upenn.edu
opitz [at] cl.uni-heidelberg.de

the 4th Workshop on Evaluation and Comparison for NLP systems (Eval4NLP), co-located at the 2023 Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL 2023), invites the submission of long and short papers, with a theoretical or experimental nature, describing recent advances in system evaluation and comparison in NLP.

ACL-Sponsored Event: 
1

Second call for papers: The 4th Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP 2023)

Abbreviated Title: 
Eval4NLP 2023
Call for Papers
Submission Deadline: 
25 Aug 2023
Location: 
AACL 2023
City: 
Bali
State: 
Indonesia
Country: 
Indonesia
Contact: 
Daniel Deutsch
Rotem Dror
Juri Opitz
Contact Email: 
dandeutsch [at] google.com
rtmdrr [at] seas.upenn.edu
opitz [at] cl.uni-heidelberg.de

The 4th Workshop on Evaluation and Comparison for NLP systems (Eval4NLP), co-located at the 2023 Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL 2023), invites the submission of long and short papers, with a theoretical or experimental nature, describing recent advances in system evaluation and comparison in NLP.

ACL-Sponsored Event: 
1

Shared Task: Prompting Large Language Models as Explainable Metrics

Abbreviated Title: 
LLMs as Explainable Metrics
Call for Participation
Submission Deadline: 
23 Sep 2023
Location: 
AACL 2023
City: 
Bali
State: 
Indonesia
Country: 
Indonesia
Contact: 
christoph.leiter@uni-bielefeld.de
opitz@cl.uni-heidelberg.de
steffen.eger@uni-bielefeld.de

Dear colleagues,

you are invited to participate in the Eval4NLP 2023 shared task on **Prompting Large Language Models as Explainable Metrics**.

Please find more information below and on the shared task webpage: https://eval4nlp.github.io/2023/shared-task.html

Important Dates

ACL-Sponsored Event: 
1

Call for papers: The 4th Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP 2023)

Abbreviated Title: 
Eval4NLP
Call for Papers
Submission Deadline: 
27 Aug 2023
Event Dates: 
1 Nov 2023
Location: 
AACL 2023
City: 
Bali
State: 
Indonesia
Country: 
Indonesia
Contact: 
Daniel Deutsch
Rotem Dror
Juri Opitz
Contact Email: 
dandeutsch [at] google.com
rtmdrr [at] seas.upenn.edu
opitz [at] cl.uni-heidelberg.de

Dear Colleagues,

the 4th Workshop on Evaluation and Comparison for NLP systems (Eval4NLP), co-located at the 2023 Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL 2023), invites the submission of long and short papers, with a theoretical or experimental nature, describing recent advances in system evaluation and comparison in NLP.

** Important Dates **

All deadlines are 11.59 pm UTC -12h (“Anywhere on Earth”).

ACL-Sponsored Event: 
1

ReproNLP Shared Task on Reproducibility of Evaluations in NLP 2023

Abbreviated Title: 
ReproNLP 2023
Call for Papers
Submission Deadline: 
4 Aug 2023
Event Dates: 
7 Sep 2023
Location: 
RANLP 2023
City: 
Varna
State: 
Country: 
Bulgaria
Contact: 
Anya Belz
Craig Thomson
Contact Email: 
a.s.belz [at] adaptcentre.ie
c.thomson [at] abdn.ac.uk

ReproNLP 2023: First Call for Participation

Background

ACL-Sponsored Event: 
0

Test suite sub-task of the Eighth Conference on Machine Translation (WMT23)

Call for Participation
Submission Deadline: 
19 Jun 2023
Event Dates: 
6 Dec 2023 to 7 Dec 2023
Location: 
Singapore
Contact: 
Ondrej Bojar
Eleftherios Avramidis
Contact Email: 
bojar [at] ufal.mff.cuni.cz
eleftherios.avramidis [at] dfki.de

Dear all,

the “Test suites” sub-task will be included for the sixth time in the General MT Shared Task of the Conference on Machine Translation (WMT23).

*OVERVIEW*

Test suites are custom extensions to the test sets of the General MT Shared Task, constructed so that they can focus on particular aspects of the MT output. They cοnsist of a source-side test-set and a customized evaluation service. As opposed to the standard evaluation process which produces generic quality scores, test suites often produce separate fine-grained results for each phenomenon.

ACL-Sponsored Event: 
0

2nd Workshop on Novel Evaluation Approaches for Text Classification Systems

Abbreviated Title: 
NEATCLasS
Call for Papers
Submission Deadline: 
5 Jun 2023
Location: 
City: 
Limassol
State: 
Country: 
Cyprus
Contact: 
Björn Ross
Contact Email: 
b.ross [at] ed.ac.uk

2nd Workshop on Novel Evaluation Approaches for Text Classification Systems

Co-located with ICWSM 2023, 5 June 2023, Limassol, Cyprus

https://neatclass-workshop.github.io/

ACL-Sponsored Event: 
0

Pages

Subscribe to RSS - evaluation