evaluation

Deadlines extended for Eval4NLP 2022: The 3rd Workshop on Evaluation and Comparison of NLP Systems

Call for Papers
Submission Deadline: 
15 Aug 2022
Location: 
co-located at AACL 2022
City: 
Taipei
State: 
Taiwan
Country: 
Taiwan
Contact: 
Daniel Deutsch
Can Udomcharoenchaikit
Juri Opitz
Contact Email: 
eval4nlp [at] gmail.com

The 3rd Workshop on Evaluation and Comparison for NLP systems (Eval4NLP, https://eval4nlp.github.io/2022), co-located at the 2022 Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL 2022, https://www.aacl2022.org/), invites the submission of long and short papers, with a theoretical or experimental nature, describing recent advances in system evaluation and comparison in NLP.

ACL-Sponsored Event: 
1

The 3rd Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP 2022)

Abbreviated Title: 
Eval4NLP 2022
Call for Papers
Submission Deadline: 
10 Sep 2022
Event Dates: 
20 Nov 2022
Location: 
Online
Contact: 
Daniel Deutsch
Juri Opitz
Can Udomcharoenchaikit
Contact Email: 
eval4nlp [at] gmail.com

Fair evaluations and comparisons are of fundamental importance to the NLP community to properly track progress, especially within the current deep learning revolution, with new state-of-the-art results reported in ever shorter intervals. This concerns the creation of benchmark datasets that cover typical use cases and blind spots of existing systems, the designing of metrics for evaluating the performance of NLP systems on different dimensions, and the reporting of evaluation results in an unbiased manner.

ACL-Sponsored Event: 
1

1st Workshop on Novel Evaluation Approaches for Text Classification Systems on Social Media

Abbreviated Title: 
NEATCLasS
Call for Papers
Submission Deadline: 
10 Apr 2022
Event Dates: 
6 Jun 2022
Location: 
Co-located with ICWSM 2022
City: 
Atlanta
State: 
Georgia
Country: 
United States
Contact: 
Björn Ross
Roberto Navigli
Agostina Calabrese
Contact Email: 
b.ross [at] ed.ac.uk
navigli [at] diag.uniroma1.it
a.calabrese [at] ed.ac.uk

The automatic or semiautomatic analysis of textual data is a key approach to analyse the massive amounts of user-generated content online, from the identification of sentiment in text and topic classification to the detection of abusive language, misinformation or propaganda. However, the development of such systems faces a crucial challenge.

ACL-Sponsored Event: 
0

Second Call for Papers: Evaluation and Comparison of NLP Systems 2021

Abbreviated Title: 
2nd CFP: Eval4NLP 2021
Call for Papers
Submission Deadline: 
24 Jul 2021
Event Dates: 
10 Nov 2021 to 11 Nov 2021
Location: 
in conjunction with EMNLP 2021
Contact: 
Eval4NLP organizers
Contact Email: 
eval4nlp [at] gmail.com

--------------------------------------------
Second Call for Papers
--------------------------------------------
The 2nd Workshop on Evaluation and Comparison for NLP systems (Eval4NLP), co-located at the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP2021), invites the submission of long and short papers, with a theoretical or experimental nature, describing recent advances in system evaluation and comparison in NLP.

ACL-Sponsored Event: 
0

NL-Augmenter

Abbreviated Title: 
NL-Augmenter
Call for Participation
Submission Deadline: 
1 Sep 2021
Location: 
GEM@ACL'21
City: 
State: 
Country: 
Contact: 
Kaustubh Dole
Sebastian Gehrmann
Contact Email: 
nl-augmenter [at] googlegroups.com

The GEM (Generation, Evaluation, Metrics) workshop at ACL, 2021 is inviting transformation submissions to NL-Augmenter.

ACL-Sponsored Event: 
0

First Call for Papers: Evaluation and Comparison of NLP Systems 2021

Abbreviated Title: 
1st CFP: Eval4NLP 2021
Call for Papers
Submission Deadline: 
24 Jul 2021
Event Dates: 
10 Nov 2021 to 11 Nov 2021
Location: 
in conjunction with EMNLP 2021
Contact: 
Eval4NLP organizers
Contact Email: 
eval4nlp [at] gmail.com

--------------------------------------------
First Call for Papers
--------------------------------------------
The 2nd Workshop on Evaluation and Comparison for NLP systems (Eval4NLP), co-located at the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP2021), invites the submission of long and short papers, with a theoretical or experimental nature, describing recent advances in system evaluation and comparison in NLP.

ACL-Sponsored Event: 
0

Eval4NLP 2021: A Shared Task on Explainable Quality Estimation

Call for Participation
Submission Deadline: 
1 Sep 2021
Event Dates: 
10 Nov 2021
Location: 
in conjunction with EMNLP 2021
Contact: 
Eval4NLP organizers
Contact Email: 
eval4nlp [at] gmail.com

--------------------------------------------
First Call for Participation
--------------------------------------------
The 2nd Workshop on "Evaluation & Comparison of NLP Systems" (co-located with EMNLP 2021) organizes a shared task on Explainable Quality Estimation. The call for participation is described below. For more details, please visit our shared task website -- https://eval4nlp.github.io/sharedtask.html

ACL-Sponsored Event: 
0

SemEval-2022: The 16th International Workshop on Semantic Evaluation

Abbreviated Title: 
SemEval-2022
Call for Proposals
Submission Deadline: 
22 Mar 2021
Location: 
Co-located with a major NLP conference in 2022
Contact: 
Nathan Schneider
Alexis Palmer
Guy Emerson
Natalie Schluter
Contact Email: 
semeval-organizers [at] googlegroups.com

SemEval-2022: International Workshop on Semantic Evaluation
https://semeval.github.io/

We invite proposals for tasks to be run as part of SemEval-2022. SemEval (the International Workshop on Semantic Evaluation) is an ongoing series of evaluations of computational semantics systems, organized under the umbrella of SIGLEX, the Special Interest Group on the Lexicon of the Association for Computational Linguistics.

ACL-Sponsored Event: 
1

First Workshop on Generation Evaluation and Metrics at ACL 2021: Final Call for Papers

Abbreviated Title: 
GEM '21
Call for Papers
Submission Deadline: 
3 May 2021
Event Dates: 
5 Aug 2021
Location: 
Berkeley Hotel
City: 
Bangkok
Country: 
Thailand
Contact: 
Sebastian Gehrmann
Antoine Bosselut
Esin Durmus
Varun Prashant Gangal
Yacine Jernite
Laura Perez-Beltrachini
Samira Shaikh
Wei Xu
Contact Email: 
gehrmann [at] google.com

Final call for papers and shared task submissions for Workshop on Generation, Evaluation, and Metrics (GEM) at ACL ’21

=========
Call for Participation
=========

Update April 22: Our Paper submission deadline has been extended to May 3! Please submit your papers at the SoftConf link listed below. The shared task submission deadline is May 14.

ACL-Sponsored Event: 
1

First CfP: Aggregating and analysing crowdsourced annotations for NLP (AnnoNLP)

Abbreviated Title: 
AnnoNLP
Call for Papers
Submission Deadline: 
2 Sep 2019
Event Dates: 
3 Nov 2019
Location: 
EMNLP-IJCNLP
City: 
Hong Kong
State: 
Country: 
Contact: 
Silviu Paun
Dirk Hovy
Contact Email: 
s.paun [at] qmul.ac.uk
dirk.hovy [at] unibocconi.it

Aggregating and analysing crowdsourced annotations for NLP (AnnoNLP)
The workshop is hosted by EMNLP-IJCNLP 2019 which will take place in Hong Kong. Full details here: http://dali.eecs.qmul.ac.uk/annonlp

ACL-Sponsored Event: 
1

Pages

Subscribe to RSS - evaluation