Attachment | Size |
---|---|
![]() | 6.46 KB |
![]() | 918.74 KB |
NLP Power! The First Workshop on Efficient Benchmarking in NLP co-located with ACL 2022, online
Second Call for Papers
Workshop: May 26, 2022
ACL Conference: May 26–28, 2022
Website: https://nlp-power.github.io/
Paper submission: https://openreview.net/group?id=aclweb.org/ACL/2022/Workshop/NLP-Power
Paper submission deadline: February 28, 2022
Benchmarks have played a crucial role in accelerating progress in the field of NLP, covering a wide range of research directions: natural language understanding (GLUE, SuperGLUE), natural language generation (GEM), cross-lingual knowledge transfer (XGLUE, XTREME), probing and interpretation (LINSPECTOR, SentEval), hate speech and bias (HateCheck, StereoSet, HONEST) and robustness to adversarial attacks (RobustnessGym, AdvGLUE). Despite the fact that the concept of benchmarking has become a standard practice for evaluating upcoming models against one another and human solvers, there are still a number of unresolved issues and methodological concerns.
We welcome submissions that identify with one of the aforementioned areas or present fall into these general:
1. Computational race & carbon footprints
2. Linguistic competence of the models
3. Reproducibility crisis
4. Responsible innovation and ethics in NLP
5. Model and human evaluation design
6. Application to real-world scenarios
7. Data collection & leakage
IMPORTANT DATES
* Jan. 28, 2022: Anonymity period begins
* Feb. 28, 2022: Workshop Paper Due Date
* March 26, 2022: Notification of Acceptance
* April 10, 2022: Camera-ready papers due
* May 26, 2022: Workshop Date
Note: All deadlines are 11:59 PM UTC-12:00 (“anywhere on Earth”).
PAPER SUBMISSION
Submission is electronic, using the OpenReview conference management system.
Submission link: https://openreview.net/group?id=aclweb.org/ACL/2022/Workshop/NLP-Power
We accept three types of papers
1. Standard workshop papers: anonymized submissions describing substantially original research not previously published in other venues.
2. Extended abstracts: anonymized submissions describing preliminary but interesting ideas or results not previously published in other venues.
3. Cross-submissions: non-anonymized papers on relevant topics that have previously been accepted for publication in another venue.
For questions and comments regarding the workshop please contact the
organisers at nlp_power [at] googlegroups.com.
Read more:
https://nlp-power.github.io/