2025Q3 Reports: ARR Editors in Chief: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
| (7 intermediate revisions by the same user not shown) | |||
| Line 13: | Line 13: | ||
= Summary of Submission of Recent Cycles = | = Summary of Submission of Recent Cycles = | ||
[[File:ARR submission numbers.jpg| | [[File:ARR submission numbers.jpg|600px]] | ||
More information can be found at: [https://stats.aclrollingreview.org/ ARR Statistics] | More information can be found at: [https://stats.aclrollingreview.org/ ARR Statistics] | ||
| Line 22: | Line 22: | ||
: Background: In the past (from October 2022 to February 2025), ARR ran 8-week review cycles, | : Background: In the past (from October 2022 to February 2025), ARR ran 8-week review cycles, | ||
: with submission deadlines on the 15th of every second month. After extensive deliberation and | : with submission deadlines on the 15th of every second month [https://aclrollingreview.org/key-changes-in-the-october-cycle/]. After extensive deliberation and | ||
: soliciting community feedback, the ACL Peer Review Committee recommended to ACL Exec to | : soliciting community feedback [https://www.aclweb.org/portal/content/acl-survey-what-should-acl-peer-review-process-be-future], the ACL Peer Review Committee [https://www.aclweb.org/adminwiki/index.php/ACL_Peer_Review_Standing_Committee] recommended to ACL Exec to | ||
: switch to 10-week cycles. The full committee report is available in the adminwiki. | : switch to 10-week cycles. The full committee report is available in the adminwiki [https://www.aclweb.org/adminwiki/images/9/9e/COPR-5-cycle-report-to-publish.pdf]. | ||
* Changes implemented to cope with the increasing submissions: | * Changes implemented to cope with the increasing submissions: | ||
| Line 31: | Line 31: | ||
:: reviews required when submitting multiple papers. | :: reviews required when submitting multiple papers. | ||
* Detailed changes in the last two ARR cycles: | * Detailed changes in the last two ARR cycles: | ||
** May 2025: | |||
** Updating Area Keywords at ARR (leads: Anna, Mike, EMNLP’25 PCs) | *** Updating Area Keywords at ARR [https://aclrollingreview.org/areas] (leads: Anna, Mike, EMNLP’25 PCs) | ||
** Migrating to the new 10-week cycle schedule (leads: Anna) | *** Migrating to the new 10-week cycle schedule (leads: Anna) | ||
** New philosophy and implementation for workload requirement, inspired by CVPR 25: all qualified authors now expected to review (leads: Jonathan, Anna, Mike) | *** New philosophy and implementation for workload requirement, inspired by CVPR 25: all qualified authors now expected to review [https://aclrollingreview.org/incentives2025] (leads: Jonathan, Anna, Mike) | ||
** Updating reviewer sign-up forms (leads: Jonathan) | *** Updating reviewer sign-up forms (leads: Jonathan) | ||
** Contributing to development of the new policy on incentives in peer review at ARR | *** Contributing to development of the new policy on incentives in peer review at ARR [https://aclrollingreview.org/incentives2025] | ||
** Updating openreview forms, guidelines and documentation accordingly (leads: Anna, Sarv) | *** Updating openreview forms, guidelines and documentation accordingly (leads: Anna, Sarv) | ||
** Feb 2025: | |||
** Optimizing the AC assignments so that each AC works with fewer SACs (leads: Freda, Harold) | *** Optimizing the AC assignments so that each AC works with fewer SACs (leads: Freda, Harold) | ||
** Developing a workflow for processing reported cases of publication ethics violations with the help of ACL Publication Ethics Committee (leads: Leon, Kokil, Aoife) | *** Developing a workflow for processing reported cases of publication ethics [https://www.aclweb.org/adminwiki/index.php/ACL_Policy_on_Publication_Ethics] violations with the help of ACL Publication Ethics Committee [https://www.aclweb.org/portal/content/acl-publication-ethics-committee-0] (leads: Leon, Kokil, Aoife) | ||
** Improving submission and review forms (leads: Anna, ACL’25 and EMNLP’25 PCs) | *** Improving submission and review forms (leads: Anna, ACL’25 and EMNLP’25 PCs) | ||
** Updating the workload requirement, in consultation with ACL’25 PCs (leads: Jing, Xiaodan) | *** Updating the workload requirement [https://aclrollingreview.org/reviewing-workload-adjustment/], in consultation with ACL’25 PCs (leads: Jing, Xiaodan) | ||
** Corresponding updates to the guidelines and email templates (leads: Anna) | *** Corresponding updates to the guidelines and email templates (leads: Anna) | ||
** Developing new timeline for the new 10-week cycles (leads: Anna) | *** Developing new timeline for the new 10-week cycles (leads: Anna) | ||
** Developing a proposal for a development server (leads: Sudipta) | *** Developing a proposal for a development server (leads: Sudipta) | ||
** Contributing to discussions by the ACL peer review committee on review incentive policies | *** Contributing to discussions by the ACL peer review committee on review incentive policies | ||
* More changes in the past cycles can be found at the ARR change log: | * More changes in the past cycles can be found at the ARR change log: | ||
| Line 53: | Line 52: | ||
: [https://aclrollingreview.org/changelog ARR Changelog] | : [https://aclrollingreview.org/changelog ARR Changelog] | ||
= Open Issues | = Open Issues being Coped With = | ||
* AI-generated papers | * AI-generated papers | ||
* AI-generated reviews | * AI-generated reviews | ||
* Fake researcher profiles | * Fake researcher profiles | ||
Latest revision as of 19:22, 6 July 2025
ARR Team Update
- Current Team: ARR Organization Page
- Active Editors-in-Chief (EiCs): Vincent Ng, Anna Rogers, Jing Jiang, Michael White, Xiaodan Zhu, Sarvnaz Karimi, and Margot Mieskes
- Outgoing EiCs: Jun Suziki, Viviane Moreira (Thank you Jun and Viviane!)
- EiCs stepped down in the past 6 months: Tharmar Solorio, Lilja Øvrelid, Mausam
- Four new EiCs (Sep 2024): Michael White, Xiaodan Zhu, Sarvnaz Karimi, and Margot Mieskes
- Tech Team: Sudipta Kar (co-CTO), Freda Shi (co-CTO), Jonathan Kummerfeld (outgoing CTO)
- New support members: With the support from ACL, two new support members hired: Editorial assistant (Sonakshi Chauhan) and Workflow manager (Holy Lovenia)
- Recruitment: An advertisement has been posted to recruit the 2025 batch of new EiCs, who are expected to start in September/October 2025. We hope to recruit
- more editors to represent India and China, as these locations have a large volume of submissions.
Summary of Submission of Recent Cycles
More information can be found at: ARR Statistics
Changes Made in the Past Six Months
- Starting from the May 2025 cycle, ARR implemented the new 10-week cycle schedule
- Background: In the past (from October 2022 to February 2025), ARR ran 8-week review cycles,
- with submission deadlines on the 15th of every second month [1]. After extensive deliberation and
- soliciting community feedback [2], the ACL Peer Review Committee [3] recommended to ACL Exec to
- switch to 10-week cycles. The full committee report is available in the adminwiki [4].
- Changes implemented to cope with the increasing submissions:
- From the May 2025 cycle (EMNLP), following ACL Exec suggestion, all qualified authors of a submitted paper must review.
- In the February 2025 (ACL) cycle: each paper needs to nominate an author who will complete at least 4 reviews, and more
- reviews required when submitting multiple papers.
- Detailed changes in the last two ARR cycles:
- May 2025:
- Updating Area Keywords at ARR [5] (leads: Anna, Mike, EMNLP’25 PCs)
- Migrating to the new 10-week cycle schedule (leads: Anna)
- New philosophy and implementation for workload requirement, inspired by CVPR 25: all qualified authors now expected to review [6] (leads: Jonathan, Anna, Mike)
- Updating reviewer sign-up forms (leads: Jonathan)
- Contributing to development of the new policy on incentives in peer review at ARR [7]
- Updating openreview forms, guidelines and documentation accordingly (leads: Anna, Sarv)
- Feb 2025:
- Optimizing the AC assignments so that each AC works with fewer SACs (leads: Freda, Harold)
- Developing a workflow for processing reported cases of publication ethics [8] violations with the help of ACL Publication Ethics Committee [9] (leads: Leon, Kokil, Aoife)
- Improving submission and review forms (leads: Anna, ACL’25 and EMNLP’25 PCs)
- Updating the workload requirement [10], in consultation with ACL’25 PCs (leads: Jing, Xiaodan)
- Corresponding updates to the guidelines and email templates (leads: Anna)
- Developing new timeline for the new 10-week cycles (leads: Anna)
- Developing a proposal for a development server (leads: Sudipta)
- Contributing to discussions by the ACL peer review committee on review incentive policies
- May 2025:
- More changes in the past cycles can be found at the ARR change log:
Open Issues being Coped With
- AI-generated papers
- AI-generated reviews
- Fake researcher profiles