2025Q3 Reports: ARR Editors in Chief: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
| (13 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
= ARR Team Update = | = ARR Team Update = | ||
'''Current Team''': [https://aclrollingreview.org/organization ARR Organization Page] | * '''Current Team''': [https://aclrollingreview.org/organization ARR Organization Page] | ||
** '''Active Editors-in-Chief (EiCs)''': Vincent Ng, Anna Rogers, Jing Jiang, Michael White, Xiaodan Zhu, Sarvnaz Karimi, and Margot Mieskes | |||
** '''Outgoing EiCs''': Jun Suziki, Viviane Moreira (Thank you Jun and Viviane!) | |||
** '''EiCs stepped down in the past 6 months''': Tharmar Solorio, Lilja Øvrelid, Mausam | |||
** '''Four new EiCs (Sep 2024)''': Michael White, Xiaodan Zhu, Sarvnaz Karimi, and Margot Mieskes | |||
** '''Tech Team''': Sudipta Kar (co-CTO), Freda Shi (co-CTO), Jonathan Kummerfeld (outgoing CTO) | |||
** '''New support members''': With the support from ACL, two new support members hired: Editorial assistant (Sonakshi Chauhan) and Workflow manager (Holy Lovenia) | |||
* '''Recruitment''': An advertisement has been posted to recruit the 2025 batch of new EiCs, who are expected to start in September/October 2025. We hope to recruit <br /> | |||
: more editors to represent India and China, as these locations have a large volume of submissions. | |||
= Summary of Submission of Recent Cycles = | |||
[[File:ARR submission numbers.jpg|600px]] | |||
More information can be found at: [https://stats.aclrollingreview.org/ ARR Statistics] | More information can be found at: [https://stats.aclrollingreview.org/ ARR Statistics] | ||
| Line 25: | Line 21: | ||
* Starting from the May 2025 cycle, ARR implemented the new 10-week cycle schedule | * Starting from the May 2025 cycle, ARR implemented the new 10-week cycle schedule | ||
: Background: | : Background: In the past (from October 2022 to February 2025), ARR ran 8-week review cycles, | ||
of every second month. After community feedback, the ACL Peer Review Committee recommended | : with submission deadlines on the 15th of every second month [https://aclrollingreview.org/key-changes-in-the-october-cycle/]. After extensive deliberation and | ||
10-week cycles. | : soliciting community feedback [https://www.aclweb.org/portal/content/acl-survey-what-should-acl-peer-review-process-be-future], the ACL Peer Review Committee [https://www.aclweb.org/adminwiki/index.php/ACL_Peer_Review_Standing_Committee] recommended to ACL Exec to | ||
: switch to 10-week cycles. The full committee report is available in the adminwiki [https://www.aclweb.org/adminwiki/images/9/9e/COPR-5-cycle-report-to-publish.pdf]. | |||
* Changes implemented to cope with the increasing submissions: | |||
** | ** From the May 2025 cycle (EMNLP), following ACL Exec suggestion, all qualified authors of a submitted paper must review. | ||
** | ** In the February 2025 (ACL) cycle: each paper needs to nominate an author who will complete at least 4 reviews, and more | ||
** | :: reviews required when submitting multiple papers. | ||
** | * Detailed changes in the last two ARR cycles: | ||
** | ** May 2025: | ||
** | *** Updating Area Keywords at ARR [https://aclrollingreview.org/areas] (leads: Anna, Mike, EMNLP’25 PCs) | ||
** | *** Migrating to the new 10-week cycle schedule (leads: Anna) | ||
** | *** New philosophy and implementation for workload requirement, inspired by CVPR 25: all qualified authors now expected to review [https://aclrollingreview.org/incentives2025] (leads: Jonathan, Anna, Mike) | ||
*** Updating reviewer sign-up forms (leads: Jonathan) | |||
*** Contributing to development of the new policy on incentives in peer review at ARR [https://aclrollingreview.org/incentives2025] | |||
*** Updating openreview forms, guidelines and documentation accordingly (leads: Anna, Sarv) | |||
** Feb 2025: | |||
*** Optimizing the AC assignments so that each AC works with fewer SACs (leads: Freda, Harold) | |||
*** Developing a workflow for processing reported cases of publication ethics [https://www.aclweb.org/adminwiki/index.php/ACL_Policy_on_Publication_Ethics] violations with the help of ACL Publication Ethics Committee [https://www.aclweb.org/portal/content/acl-publication-ethics-committee-0] (leads: Leon, Kokil, Aoife) | |||
*** Improving submission and review forms (leads: Anna, ACL’25 and EMNLP’25 PCs) | |||
*** Updating the workload requirement [https://aclrollingreview.org/reviewing-workload-adjustment/], in consultation with ACL’25 PCs (leads: Jing, Xiaodan) | |||
*** Corresponding updates to the guidelines and email templates (leads: Anna) | |||
*** Developing new timeline for the new 10-week cycles (leads: Anna) | |||
*** Developing a proposal for a development server (leads: Sudipta) | |||
*** Contributing to discussions by the ACL peer review committee on review incentive policies | |||
* More changes in the past cycles can be found at the ARR change log: | * More changes in the past cycles can be found at the ARR change log: | ||
: [https://aclrollingreview.org/changelog ARR Changelog] | |||
= Open Issues = | = Open Issues being Coped With = | ||
* AI-generated papers | * AI-generated papers | ||
* AI-generated reviews | * AI-generated reviews | ||
* Fake researcher profiles | * Fake researcher profiles | ||
Latest revision as of 19:22, 6 July 2025
ARR Team Update
- Current Team: ARR Organization Page
- Active Editors-in-Chief (EiCs): Vincent Ng, Anna Rogers, Jing Jiang, Michael White, Xiaodan Zhu, Sarvnaz Karimi, and Margot Mieskes
- Outgoing EiCs: Jun Suziki, Viviane Moreira (Thank you Jun and Viviane!)
- EiCs stepped down in the past 6 months: Tharmar Solorio, Lilja Øvrelid, Mausam
- Four new EiCs (Sep 2024): Michael White, Xiaodan Zhu, Sarvnaz Karimi, and Margot Mieskes
- Tech Team: Sudipta Kar (co-CTO), Freda Shi (co-CTO), Jonathan Kummerfeld (outgoing CTO)
- New support members: With the support from ACL, two new support members hired: Editorial assistant (Sonakshi Chauhan) and Workflow manager (Holy Lovenia)
- Recruitment: An advertisement has been posted to recruit the 2025 batch of new EiCs, who are expected to start in September/October 2025. We hope to recruit
- more editors to represent India and China, as these locations have a large volume of submissions.
Summary of Submission of Recent Cycles
More information can be found at: ARR Statistics
Changes Made in the Past Six Months
- Starting from the May 2025 cycle, ARR implemented the new 10-week cycle schedule
- Background: In the past (from October 2022 to February 2025), ARR ran 8-week review cycles,
- with submission deadlines on the 15th of every second month [1]. After extensive deliberation and
- soliciting community feedback [2], the ACL Peer Review Committee [3] recommended to ACL Exec to
- switch to 10-week cycles. The full committee report is available in the adminwiki [4].
- Changes implemented to cope with the increasing submissions:
- From the May 2025 cycle (EMNLP), following ACL Exec suggestion, all qualified authors of a submitted paper must review.
- In the February 2025 (ACL) cycle: each paper needs to nominate an author who will complete at least 4 reviews, and more
- reviews required when submitting multiple papers.
- Detailed changes in the last two ARR cycles:
- May 2025:
- Updating Area Keywords at ARR [5] (leads: Anna, Mike, EMNLP’25 PCs)
- Migrating to the new 10-week cycle schedule (leads: Anna)
- New philosophy and implementation for workload requirement, inspired by CVPR 25: all qualified authors now expected to review [6] (leads: Jonathan, Anna, Mike)
- Updating reviewer sign-up forms (leads: Jonathan)
- Contributing to development of the new policy on incentives in peer review at ARR [7]
- Updating openreview forms, guidelines and documentation accordingly (leads: Anna, Sarv)
- Feb 2025:
- Optimizing the AC assignments so that each AC works with fewer SACs (leads: Freda, Harold)
- Developing a workflow for processing reported cases of publication ethics [8] violations with the help of ACL Publication Ethics Committee [9] (leads: Leon, Kokil, Aoife)
- Improving submission and review forms (leads: Anna, ACL’25 and EMNLP’25 PCs)
- Updating the workload requirement [10], in consultation with ACL’25 PCs (leads: Jing, Xiaodan)
- Corresponding updates to the guidelines and email templates (leads: Anna)
- Developing new timeline for the new 10-week cycles (leads: Anna)
- Developing a proposal for a development server (leads: Sudipta)
- Contributing to discussions by the ACL peer review committee on review incentive policies
- May 2025:
- More changes in the past cycles can be found at the ARR change log:
Open Issues being Coped With
- AI-generated papers
- AI-generated reviews
- Fake researcher profiles