ACL Reviewer Guidelines - Revision history

Iryna Gurevych: /* Preserving Double Blind Review */ match wording on parent page

2024-01-12T13:24:34Z

Preserving Double Blind Review: match wording on parent page

← Older revision		Revision as of 13:24, 12 January 2024
Line 8:		Line 8:
	* If you do become aware of the authors' identity (by whatever means), let the area chairs (but not your fellow reviewers) know.		* If you do become aware of the authors' identity (by whatever means), let the area chairs (but not your fellow reviewers) know.
	* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.		* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.
	* <font color="red">After January 12, 2024, ACL reviewing procedures will explicitly ask ~~authors~~ to disclose any outside knowledge they may have about a submitted paper.</font>		* <font color="red">After January 12, 2024, ACL reviewing procedures will explicitly ask reviewers to disclose any outside knowledge they may have about a submitted paper, and will take this information into account when assigning and using reviews. This new policy is described [[ACL Anonymity Policy\|here]].</font>

	== Citation and Comparison ==		== Citation and Comparison ==

Iryna Gurevych: wording

2024-01-12T12:44:32Z

wording

← Older revision		Revision as of 12:44, 12 January 2024
Line 1:		Line 1:
	The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].		The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].
	* For corresponding author guidelines, see: [[ACL Author Guidelines]].		* For corresponding author guidelines, see: [[ACL Author Guidelines]].
	* For further motivation and discussion, we refer to the reports of the [[Media:ACL Guidelines for Submission, Review and Citation.pdf\|2017]] and [[ACL Anonymity Policy\|2023]] working groups appointed by the ACL Executive Committee.		* For further motivation and discussion, please refer to the reports of the [[Media:ACL Guidelines for Submission, Review and Citation.pdf\|2017]] and [[ACL Anonymity Policy\|2023]] working groups appointed by the ACL Executive Committee.

	== Preserving Double Blind Review ==		== Preserving Double Blind Review ==

Iryna Gurevych: improved style of links to previous reports

2024-01-12T12:44:01Z

improved style of links to previous reports

← Older revision		Revision as of 12:44, 12 January 2024
Line 1:		Line 1:
	The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].		The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].
	* For corresponding author guidelines, see: [[ACL Author Guidelines]].		* For corresponding author guidelines, see: [[ACL Author Guidelines]].
	* For further motivation and discussion, we refer to the ~~report~~ of the ~~2017 working group appointed by the ACL Executive Committee:~~ [[~~File~~:ACL Guidelines for Submission, Review and Citation.pdf]]		* For further motivation and discussion, we refer to the reports of the [[Media:ACL Guidelines for Submission, Review and Citation.pdf\|2017]] and [[ACL Anonymity Policy\|2023]] working groups appointed by the ACL Executive Committee.
	* <font color="red">On January 12, 2024, that report was partly superseded by the [[ACL Anonymity Policy\|~~report of the~~ 2023 ~~working group~~]].~~</font>~~

	== Preserving Double Blind Review ==		== Preserving Double Blind Review ==

Iryna Gurevych: bad link anchor

2024-01-12T12:28:00Z

bad link anchor

← Older revision		Revision as of 12:28, 12 January 2024
Line 1:		Line 1:
	The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].		The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].
	* For corresponding author guidelines, see: [[ACL Author Guidelines]].		* For corresponding author guidelines, see: [[ACL Author Guidelines]].
	* For further motivation and discussion, we refer to the [[File:ACL Guidelines for Submission, Review and Citation.pdf~~\|report of the 2017 working group~~]] ~~appointed by the ACL Executive Committee.~~		* For further motivation and discussion, we refer to the report of the 2017 working group appointed by the ACL Executive Committee: [[File:ACL Guidelines for Submission, Review and Citation.pdf]]
	* <font color="red">On January 12, 2024, that report was partly superseded by the [[ACL Anonymity Policy\|report of the 2023 working group]].</font>		* <font color="red">On January 12, 2024, that report was partly superseded by the [[ACL Anonymity Policy\|report of the 2023 working group]].</font>

Iryna Gurevych: link to new working group report

2024-01-12T12:24:51Z

link to new working group report

← Older revision		Revision as of 12:24, 12 January 2024
Line 1:		Line 1:
	The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].		The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].
	* For further motivation and discussion, we refer to the report of the working group appointed by the ACL Executive Committee: [[File:ACL Guidelines for Submission, Review and Citation.pdf]].
	* For corresponding author guidelines, see: [[ACL Author Guidelines]].		* For corresponding author guidelines, see: [[ACL Author Guidelines]].
			* For further motivation and discussion, we refer to the [[File:ACL Guidelines for Submission, Review and Citation.pdf\|report of the 2017 working group]] appointed by the ACL Executive Committee.
			* <font color="red">On January 12, 2024, that report was partly superseded by the [[ACL Anonymity Policy\|report of the 2023 working group]].</font>

	== Preserving Double Blind Review ==		== Preserving Double Blind Review ==
Line 8:		Line 9:
	* If you do become aware of the authors' identity (by whatever means), let the area chairs (but not your fellow reviewers) know.		* If you do become aware of the authors' identity (by whatever means), let the area chairs (but not your fellow reviewers) know.
	* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.		* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.
	* <font color="red">After January 12, 2024, ACL reviewing procedures will explicitly ask authors to disclose any outside knowledge they may have about a submitted paper~~. More information is [[ACL Anonymity Policy\|here]]~~.</font>		* <font color="red">After January 12, 2024, ACL reviewing procedures will explicitly ask authors to disclose any outside knowledge they may have about a submitted paper.</font>

	== Citation and Comparison ==		== Citation and Comparison ==

Iryna Gurevych: /* Preserving Double Blind Review */ added link to policy change

2024-01-12T12:21:48Z

Preserving Double Blind Review: added link to policy change

← Older revision		Revision as of 12:21, 12 January 2024
Line 8:		Line 8:
	* If you do become aware of the authors' identity (by whatever means), let the area chairs (but not your fellow reviewers) know.		* If you do become aware of the authors' identity (by whatever means), let the area chairs (but not your fellow reviewers) know.
	* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.		* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.
			* <font color="red">After January 12, 2024, ACL reviewing procedures will explicitly ask authors to disclose any outside knowledge they may have about a submitted paper. More information is [[ACL Anonymity Policy\|here]].</font>

	== Citation and Comparison ==		== Citation and Comparison ==

ShiqiZhao at 11:31, 18 October 2017

2017-10-18T11:31:11Z

← Older revision		Revision as of 11:31, 18 October 2017
Line 1:		Line 1:
	The following guidelines can be used by conferences and journals who adopt the [[ACL Policies on Submission, Review and Citation]].		The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].
	* For further motivation and discussion, we refer to the report of the working group appointed by the ACL Executive Committee: [[File:ACL Guidelines for Submission, Review and Citation.pdf]].		* For further motivation and discussion, we refer to the report of the working group appointed by the ACL Executive Committee: [[File:ACL Guidelines for Submission, Review and Citation.pdf]].
	* For corresponding author guidelines, see: [[ACL Author Guidelines]].		* For corresponding author guidelines, see: [[ACL Author Guidelines]].

ShiqiZhao at 11:27, 18 October 2017

2017-10-18T11:27:59Z

← Older revision		Revision as of 11:27, 18 October 2017
Line 6:		Line 6:

	* Reviewing may involve an online search for related work. However, do not set out to uncover the identity of the authors and try not to let any suspicions regarding author identity affect your judgement. To reduce the risk of bias, it is a good idea to read the paper and draft an initial review before you carry out any online searches that risk discovering authorship. You should be especially careful if an area chair has informed you that a non-anonymized version of the paper is available online.		* Reviewing may involve an online search for related work. However, do not set out to uncover the identity of the authors and try not to let any suspicions regarding author identity affect your judgement. To reduce the risk of bias, it is a good idea to read the paper and draft an initial review before you carry out any online searches that risk discovering authorship. You should be especially careful if an area chair has informed you that a non-anonymized version of the paper is available online.
	* If you do become aware of the ~~authors’~~ identity (by whatever means), let the area chairs (but not your fellow reviewers) know.		* If you do become aware of the authors' identity (by whatever means), let the area chairs (but not your fellow reviewers) know.
	* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.		* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.

			== Citation and Comparison ==

			* Evaluate papers based on your knowledge of the subject, regardless of where you gained this knowledge. If you are aware of relevant publicly available research that has not been cited in the paper you are reviewing, you should bring it to the attention of the authors, irrespective of whether it is described in a preprint or a refereed publication. However, if the work appears only in a preprint, especially one that is recent and/or not widely cited, you should in general give authors the benefit of the doubt and not penalize them for the missing citation.
			* Papers should include appropriate discussion of related work, potentially including both preprints and refereed publications. However, it is not reasonable to expect a time-consuming empirical comparison with work that has appeared ''less than 3 months before the submission deadline''. In this situation, the two papers are considered to be ''contemporaneous''. Contemporaneous papers may affect your perspective on the ''quality'' of a submission, but should be disregarded when evaluating the ''novelty'' of the submission, unless there is evidence that they have influenced the submission.

ShiqiZhao at 11:25, 18 October 2017

2017-10-18T11:25:18Z

← Older revision		Revision as of 11:25, 18 October 2017
Line 1:		Line 1:
	The following guidelines can be used by conferences and journals who adopt the [[ACL Policies on Submission, Review and Citation]].		The following guidelines can be used by conferences and journals who adopt the [[ACL Policies on Submission, Review and Citation]].
	* For further motivation and discussion, we refer to the report of the working group appointed by the ACL Executive Committee: [[File:ACL Guidelines for Submission, Review and Citation]].		* For further motivation and discussion, we refer to the report of the working group appointed by the ACL Executive Committee: [[File:ACL Guidelines for Submission, Review and Citation.pdf]].
	* For corresponding author guidelines, see: [[ACL Author Guidelines]].		* For corresponding author guidelines, see: [[ACL Author Guidelines]].

			== Preserving Double Blind Review ==

			* Reviewing may involve an online search for related work. However, do not set out to uncover the identity of the authors and try not to let any suspicions regarding author identity affect your judgement. To reduce the risk of bias, it is a good idea to read the paper and draft an initial review before you carry out any online searches that risk discovering authorship. You should be especially careful if an area chair has informed you that a non-anonymized version of the paper is available online.
			* If you do become aware of the authors’ identity (by whatever means), let the area chairs (but not your fellow reviewers) know.
			* If you come across a preprint or paper that has a substantial text overlap with the submission, report this to the area chairs even if the existence of a preprint has been declared, since you do not know whether the authors of the discovered paper are the authors of the submission under review, and so the possibility of plagiarism needs to be considered.

ShiqiZhao: Created page with "The following guidelines can be used by conferences and journals who adopt the ACL Policies on Submission, Review and Citation. * For further motivation and discussion, w..."

2017-10-18T11:22:36Z

Created page with "The following guidelines can be used by conferences and journals who adopt the ACL Policies on Submission, Review and Citation. * For further motivation and discussion, w..."

New page

The following guidelines can be used by conferences and journals who adopt the [[ACL Policies on Submission, Review and Citation]].
* For further motivation and discussion, we refer to the report of the working group appointed by the ACL Executive Committee: [[File:ACL Guidelines for Submission, Review and Citation]].
* For corresponding author guidelines, see: [[ACL Author Guidelines]].