2019Q1 Reports: TACL Journal - Revision history

LillianLee: /* Number of submissions and days to first decision */ typoe

2019-05-12T22:03:15Z

Number of submissions and days to first decision: typoe

← Older revision		Revision as of 22:03, 12 May 2019
Line 38:		Line 38:
	* The number of submissions tends to drop in early summer.		* The number of submissions tends to drop in early summer.

	Now, here is the history, depicted in terms of quartiles, of the average time to first decision, excluding desk rejects, grouped by round (=nearest first-of-the-month). A blue line ~~showsWhen~~ the average time for each submission month, and the red horizontal line shows our “goal” time of 45 days. Yellow shading indicates alternate calendar years.		Now, here is the history, depicted in terms of quartiles, of the average time to first decision, excluding desk rejects, grouped by round (=nearest first-of-the-month). A blue line shows the average time for each submission month, and the red horizontal line shows our “goal” time of 45 days. Yellow shading indicates alternate calendar years.
	''More details'': The decision time for papers submitted for a given month is counted as starting from the first of that month. Most May-2019 papers, and about 11 March-2019 papers, have not yet been decided, so the shape of the right-hand side of the graph will change. Also not counted: papers handled using START (the early days of TACL) and papers archived for some technical or formatting problem.)		''More details'': The decision time for papers submitted for a given month is counted as starting from the first of that month. Most May-2019 papers, and about 11 March-2019 papers, have not yet been decided, so the shape of the right-hand side of the graph will change. Also not counted: papers handled using START (the early days of TACL) and papers archived for some technical or formatting problem.)

LillianLee: /* Distribution of decisions */ - fix spacing

2019-05-11T22:08:45Z

Distribution of decisions: - fix spacing

← Older revision		Revision as of 22:08, 11 May 2019
Line 59:		Line 59:

	Of the additional 28 resubmissions of (c)s that were submitted during the same period and received a decision, and recalling that TACL policy is not to give two (c)s in a row, the breakdown was:		Of the additional 28 resubmissions of (c)s that were submitted during the same period and received a decision, and recalling that TACL policy is not to give two (c)s in a row, the breakdown was:
	11% (a)		11% (a)
	43% (b)		43% (b)
	39% (d)		39% (d)

	There was one special case that had to be handled differently.		There was one special case that had to be handled differently.

LillianLee: typos, added more detailed distribution for (c) resubmits.

2019-05-11T22:07:55Z

typos, added more detailed distribution for (c) resubmits.

← Older revision		Revision as of 22:07, 11 May 2019
Line 7:		Line 7:
	MIT Press will also be handling the application of TACL to be indexed by the major services. During the period covered by this report, we have prepared most of the documentation required for this application. We are in the midst of completing the final piece, a publication ethics statement, which should certainly be done in the next two months, as a very generous upper bound.		MIT Press will also be handling the application of TACL to be indexed by the major services. During the period covered by this report, we have prepared most of the documentation required for this application. We are in the midst of completing the final piece, a publication ethics statement, which should certainly be done in the next two months, as a very generous upper bound.

	== Finding professional submission support ==		== Finding professional submission-system support ==

	TACL is in the midst of discussions with various vendors regarding professional paid support of the submission system, currently a 2.x version of OJS with in-house modifications. (The publication system, handled by MIT Press, is disjoint.)		TACL is in the midst of discussions with various vendors regarding professional paid support of the submission system, currently a 2.x version of OJS with in-house modifications. (The publication system, handled by MIT Press, is disjoint.)

	An issue is that the latest version of OJS 3.x is a poor fit with some of TACL’s workflow, but 2.x is deprecated. TACL will probably transition to professional paid support of a version of the current system upgraded to 2.4.8 during this calendar year. Upgrading to 3.x remains an option for future years.		An issue is that the latest version of OJS 3.x is a poor fit with some of TACL’s workflow, but 2.x is deprecated. TACL will probably transition to professional paid support of a version of the current system upgraded to 2.4.8 during this calendar year. Upgrading to 3.x remains an option for future years.
	z
	== Personnel updates ==		== Personnel updates ==

Line 26:		Line 26:
	=== Number of submissions and days to first decision ===		=== Number of submissions and days to first decision ===

	Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems ~~and~~ papers handled using START (the early days of TACL).		Here is the number of first submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems, papers handled using START (the early days of TACL), and re-submissions.


Line 38:		Line 38:
	* The number of submissions tends to drop in early summer.		* The number of submissions tends to drop in early summer.

	Now, here is the history, depicted in terms of quartiles, of the average time to first decision, excluding desk rejects, grouped by round (=nearest first-of-the-month). A blue line ~~shows connects~~ the average time for each submission month, and the red horizontal line shows our “goal” time of 45 days. Yellow shading indicates alternate calendar years.		Now, here is the history, depicted in terms of quartiles, of the average time to first decision, excluding desk rejects, grouped by round (=nearest first-of-the-month). A blue line showsWhen the average time for each submission month, and the red horizontal line shows our “goal” time of 45 days. Yellow shading indicates alternate calendar years.
	''More details'': The decision time for papers submitted for a given month is counted as starting from the first of that month. Most May-2019 papers, and about 11 March-2019 papers, have not yet been decided, so the shape of the right-hand side of the graph will change. Also not counted: papers handled using START (the early days of TACL) and papers archived for some technical or formatting problem.)		''More details'': The decision time for papers submitted for a given month is counted as starting from the first of that month. Most May-2019 papers, and about 11 March-2019 papers, have not yet been decided, so the shape of the right-hand side of the graph will change. Also not counted: papers handled using START (the early days of TACL) and papers archived for some technical or formatting problem.)

Line 45:		Line 45:
	''Observations'':		''Observations'':

	* The average time to first decision continues to bounce between 50-60 days. The ideal timeline would be 45 days (a detailed breakdown of this ideal can be found at the "Reviewing Procedure" section of So we are running about a week or week and a half, on average, later than we would ideally be.		* The average time to first decision continues to bounce between 50-60 days. The ideal timeline would be 45 days (a detailed breakdown of this ideal can be found at the "Reviewing Procedure" section of [https://transacl.org/ojs/index.php/tacl/about/editorialPolicies#peerReviewProcess]. So we are running about a week or week and a half, on average, later than we would ideally like to be.
	** It's worth pointing out that, for reviewers that complete their reviews, over the past 12 months, the average review-completion time is 24.4 days, where the TACL "contract" is 21 days. Many, many thanks to these wonderful reviewers!		** It's worth pointing out that, for reviewers that complete their reviews, over the past 12 months, the average review-completion time is 24.4 days, where the TACL "contract" is 21 days. Many, many thanks to these wonderful reviewers!
	* Time to first decision seems to spike in early spring. Anecdotal evidence suggests that one cause is Action Editor and reviewer commitments to conferences (or burnout from said commitments). Admittedly, another contributing factor could be that the spring semesters constitute very heavy teaching loads for one of the co-EiCs.		* Time to first decision seems to spike in early spring. Anecdotal evidence suggests that one cause is Action Editor and reviewer commitments to conferences (or burnout from said commitments). Admittedly, another contributing factor could be that the spring semesters constitute very heavy teaching loads for one of the co-EiCs.

	=== Distribution of ~~first~~ decisions ===		=== Distribution of decisions ===

	We had 135 papers submitted from the May 2018 round through the present, inclusive, that received a ''first'' decision. Of these, 18 (13%) were desk-rejected. Of the 117 left, the decision breakdown was:		We had 135 papers submitted from the May 2018 round through the present, inclusive, that received a ''first'' decision. Of these, 18 (13%) were desk-rejected. Of the 117 left, the decision breakdown was:

	2% (a) = accepted as is		2% (a) = accepted as is
	23% (b) = conditional accept: acceptance guaranteed if conditions met		23% (b) = conditional accept: acceptance guaranteed if conditions met
	58% (c) = rejected, encourage resubmission but no guarantee of acceptance		58% (c) = rejected, encourage resubmission but no guarantee of acceptance
	27% (d) = rejected with 1-year moratorium on TACL submission.		27% (d) = rejected with 1-year moratorium on TACL submission.

	Of the additional 28 resubmissions of (c)s that were submitted during the same period and received a decision, ~~54% received a conditional accept or an accept. 39% received a (d), as~~ TACL policy is to ~~not~~ give two (c)s in a row. ~~The remaining paper~~ was a special case that had to be handled differently.		Of the additional 28 resubmissions of (c)s that were submitted during the same period and received a decision, and recalling that TACL policy is not to give two (c)s in a row, the breakdown was:
			11% (a)
			43% (b)
			39% (d)

			There was one special case that had to be handled differently.

	=== Number of TACL papers presented at conferences ===		=== Number of TACL papers presented at conferences ===

LillianLee: added reviewer time

2019-05-11T04:54:17Z

added reviewer time

← Older revision		Revision as of 04:54, 11 May 2019
Line 12:		Line 12:

	An issue is that the latest version of OJS 3.x is a poor fit with some of TACL’s workflow, but 2.x is deprecated. TACL will probably transition to professional paid support of a version of the current system upgraded to 2.4.8 during this calendar year. Upgrading to 3.x remains an option for future years.		An issue is that the latest version of OJS 3.x is a poor fit with some of TACL’s workflow, but 2.x is deprecated. TACL will probably transition to professional paid support of a version of the current system upgraded to 2.4.8 during this calendar year. Upgrading to 3.x remains an option for future years.
			z
	== Personnel updates ==		== Personnel updates ==

Line 27:		Line 27:

	Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems and papers handled using START (the early days of TACL).		Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems and papers handled using START (the early days of TACL).


	[[File:2019Q1_TACL.number_of_submissions.png\|800px]]		[[File:2019Q1_TACL.number_of_submissions.png\|800px]]


	''Observations'':		''Observations'':

	* The trendline (omitted) is very slightly upwards, which should perhaps be interpreted as stable. We expect the number of submissions to increase dramatically once TACL is indexed by the major services.		* The trendline (omitted) is very slightly upwards, which should perhaps be interpreted as stable. We expect the number of submissions to increase dramatically once TACL is indexed by the major services.
	* The number of submissions tends to peak around early winter, perhaps as authors		* The number of submissions tends to peak around early winter, perhaps as authors strive to submit in time for their papers to be accepted at ACL.
	strive to submit in time for their papers to be accepted at ACL.
	* The number of submissions tends to drop in early summer.		* The number of submissions tends to drop in early summer.


	Now, here is the history, depicted in terms of quartiles, of the average time to first decision, excluding desk rejects, grouped by round (=nearest first-of-the-month). A blue line shows connects the average time for each submission month, and the red horizontal line shows our “goal” time of 45 days. Yellow shading indicates alternate calendar years.		Now, here is the history, depicted in terms of quartiles, of the average time to first decision, excluding desk rejects, grouped by round (=nearest first-of-the-month). A blue line shows connects the average time for each submission month, and the red horizontal line shows our “goal” time of 45 days. Yellow shading indicates alternate calendar years.
Line 42:		Line 42:

	[[File:2019Q1_TACL.per-paper-days-to-decision.png\|800px]]		[[File:2019Q1_TACL.per-paper-days-to-decision.png\|800px]]


	''Observations'':		''Observations'':

	* The average time to first decision continues to bounce between 50-60 days. The ideal timeline would be 45 days (a detailed breakdown of this ideal can be found at the "Reviewing Procedure" section of So we are running about a week or week and a half, on average, later than we would ideally be.		* The average time to first decision continues to bounce between 50-60 days. The ideal timeline would be 45 days (a detailed breakdown of this ideal can be found at the "Reviewing Procedure" section of So we are running about a week or week and a half, on average, later than we would ideally be.
			** It's worth pointing out that, for reviewers that complete their reviews, over the past 12 months, the average review-completion time is 24.4 days, where the TACL "contract" is 21 days. Many, many thanks to these wonderful reviewers!
	* Time to first decision seems to spike in early spring. Anecdotal evidence suggests that one cause is Action Editor and reviewer commitments to conferences (or burnout from said commitments). Admittedly, another contributing factor could be that the spring semesters constitute very heavy teaching loads for one of the co-EiCs.		* Time to first decision seems to spike in early spring. Anecdotal evidence suggests that one cause is Action Editor and reviewer commitments to conferences (or burnout from said commitments). Admittedly, another contributing factor could be that the spring semesters constitute very heavy teaching loads for one of the co-EiCs.

LillianLee: shrink size of /* Number of submissions and days to first decision */

2019-05-11T04:43:06Z

shrink size of Number of submissions and days to first decision

← Older revision		Revision as of 04:43, 11 May 2019
Line 28:		Line 28:
	Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems and papers handled using START (the early days of TACL).		Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems and papers handled using START (the early days of TACL).

	[[File:2019Q1_TACL.number_of_submissions.png]]		[[File:2019Q1_TACL.number_of_submissions.png\|800px]]

	''Observations'':		''Observations'':

LillianLee: minor fixes and correction of file name

2019-05-11T04:39:59Z

minor fixes and correction of file name

← Older revision		Revision as of 04:39, 11 May 2019
Line 12:		Line 12:

	An issue is that the latest version of OJS 3.x is a poor fit with some of TACL’s workflow, but 2.x is deprecated. TACL will probably transition to professional paid support of a version of the current system upgraded to 2.4.8 during this calendar year. Upgrading to 3.x remains an option for future years.		An issue is that the latest version of OJS 3.x is a poor fit with some of TACL’s workflow, but 2.x is deprecated. TACL will probably transition to professional paid support of a version of the current system upgraded to 2.4.8 during this calendar year. Upgrading to 3.x remains an option for future years.


	== Personnel updates ==		== Personnel updates ==
Line 29:		Line 28:
	Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems and papers handled using START (the early days of TACL).		Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems and papers handled using START (the early days of TACL).

	[[File:2019Q1_TACL.~~days_to_decision~~.png]]		[[File:2019Q1_TACL.number_of_submissions.png]]

	''Observations'':		''Observations'':

LillianLee: Report except for plots

2019-05-11T04:36:54Z

Report except for plots

← Older revision		Revision as of 04:36, 11 May 2019
Line 1:		Line 1:
	''We thank ACL ~~Secretary Shiqi Zhao~~ for ~~arranging a due date~~ of ~~May 10th~~ for this ~~report~~. We ~~will~~ be ~~describing progress on searching for~~ professional support ~~for~~ the submission system, the transition to ~~MIT Press~~, and ~~statistics on~~ submissions and ~~outcomes~~. --- the TACL co-~~EICs~~''		== MIT Press transition ==

			We are pleased to report that all TACL papers, past and present, are now available at the MIT Press website, with the first batch of MIT-Press-managed papers having been released in December 2018. This was a few months later than we had all planned, but here in May 2019, we have, we believe, smoothed out many of the wrinkles in the process of coordinating between two complex entities and in reworking our "legal" apparati (forms and policies regarding copyright, preprint posting, releases, etc.). We would like to especially thank Levi Rubeck of MIT Press for being so helpful and thoughtful throughout; his patience in working out the details with TACL are greatly appreciated. We also thank Matt Post and Arya McCarthy of the ACL Anthology for help in working out issues in transferring data from MIT Press to the Anthology.

			Unfortunately, the planned integration with Overleaf on the MIT Press side did not happen.

			MIT Press will also be handling the application of TACL to be indexed by the major services. During the period covered by this report, we have prepared most of the documentation required for this application. We are in the midst of completing the final piece, a publication ethics statement, which should certainly be done in the next two months, as a very generous upper bound.

			== Finding professional submission support ==

			TACL is in the midst of discussions with various vendors regarding professional paid support of the submission system, currently a 2.x version of OJS with in-house modifications. (The publication system, handled by MIT Press, is disjoint.)

			An issue is that the latest version of OJS 3.x is a poor fit with some of TACL’s workflow, but 2.x is deprecated. TACL will probably transition to professional paid support of a version of the current system upgraded to 2.4.8 during this calendar year. Upgrading to 3.x remains an option for future years.


			== Personnel updates ==

			An ad hoc search committee (chaired by Jan Hajic) has organised a search for a new co-Editor-in-Chief (EiC) to replace Lillian Lee, who will be retiring from TACL in December 2019. A call for nominations has been issued, deadline May 27, 2019:
			https://www.aclweb.org/portal/content/call-nominations-tacl-co-editor-chief-summer-2019-summer-2022

			We note that Mark Johnson’s co-EiC term ends in June 2020, at which point TACL will revert to having two co-EiCs. Brian Roark’s term ends June 2021.

			TACL currently has roughly 50 Action Editors (AEs) and roughly 230 members of the elite standing reviewing pool, while maintaining minimum eligibility requirements of the equivalent of tenured experience in the field (AEs) or several years post-PhD in the field (standing reviewers). The AEs and standing reviewers have done a terrific job upholding TACL standards, although even with the increased size of these two groups, it is sometimes a challenge to balance reviewing assignments and our “one person, one paper” workload objective in the face of increased submissions and re-submissions. Our AEs and standing reviewers are listed at: https://transacl.org/ojs/index.php/tacl/about/editorialTeam .

			== Statistics ==

			=== Number of submissions and days to first decision ===

			Here is the number of submissions per monthly submission round (=nearest first-of-the-month), including desk rejects (see caveats at the end of this paragraph). ''More details'': this plot excludes first versions of papers that were not considered due to minor technical formatting problems and papers handled using START (the early days of TACL).

			[[File:2019Q1_TACL.days_to_decision.png]]

			''Observations'':

			* The trendline (omitted) is very slightly upwards, which should perhaps be interpreted as stable. We expect the number of submissions to increase dramatically once TACL is indexed by the major services.
			* The number of submissions tends to peak around early winter, perhaps as authors
			strive to submit in time for their papers to be accepted at ACL.
			* The number of submissions tends to drop in early summer.


			Now, here is the history, depicted in terms of quartiles, of the average time to first decision, excluding desk rejects, grouped by round (=nearest first-of-the-month). A blue line shows connects the average time for each submission month, and the red horizontal line shows our “goal” time of 45 days. Yellow shading indicates alternate calendar years.
			''More details'': The decision time for papers submitted for a given month is counted as starting from the first of that month. Most May-2019 papers, and about 11 March-2019 papers, have not yet been decided, so the shape of the right-hand side of the graph will change. Also not counted: papers handled using START (the early days of TACL) and papers archived for some technical or formatting problem.)

			[[File:2019Q1_TACL.per-paper-days-to-decision.png\|800px]]


			''Observations'':

			* The average time to first decision continues to bounce between 50-60 days. The ideal timeline would be 45 days (a detailed breakdown of this ideal can be found at the "Reviewing Procedure" section of So we are running about a week or week and a half, on average, later than we would ideally be.
			* Time to first decision seems to spike in early spring. Anecdotal evidence suggests that one cause is Action Editor and reviewer commitments to conferences (or burnout from said commitments). Admittedly, another contributing factor could be that the spring semesters constitute very heavy teaching loads for one of the co-EiCs.

			=== Distribution of first decisions ===

			We had 135 papers submitted from the May 2018 round through the present, inclusive, that received a ''first'' decision. Of these, 18 (13%) were desk-rejected. Of the 117 left, the decision breakdown was:

			2% (a) = accepted as is
			23% (b) = conditional accept: acceptance guaranteed if conditions met
			58% (c) = rejected, encourage resubmission but no guarantee of acceptance
			27% (d) = rejected with 1-year moratorium on TACL submission.

			Of the additional 28 resubmissions of (c)s that were submitted during the same period and received a decision, 54% received a conditional accept or an accept. 39% received a (d), as TACL policy is to not give two (c)s in a row. The remaining paper was a special case that had to be handled differently.

			=== Number of TACL papers presented at conferences ===

			These counts are not broken down by talk vs. poster, but rather, group these categories together.

			ACL 2019: 22 (3 conditional on AE technical approval of final version, to be submitted).
			NAACL 2019: 8
			EMNLP 2018: 10
			ACL 2018: 20
			NAACL 2018: 16

			It should be noted that some TACL authors do request poster presentation rather than a talk.

			=== Publishing statistics ===

			Volume 6 (2018) had 48 non-erratum papers and 0 errata. So far, volume 7 (2019) has 14 non-erratum papers and 0 errata, with 11 papers in the publication queue and 7 awaiting submission of the final version by the authors.

LillianLee: give timeline for report and description of what to expect.

2019-05-01T12:49:24Z

give timeline for report and description of what to expect.

New page

''We thank ACL Secretary Shiqi Zhao for arranging a due date of May 10th for this report. We will be describing progress on searching for professional support for the submission system, the transition to MIT Press, and statistics on submissions and outcomes. --- the TACL co-EICs''