Admin Wiki - User contributions [en]

2026Q1 Reports: Anthology Director

2026-03-11T15:09:23Z

Matt Post: Created page

== Overview ==

The Anthology staff comprises Matt Post (director since 2019), two current paid assistants (David Stap, Ankur Kejriwal), and a number of volunteers. Over the past six months, active volunteers include Marcel Bollmann, Nathan Schneider, David Chiang, and Arne Koehn. We have lost our assistant, Xinru Yan, who took care of day-to-day operations, and I need to post an ad to find a replacement with a sharp editorial eye.

A. Seza Doğruöz continues to handle submission of main conference materials to various indexing services (Web of Science, Scopus).

== Main items ==

Here are the main accomplishments and discussion points since July 2025:

* We completed our [https://aclanthology.org/posts/2026-01-26-new-author-system/ author transition] to the use of ORCID iDs. This was a tremendous software engineering and planning effort championed mostly by Marcel Bollmann, Nathan Schneider, and myself, with input also from David Chiang and Arne Koehn. We are now working to advertise this to ensure that authors create iDs and add this information to their profiles in various submission systems. We are in communication with MIT Press, ARR, and Softconf (who added the information to their ACLPUB exports). We have contacted CCL. We are trying to reach LREC.

* Nathan Schneider has been working steadily through the author page backlog, where we manually verify and disambiguate author pages.

* Nathan Schneider created a very useful issues dashboard. We have reduced the number of open issues from 578 (on January 11) to 350 (March 11). This has been very useful. There are currently (March 11) 88 author page requests open, 32 paper metadata requests, 26 ingestions, and a number of other issues, ~150 assigned to milestones throughout this current calendar year

== Plans ==

We continue to hope to be able to expand our citation framework to include plenary videos. This task is left over from last year and was stalled due to the intense amount of work required for the author transition.. There is some progress here but no news since the last report ([https://github.com/acl-org/acl-anthology/pull/3603 #3603], [https://github.com/acl-org/acl-anthology/pull/4309 #4309]).

2025Q3 Reports: Anthology Director

2025-07-08T18:26:15Z

Matt Post: links

== Overview ==

The Anthology staff comprises Matt Post (director since 2019), three current paid assistants who have been helping with day-to-day operations and improvements, and a number of volunteers. Over the past six months, active volunteers include Marcel Bollmann, Nathan Schneider, David Chiang, and Arne Koehn.

A. Seza Doğruöz continues to handle submission of main conference materials to various indexing services (Web of Science, Scopus). There is a report from her below.

I have hired a new assistant, Ankur Kejriwal, to help handle issues, in responses to diminished activity from our main paid assistant.

== Main items ==

Here are the main accomplishments and discussion points from January through June, 2025:

* For [https://www.aclweb.org/adminwiki/index.php/2025Q1_Reports:_Anthology_Director 2025Q1], we noted a plan to improve the representation of people in the Anthology. After a very long, helpful public discussion ([https://github.com/acl-org/acl-anthology/issues/623 #623]), we have [https://github.com/acl-org/acl-anthology/wiki/Author-Page-Plan#consolidated-version-2025-06-20 a draft plan], which we hope to implement in the next quarter. We do hope that the ACL Exec will read it and comment. Key features:
** We plan to rely heavily on ORCIDs to disambiguate papers, and to work with ARR to have everyone create and record these in their Open Review and Softconf profiles
** We will maintain the Anthology's human-friendly names (no numbers), e.g., [https://aclanthology.org/people/y/yang-liu-umich/ yang-liu-umich]
* Since implementing our web interface for handling corrections, submissions have skyrocketed. We process these through a semi-automated process on a biweekly basis: typically, Nathan Schneider approves them, and then a bulk processing script automatically merges all approved corrections. We have processed 272 requests since February, and have 49 open ones. Often there is some complication that prevents quick dispatch.
* We also receive a large number of requests for author page merges and disambiguations, which we have no means of automating yet. Assistants still process these manually. The new author infrastructure should alleviate this. There are 400 (!) open requests.

== Scientific indexing ==

Most ACL publications (until 2025) are submitted and/or being processed for scientific indexing at various indices (e.g., Web of Science, Scopus). We continue to try to index Findings, but the idea of it is unique among scientific fields, and it is unclear at the moment whether it will be accepted or not. One important item is that if Findings is separated from conferences, and given its own editor, this may be a big impediment to indexing. It is already very hard to get a new venue indexed. If the ACL is considering adding new venues in the future, with the requirement that they be indexed, it would be good to consult with Prof. Doğruöz first, since she has accumulated some knowledge and experience here.

== Plans ==

We continue to hope to be able to expand our citation framework to include plenary videos. There is some progress here but no news since the last report ([https://github.com/acl-org/acl-anthology/pull/3603 #3603], [https://github.com/acl-org/acl-anthology/pull/4309 #4309]).

2025Q3 Reports: Anthology Director

2025-07-02T18:37:18Z

Matt Post: /* Overview */

== Overview ==

The Anthology staff comprises Matt Post (director since 2019), three current paid assistants who have been helping with day-to-day operations and improvements, and a number of volunteers. Over the past six months, active volunteers include Marcel Bollmann, Nathan Schneider, David Chiang, and Arne Koehn.

A. Seza Doğruöz continues to handle submission of main conference materials to various indexing services (Web of Science, Scopus). There is a report from her below.

I have hired a new assistant, Ankur Kejriwal, to help handle issues, in responses to diminished activity from our main paid assistant.

== Main items ==

Here are the main accomplishments and discussion points from January through June, 2025:

* For [[https://www.aclweb.org/adminwiki/index.php/2025Q1_Reports:_Anthology_Director 2025Q1]], we noted a plan to improve the representation of people in the Anthology. After a very long, helpful public discussion ([[https://github.com/acl-org/acl-anthology/issues/623 #623]]), we have [[https://github.com/acl-org/acl-anthology/wiki/Author-Page-Plan#consolidated-version-2025-06-20 a draft plan]], which we hope to implement in the next quarter. We do hope that the ACL Exec will read it and comment. Key features:
** We plan to rely heavily on ORCIDs to disambiguate papers, and to work with ARR to have everyone create and record these in their Open Review and Softconf profiles
** We will maintain the Anthology's human-friendly names (no numbers), e.g., [[https://aclanthology.org/people/y/yang-liu-umich/ yang-liu-umich]]
* Since implementing our web interface for handling corrections, submissions have skyrocketed. We process these through a semi-automated process on a biweekly basis: typically, Nathan Schneider approves them, and then a bulk processing script automatically merges all approved corrections. We have processed 272 requests since February, and have 49 open ones. Often there is some complication that prevents quick dispatch.
* We also receive a large number of requests for author page merges and disambiguations, which we have no means of automating yet. Assistants still process these manually. The new author infrastructure should alleviate this. There are 400 (!) open requests.

== Scientific indexing ==

Most ACL publications (until 2025) are submitted and/or being processed for scientific indexing at various indices (e.g., Web of Science, Scopus). We continue to try to index Findings, but the idea of it is unique among scientific fields, and it is unclear at the moment whether it will be accepted or not. One important item is that if Findings is separated from conferences, and given its own editor, this may be a big impediment to indexing. It is already very hard to get a new venue indexed. If the ACL is considering adding new venues in the future, with the requirement that they be indexed, it would be good to consult with Prof. Doğruöz first, since she has accumulated some knowledge and experience here.

== Plans ==

We continue to hope to be able to expand our citation framework to include plenary videos. There is some progress here but no news since the last report ([https://github.com/acl-org/acl-anthology/pull/3603 #3603], [https://github.com/acl-org/acl-anthology/pull/4309 #4309]).

2025Q3 Reports: Anthology Director

2025-07-01T17:40:04Z

Matt Post: typo /* Scientific indexing */

== Overview ==

The Anthology staff comprises Matt Post (director since 2019), three current paid assistants who have been helping with day-to-day operations and improvements, and a number of volunteers. Over the past six months, active volunteers include Marcel Bollmann, Nathan Schneider, David Chiang, and Arne Koehn.

A. Seza Dogruöz continues to handle submission of main conference materials to various indexing services (Web of Science, Scopus). There is a report from her below.

I have hired a new assistant, Ankur Kejriwal, to help handle issues, in responses to diminished activity from our main paid assistant.

== Main items ==

Here are the main accomplishments and discussion points from January through June, 2025:

* For [[https://www.aclweb.org/adminwiki/index.php/2025Q1_Reports:_Anthology_Director 2025Q1]], we noted a plan to improve the representation of people in the Anthology. After a very long, helpful public discussion ([[https://github.com/acl-org/acl-anthology/issues/623 #623]]), we have [[https://github.com/acl-org/acl-anthology/wiki/Author-Page-Plan#consolidated-version-2025-06-20 a draft plan]], which we hope to implement in the next quarter. We do hope that the ACL Exec will read it and comment. Key features:
** We plan to rely heavily on ORCIDs to disambiguate papers, and to work with ARR to have everyone create and record these in their Open Review and Softconf profiles
** We will maintain the Anthology's human-friendly names (no numbers), e.g., [[https://aclanthology.org/people/y/yang-liu-umich/ yang-liu-umich]]
* Since implementing our web interface for handling corrections, submissions have skyrocketed. We process these through a semi-automated process on a biweekly basis: typically, Nathan Schneider approves them, and then a bulk processing script automatically merges all approved corrections. We have processed 272 requests since February, and have 49 open ones. Often there is some complication that prevents quick dispatch.
* We also receive a large number of requests for author page merges and disambiguations, which we have no means of automating yet. Assistants still process these manually. The new author infrastructure should alleviate this. There are 400 (!) open requests.

== Scientific indexing ==

Most ACL publications (until 2025) are submitted and/or being processed for scientific indexing at various indices (e.g., Web of Science, Scopus). We continue to try to index Findings, but the idea of it is unique among scientific fields, and it is unclear at the moment whether it will be accepted or not. One important item is that if Findings is separated from conferences, and given its own editor, this may be a big impediment to indexing. It is already very hard to get a new venue indexed. If the ACL is considering adding new venues in the future, with the requirement that they be indexed, it would be good to consult with Prof. Doğruöz first, since she has accumulated some knowledge and experience here.

== Plans ==

We continue to hope to be able to expand our citation framework to include plenary videos. There is some progress here but no news since the last report ([https://github.com/acl-org/acl-anthology/pull/3603 #3603], [https://github.com/acl-org/acl-anthology/pull/4309 #4309]).

2025Q3 Reports: Anthology Director

2025-07-01T11:42:25Z

Matt Post: Added note about scientific indexing

== Overview ==

The Anthology staff comprises Matt Post (director since 2019), three current paid assistants who have been helping with day-to-day operations and improvements, and a number of volunteers. Over the past six months, active volunteers include Marcel Bollmann, Nathan Schneider, David Chiang, and Arne Koehn.

A. Seza Dogruöz continues to handle submission of main conference materials to various indexing services (Web of Science, Scopus). There is a report from her below.

I have hired a new assistant, Ankur Kejriwal, to help handle issues, in responses to diminished activity from our main paid assistant.

== Main items ==

Here are the main accomplishments and discussion points from January through June, 2025:

* For [[https://www.aclweb.org/adminwiki/index.php/2025Q1_Reports:_Anthology_Director 2025Q1]], we noted a plan to improve the representation of people in the Anthology. After a very long, helpful public discussion ([[https://github.com/acl-org/acl-anthology/issues/623 #623]]), we have [[https://github.com/acl-org/acl-anthology/wiki/Author-Page-Plan#consolidated-version-2025-06-20 a draft plan]], which we hope to implement in the next quarter. We do hope that the ACL Exec will read it and comment. Key features:
** We plan to rely heavily on ORCIDs to disambiguate papers, and to work with ARR to have everyone create and record these in their Open Review and Softconf profiles
** We will maintain the Anthology's human-friendly names (no numbers), e.g., [[https://aclanthology.org/people/y/yang-liu-umich/ yang-liu-umich]]
* Since implementing our web interface for handling corrections, submissions have skyrocketed. We process these through a semi-automated process on a biweekly basis: typically, Nathan Schneider approves them, and then a bulk processing script automatically merges all approved corrections. We have processed 272 requests since February, and have 49 open ones. Often there is some complication that prevents quick dispatch.
* We also receive a large number of requests for author page merges and disambiguations, which we have no means of automating yet. Assistants still process these manually. The new author infrastructure should alleviate this. There are 400 (!) open requests.

== Scientific indexing ==

Most ACL publications (until 2025) are submitted and/or being processed for scientific indexing at various indices (e.g., Web of Science, Scopus). We continue to try to index Findings, but the idea of it is unique among scientific fields, and it is unclear at the moment whether it will be accepted or not. One important item is that if Findings is separated from conferences, and given its own editor, this may be a big impediment to indexing. It is already very hard to get a new venue indexed. If the ACL is considering adding new venues in the future, with the requirement that they be indexed, it would be good to consult with Dogruöz first, since she has accumulated some knowledge and experience here.

== Plans ==

We continue to hope to be able to expand our citation framework to include plenary videos. There is some progress here but no news since the last report ([https://github.com/acl-org/acl-anthology/pull/3603 #3603], [https://github.com/acl-org/acl-anthology/pull/4309 #4309]).

2025Q3 Reports: Anthology Director

2025-06-25T20:49:11Z

Matt Post: Created page with "== Overview == The Anthology staff comprises Matt Post (director since 2019), three current paid assistants who have been helping with day-to-day operations and improvements,..."

== Overview ==

The Anthology staff comprises Matt Post (director since 2019), three current paid assistants who have been helping with day-to-day operations and improvements, and a number of volunteers. Over the past six months, active volunteers include Marcel Bollmann, Nathan Schneider, David Chiang, and Arne Koehn.

I have hired a new assistant, Ankur Kejriwal, to help handle issues, in responses to diminished activity from our main paid assistant.

== Main items ==

Here are the main accomplishments and discussion points from January through June, 2025:

* For [[https://www.aclweb.org/adminwiki/index.php/2025Q1_Reports:_Anthology_Director 2025Q1]], we noted a plan to improve the representation of people in the Anthology. After a very long, helpful public discussion ([[https://github.com/acl-org/acl-anthology/issues/623 #623]]), we have [[https://github.com/acl-org/acl-anthology/wiki/Author-Page-Plan#consolidated-version-2025-06-20 a draft plan]], which we hope to implement in the next quarter. We do hope that the ACL Exec will read it and comment. Key features:
** We plan to rely heavily on ORCIDs to disambiguate papers, and to work with ARR to have everyone create and record these in their Open Review and Softconf profiles
** We will maintain the Anthology's human-friendly names (no numbers), e.g., [[https://aclanthology.org/people/y/yang-liu-umich/ yang-liu-umich]]
* Since implementing our web interface for handling corrections, submissions have skyrocketed. We process these through a semi-automated process on a biweekly basis: typically, Nathan Schneider approves them, and then a bulk processing script automatically merges all approved corrections. We have processed 272 requests since February, and have 49 open ones. Often there is some complication that prevents quick dispatch.
* We also receive a large number of requests for author page merges and disambiguations, which we have no means of automating yet. Assistants still process these manually. The new author infrastructure should alleviate this. There are 400 (!) open requests.

== Plans ==

We continue to hope to be able to expand our citation framework to include plenary videos. There is some progress here but no news since the last report ([https://github.com/acl-org/acl-anthology/pull/3603 #3603], [https://github.com/acl-org/acl-anthology/pull/4309 #4309]).

2025Q1 Reports: Anthology Director

2025-02-12T12:50:19Z

Matt Post: Created page with "== Overview == The Anthology staff comprises Matt Post (director since 2019) and four paid assistants who have been helping with day-to-day operations and improvements. We al..."

== Overview ==

The Anthology staff comprises Matt Post (director since 2019) and four paid assistants who have been helping with day-to-day operations and improvements. We also continue to benefit from our volunteers, especially longtime contributor [https://marcel.bollmann.me Marcel Bollmann] of Linköping University, Sweden.

== Accomplishments ==

In addition to normal operations, we have completed the following (October 2024 through January 2025).

* In a push over Christmas, we simplified and improved the process for correcting metadata, which consumes a lot of our time. Each paper page in the Anthology now has a "Fix data" button which presents a dialog popup allowing easy correction of key data. This then is used to populate a computer-readable Github issue. [https://aclanthology.org/posts/2024-12-27-new-metadata-workflow/ There is an announcement here]. This was an effort by Marcel Bollmann, Nathan Schneider, and me.
* The site was rewritten on top of a new Python library contributed by Marcel Bollmann. This library is available through the Python package manager (https://pypi.org/project/acl-anthology/). We also managed to obtain the project name from Takahiro Kubo, who had published his own module many years ago, and generously turned it over to us.
* Nathan Schneider also contributed a similar button for correcting author disambiguation information.
* David Stap has taken over ingestion of TACL and CL and has been consistent about this, addressing a small problem.

We have also continued work on improving documentation.

== Issues ==

We have had a few videos disappear from Vimeo ([https://github.com/acl-org/acl-anthology/issues/3121 #3121]). We pay for the service, but have not been able to get help from their support team, despite reaching out many times.

== Plans ==

My major goal for this year is to modify the Anthology codebase to maintain an explicit representation of people. In the current system, people are inferred from author names on papers which are pooled and merged with the help of a "name variants" file that identifies and merges people with different name representations (e.g., [https://aclanthology.org/people/a/aravind-joshi/ Aravind Joshi]). Interested parties can follow discussion in [https://github.com/acl-org/acl-anthology/pull/1179 issue 1179]. We plan to incorporate ORC IDs.

We are also working on the ability to host and cite plenary videos ([https://github.com/acl-org/acl-anthology/pull/3603 #3603], [https://github.com/acl-org/acl-anthology/pull/4309 #4309]).

ACL Author Guidelines

2025-01-30T13:15:08Z

Matt Post:

The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].
* For corresponding reviewer guidelines, see: [[ACL Reviewer Guidelines]].
* For further motivation and discussion, please refer to the reports of the [[Media:ACL Guidelines for Submission, Review and Citation.pdf|2017]] and [[ACL Anonymity Policy|2023]] working groups appointed by the ACL Executive Committee.
* Authors should consult [https://acl-org.github.io/ACLPUB/formatting.html the official paper-formatting guidelines], which links to [https://github.com/acl-org/acl-style-files the ACL style files] and [https://www.overleaf.com/latex/templates/association-for-computational-linguistics-acl-conference/jvxskxpnznfj Overleaf template].

== Preserving Double Blind Review ==

<font color="red">This section applies only to papers that were submitted for deadlines before January 12, 2024. These restrictions do not apply to papers submitted later, although submissions must still be anonymized and authors are still cautioned against extensive advertising. This new policy is explained [[ACL Anonymity Policy|here]].</font>

The following rules and guidelines are meant to protect the integrity of double-blind review and ensure that submissions are reviewed fairly. The rules make reference to the ''anonymity period'', which runs from 1 month before the submission deadline up to the date when your paper is either accepted, rejected, or withdrawn.

*You ''may not'' make a non-anonymized version of your paper available online to the general community (for example, via a preprint server) ''during'' the anonymity period. By a version of a paper we understand another paper having essentially the same scientific content but possibly differing in minor details (including title and structure) and/or in length (e.g., an abstract is a version of the paper that it summarizes).

*If you have posted a non-anonymized version of your paper online before the start of the anonymity period, you ''may'' submit an anonymized version to the conference. The submitted version must not refer to the non-anonymized version, and you must inform the program chair(s) that a non-anonymized version exists. You may not update the non-anonymized version during the anonymity period, and we ask you not to advertise it on social media or take other actions that would further compromise double-blind reviewing during the anonymity period.

*Note that, while you are not prohibited from making a non-anonymous version available online before the start of the anonymity period, this does make double-blind reviewing more difficult to maintain, and we therefore encourage you to wait until the end of the anonymity period if possible. Alternatively, you may consider submitting your work to the Computational Linguistics journal, which does not require anonymization and has a track for "short" (i.e., conference-length) papers.

== Citation and Comparison ==

* If you are aware of previous research that appears sound and is relevant to your work, you should cite it even if it has not been peer-reviewed, and certainly if it influenced your own work. However, refereed publications take priority over unpublished work reported in preprints. Specifically:
** You are expected to cite all refereed publications relevant to your submission, but you may be excused for not knowing about all unpublished work (especially work that has been recently posted and/or is not widely cited).
** In cases where a preprint has been superseded by a refereed publication, the refereed publication should be cited in addition to or instead of the preprint version.
* Papers (whether refereed or not) appearing less than 3 months before the submission deadline are considered contemporaneous to your submission, and you are therefore not obliged to make detailed comparisons that require additional experimentation and/or in-depth analysis.

ACL Author Guidelines

2025-01-30T13:13:32Z

Matt Post: Add links to style files

The following guidelines can be used by conferences and journals who adopt the [[ACL Policies for Submission, Review and Citation]].
* For corresponding reviewer guidelines, see: [[ACL Reviewer Guidelines]].
* For further motivation and discussion, please refer to the reports of the [[Media:ACL Guidelines for Submission, Review and Citation.pdf|2017]] and [[ACL Anonymity Policy|2023]] working groups appointed by the ACL Executive Committee.
* Authors should consult [https://acl-org.github.io/ACLPUB/formatting.html the official paper-formatting guidelines] and should know about [https://github.com/acl-org/acl-style-files the style files repo] and [https://www.overleaf.com/latex/templates/association-for-computational-linguistics-acl-conference/jvxskxpnznfj the Overleaf template].

== Preserving Double Blind Review ==

<font color="red">This section applies only to papers that were submitted for deadlines before January 12, 2024. These restrictions do not apply to papers submitted later, although submissions must still be anonymized and authors are still cautioned against extensive advertising. This new policy is explained [[ACL Anonymity Policy|here]].</font>

The following rules and guidelines are meant to protect the integrity of double-blind review and ensure that submissions are reviewed fairly. The rules make reference to the ''anonymity period'', which runs from 1 month before the submission deadline up to the date when your paper is either accepted, rejected, or withdrawn.

*You ''may not'' make a non-anonymized version of your paper available online to the general community (for example, via a preprint server) ''during'' the anonymity period. By a version of a paper we understand another paper having essentially the same scientific content but possibly differing in minor details (including title and structure) and/or in length (e.g., an abstract is a version of the paper that it summarizes).

*If you have posted a non-anonymized version of your paper online before the start of the anonymity period, you ''may'' submit an anonymized version to the conference. The submitted version must not refer to the non-anonymized version, and you must inform the program chair(s) that a non-anonymized version exists. You may not update the non-anonymized version during the anonymity period, and we ask you not to advertise it on social media or take other actions that would further compromise double-blind reviewing during the anonymity period.

*Note that, while you are not prohibited from making a non-anonymous version available online before the start of the anonymity period, this does make double-blind reviewing more difficult to maintain, and we therefore encourage you to wait until the end of the anonymity period if possible. Alternatively, you may consider submitting your work to the Computational Linguistics journal, which does not require anonymization and has a track for "short" (i.e., conference-length) papers.

== Citation and Comparison ==

* If you are aware of previous research that appears sound and is relevant to your work, you should cite it even if it has not been peer-reviewed, and certainly if it influenced your own work. However, refereed publications take priority over unpublished work reported in preprints. Specifically:
** You are expected to cite all refereed publications relevant to your submission, but you may be excused for not knowing about all unpublished work (especially work that has been recently posted and/or is not widely cited).
** In cases where a preprint has been superseded by a refereed publication, the refereed publication should be cited in addition to or instead of the preprint version.
* Papers (whether refereed or not) appearing less than 3 months before the submission deadline are considered contemporaneous to your submission, and you are therefore not obliged to make detailed comparisons that require additional experimentation and/or in-depth analysis.

2024Q3 Reports: Anthology Director

2024-08-09T15:33:35Z

Matt Post: created report

== Overview ==

The Anthology staff comprises Matt Post (director since 2019) and four paid assistants who have been helping with day-to-day operations and improvements. We also continue to benefit from our volunteers, especially longtime contributor [https://marcel.bollmann.me Marcel Bollmann] of Linköping University, Sweden.

== Accomplishments ==

In addition to normal operations, we have completed the following over the past quarter:

* Moved all Vimeo videos to local hosting, and also cleared out an old Dropbox folder with miscellaneous videos [https://github.com/acl-org/acl-anthology/pull/3125 #3125]
* Improved the corrections submission process with an updated set of templates
* Ingested an old volume from the [https://aclanthology.org/volumes/1994.vlc-1/ Second workshop on Very Large Corpora] contributed by Ken Church

== Issues ==

We discovered this year that the signed copyright transfer forms are not being consistently collected. This was a solved problem in the Softconf days but this detail got lost in the transfer to OpenReview. Thanks to [https://bethard.github.io Steven Bethard] it was done correctly at NAACL this year, and we are working to ensure it will be used consistently in future conferences. However, it requires some manual setup, so this has been additional work.

We continue to have difficulties with ingesting proceedings of major conferences. As I write, ACL's proceedings are not yet available. Many issues have been introduced with the transition away from Softconf to OpenReview, and despite [https://github.com/rycolab/aclpub2/blob/main/README.md good documentation], there are difficulties with knowledge transfer and management of the many moving pieces.

The selection / appointment of a conference's publication chair plays a big role. It is extremely important that each conference have a publication chair with technical expertise, an eye for detail, management skills, and ideally some experience in the job.

== Plans ==

We have the following projects in mind in the coming quarters:

* Decide on and implement a format for canonical author names [https://github.com/acl-org/acl-anthology/pull/1179 discussion]. This will likely be based on ORCID, and look like the following: https://aclanthology.org/people/matt-post/ORC-ID
* Address the copyright issue, and potentially move to paper-level labeling of copyright
* Update documentation and aclpub2-based processes to smooth out ingestion
* Implement ability to host plenary videos, along with BibTeX citations

2024Q1 Reports: Anthology Director

2024-03-08T18:44:22Z

Matt Post: list bullets

This report covers roughly August 2023 through February 2024. I continue to spend 3–5 hours a week with management and also low-level technical duties. I am assisted by two paid assistants who help with ingestion and the backlog of issues.

Management proceeds through our Github issue tracking system. In addition, I have begun organizing ingestions into quarterly milestones (https://github.com/acl-org/acl-anthology/milestones), and triaging work on a project page (https://github.com/orgs/acl-org/projects/7).

Here are some highlights:

* With the permission granted last October and the help of Ryan Cotterell, I have hired a staff programmer. His first tasks will be to help clean up old ingestions that remain incomplete (such as EMNLP ingestion backlog), and then we will move to more development-oriented projects. I hope to have more to report on this by the next update.

* EMNLP 2023 ingestion went very well. This is due largely to excellent organizational work on the part of publications chairs (in particular, Atsushi Fujita with EMNLP). The newish Github-based model, where every volume receives a separate repository, has helped immensely. We are still plagued by last-minute changes and requests that would benefit from hard, no-exceptions deadlines, but it is more manageable.

* We have caught up on video ingestion for ACL and EMNLP 2023. The next goal on this project is to have complete self-hosting of videos currently hosted on Vimeo (https://github.com/acl-org/acl-anthology/issues/2637).

* We had a DMCA takedown request pertaining to a copyrighted image in a paper. The authors responded immediately and the issue was resolved to the satisfaction of the complainant.

2024Q1 Reports: Anthology Director

2024-03-08T18:43:21Z

Matt Post: Created page with "This report covers roughly August 2023 through February 2024. I continue to spend 3–5 hours a week with management and also low-level technical duties. I am assisted by two..."

This report covers roughly August 2023 through February 2024. I continue to spend 3–5 hours a week with management and also low-level technical duties. I am assisted by two paid assistants who help with ingestion and the backlog of issues.

Management proceeds through our Github issue tracking system. In addition, I have begun organizing ingestions into quarterly milestones (https://github.com/acl-org/acl-anthology/milestones), and triaging work on a project page (https://github.com/orgs/acl-org/projects/7).

Here are some highlights:

- With the permission granted last October and the help of Ryan Cotterell, I have hired a staff programmer. His first tasks will be to help clean up old ingestions that remain incomplete (such as EMNLP ingestion backlog), and then we will move to more development-oriented projects. I hope to have more to report on this by the next update.

- EMNLP 2023 ingestion went very well. This is due largely to excellent organizational work on the part of publications chairs (in particular, Atsushi Fujita with EMNLP). The newish Github-based model, where every volume receives a separate repository, has helped immensely. We are still plagued by last-minute changes and requests that would benefit from hard, no-exceptions deadlines, but it is more manageable.

- We have caught up on video ingestion for ACL and EMNLP 2023. The next goal on this project is to have complete self-hosting of videos currently hosted on Vimeo (https://github.com/acl-org/acl-anthology/issues/2637).

- We had a DMCA takedown request pertaining to a copyrighted image in a paper. The authors responded immediately and the issue was resolved to the satisfaction of the complainant.

2023Q3 Reports: Anthology Director

2023-07-22T17:50:06Z

Matt Post:

The Anthology is keeping up with its responsibilities. I think however that we are stagnating a bit and falling behind on development goals and our ability to proactively adapt to the changing conference and publishing scene.

This report covers April through early July, 2023 (including the ACL conference).

=== Accomplishments ===
* Since the start of the year, the Anthology assistant (Xinru Yan) has logged about 20 hours a month. Her work is mostly related to handling the large stream of ingestion requests and handling corrects (PDF revisions, and also corrections to metadata such as author names and paper titles). She also contributes improvements to the underlying codebase as time permits.
* As second assistant, David Stap, has helped with the ingestion of videos after conferences. This involves interfacing with our Underline contact(s), naming and placing the videos, and updating our database. We just ingested videos EMNLP 2022 and EACL 2023.
* [https://asdogruoz.github.io/asezadogruoz/ Seza Doğruöz] continues to lead our indexing effort, interfacing with third-party indexers such as SCOPUS. This is an important component for many academics in Europe and Asia.
* Volunteers continue to contribute crucial services: this includes bug fixes, code reviews, and development of the software that builds our site. Chief among these is [https://marcel.bollmann.me Marcel Bollmann] (Linköping University); other contributors include [https://people.cs.georgetown.edu/nschneid/ Nathan Schneider] (Georgetown), [https://www.cs.rochester.edu/~gildea/ Dan Gildea], and [https://arne.chark.eu Arne Köhn].
* Marcel in particular contributed a number of updates to our Github Issues that clarified and simplified submissions of corrections.
* I spend about 3 hours a week on average. My time is spent managing the assistants, evaluating ingestion requests, approving code and changes via Github, development of our code base and, increasingly, helping with major *ACL conference ingestions.

=== Pain points ===
* EMNLP 2022 front matter has not been delivered. This means EMNLP’s proceedings will not be accepted by SCOPUS and other indexers.
* EMNLP 2022 attachments are not ingested, due to formatting issues.
* EACL 2023 was somewhat easier, but again stretched out for some time as workshop organizers submitted and sometimes later corrected their proceedings.
* ACL 2023 presented a number of difficulties, more on which below.

ACL 2023 was difficult. I spent about 12 hours, unexpectedly, helping with ACL 2023 ingestion, including a large portion of the Saturday before the first conference day, and then throughout the conference itself. Looking back, more proactivity on my part would have mitigated some of this, but much of the difficulty seems inherent in the process.

We moved to a two-stage ingestion process (main conference papers, then later workshops), which in practice was six or seven steps. This corrected our mistake for EMNLP where we insisted on sticking to our rule of ingesting nothing until we have the complete proceedings for all main volumes and workshops. This resulted in the proceedings not being ingested in time and created lots of extra work. The basic problem is that tough love is impossible; there are no real deadlines as there were in the days of print and everyone knows this.

The process is improved over EMNLP 2022, with all workshops and main conference volumes being created as separate repositories in a single Github org. However, we received the data at the last minute, and there were many changes and new issues that had to be accommodated and addressed. The volumes come together at the last minute, and workshops organizers are often late or non responsive. Many proceedings did not have the correct format despite [https://github.com/rycolab/aclpub2#Expected-output the nice documentation] developed by [https://github.com/rycolab/aclpub2 the ACLPUB2 team]. It is often easier just to correct these ourselves than to try to get submitters to correct them.

No doubt, conference and workshop organizers also put in inordinate amounts of time and have reasons for these delays—my goal here is only to describe our perspective. The whole setup begs for automation, increased centralized coordination, and professional support.

=== Looking forward ===
The Anthology would likely not function were it not for the financial support we receive for operations. '''I would like to request support for''' '''''development''''', which would help us get ahead of some of our problems. There are three projects in particular that I think would have high payoff in reducing pain and grief among volunteers in the community:

* '''Automating revisions and metadata corrections'''. As noted, we spend a lot of time entering corrections and revisions ourselves. With Github actions, however, we could automate much of this process, automatically creating pull requests.
* '''Development of the Anthology Python library'''. The (software) library we use to build the site could use some updating and refactoring. This would improve our internal projects and . This would also benefit the community, since there are many research projects that make use of code for reading our metadata.
* '''A web-based interface for proceedings construction and submission'''. Softconf made ACLPUBv1 usable by busy academics by integrating the code into STARTv2. We should build a standalone GUI tool that would assemble watermarked PDFs, receive conference metadata, and would generate a validated proceedings for ingestion by the Anthology.

2023Q3 Reports: Anthology Director

2023-07-22T17:49:49Z

Matt Post: /* Report */

Anthology 2023 Q2 report

The Anthology is keeping up with its responsibilities. I think however that we are stagnating a bit and falling behind on development goals and our ability to proactively adapt to the changing conference and publishing scene.

This report covers April through early July, 2023 (including the ACL conference).

=== Accomplishments ===
* Since the start of the year, the Anthology assistant (Xinru Yan) has logged about 20 hours a month. Her work is mostly related to handling the large stream of ingestion requests and handling corrects (PDF revisions, and also corrections to metadata such as author names and paper titles). She also contributes improvements to the underlying codebase as time permits.
* As second assistant, David Stap, has helped with the ingestion of videos after conferences. This involves interfacing with our Underline contact(s), naming and placing the videos, and updating our database. We just ingested videos EMNLP 2022 and EACL 2023.
* [https://asdogruoz.github.io/asezadogruoz/ Seza Doğruöz] continues to lead our indexing effort, interfacing with third-party indexers such as SCOPUS. This is an important component for many academics in Europe and Asia.
* Volunteers continue to contribute crucial services: this includes bug fixes, code reviews, and development of the software that builds our site. Chief among these is [https://marcel.bollmann.me Marcel Bollmann] (Linköping University); other contributors include [https://people.cs.georgetown.edu/nschneid/ Nathan Schneider] (Georgetown), [https://www.cs.rochester.edu/~gildea/ Dan Gildea], and [https://arne.chark.eu Arne Köhn].
* Marcel in particular contributed a number of updates to our Github Issues that clarified and simplified submissions of corrections.
* I spend about 3 hours a week on average. My time is spent managing the assistants, evaluating ingestion requests, approving code and changes via Github, development of our code base and, increasingly, helping with major *ACL conference ingestions.

=== Pain points ===
* EMNLP 2022 front matter has not been delivered. This means EMNLP’s proceedings will not be accepted by SCOPUS and other indexers.
* EMNLP 2022 attachments are not ingested, due to formatting issues.
* EACL 2023 was somewhat easier, but again stretched out for some time as workshop organizers submitted and sometimes later corrected their proceedings.
* ACL 2023 presented a number of difficulties, more on which below.

ACL 2023 was difficult. I spent about 12 hours, unexpectedly, helping with ACL 2023 ingestion, including a large portion of the Saturday before the first conference day, and then throughout the conference itself. Looking back, more proactivity on my part would have mitigated some of this, but much of the difficulty seems inherent in the process.

We moved to a two-stage ingestion process (main conference papers, then later workshops), which in practice was six or seven steps. This corrected our mistake for EMNLP where we insisted on sticking to our rule of ingesting nothing until we have the complete proceedings for all main volumes and workshops. This resulted in the proceedings not being ingested in time and created lots of extra work. The basic problem is that tough love is impossible; there are no real deadlines as there were in the days of print and everyone knows this.

The process is improved over EMNLP 2022, with all workshops and main conference volumes being created as separate repositories in a single Github org. However, we received the data at the last minute, and there were many changes and new issues that had to be accommodated and addressed. The volumes come together at the last minute, and workshops organizers are often late or non responsive. Many proceedings did not have the correct format despite [https://github.com/rycolab/aclpub2#Expected-output the nice documentation] developed by [https://github.com/rycolab/aclpub2 the ACLPUB2 team]. It is often easier just to correct these ourselves than to try to get submitters to correct them.

No doubt, conference and workshop organizers also put in inordinate amounts of time and have reasons for these delays—my goal here is only to describe our perspective. The whole setup begs for automation, increased centralized coordination, and professional support.

=== Looking forward ===
The Anthology would likely not function were it not for the financial support we receive for operations. '''I would like to request support for''' '''''development''''', which would help us get ahead of some of our problems. There are three projects in particular that I think would have high payoff in reducing pain and grief among volunteers in the community:

* '''Automating revisions and metadata corrections'''. As noted, we spend a lot of time entering corrections and revisions ourselves. With Github actions, however, we could automate much of this process, automatically creating pull requests.
* '''Development of the Anthology Python library'''. The (software) library we use to build the site could use some updating and refactoring. This would improve our internal projects and . This would also benefit the community, since there are many research projects that make use of code for reading our metadata.
* '''A web-based interface for proceedings construction and submission'''. Softconf made ACLPUBv1 usable by busy academics by integrating the code into STARTv2. We should build a standalone GUI tool that would assemble watermarked PDFs, receive conference metadata, and would generate a validated proceedings for ingestion by the Anthology.

2023Q3 Reports: Anthology Director

2023-07-22T17:49:24Z

Matt Post: Created Anthology report

Anthology 2023 Q2 report

== Report ==

The Anthology is keeping up with its responsibilities. I think however that we are stagnating a bit and falling behind on development goals and our ability to proactively adapt to the changing conference and publishing scene.

This report covers April through early July, 2023 (including the ACL conference).

=== Accomplishments ===
* Since the start of the year, the Anthology assistant (Xinru Yan) has logged about 20 hours a month. Her work is mostly related to handling the large stream of ingestion requests and handling corrects (PDF revisions, and also corrections to metadata such as author names and paper titles). She also contributes improvements to the underlying codebase as time permits.
* As second assistant, David Stap, has helped with the ingestion of videos after conferences. This involves interfacing with our Underline contact(s), naming and placing the videos, and updating our database. We just ingested videos EMNLP 2022 and EACL 2023.
* [https://asdogruoz.github.io/asezadogruoz/ Seza Doğruöz] continues to lead our indexing effort, interfacing with third-party indexers such as SCOPUS. This is an important component for many academics in Europe and Asia.
* Volunteers continue to contribute crucial services: this includes bug fixes, code reviews, and development of the software that builds our site. Chief among these is [https://marcel.bollmann.me Marcel Bollmann] (Linköping University); other contributors include [https://people.cs.georgetown.edu/nschneid/ Nathan Schneider] (Georgetown), [https://www.cs.rochester.edu/~gildea/ Dan Gildea], and [https://arne.chark.eu Arne Köhn].
* Marcel in particular contributed a number of updates to our Github Issues that clarified and simplified submissions of corrections.
* I spend about 3 hours a week on average. My time is spent managing the assistants, evaluating ingestion requests, approving code and changes via Github, development of our code base and, increasingly, helping with major *ACL conference ingestions.

=== Pain points ===
* EMNLP 2022 front matter has not been delivered. This means EMNLP’s proceedings will not be accepted by SCOPUS and other indexers.
* EMNLP 2022 attachments are not ingested, due to formatting issues.
* EACL 2023 was somewhat easier, but again stretched out for some time as workshop organizers submitted and sometimes later corrected their proceedings.
* ACL 2023 presented a number of difficulties, more on which below.

ACL 2023 was difficult. I spent about 12 hours, unexpectedly, helping with ACL 2023 ingestion, including a large portion of the Saturday before the first conference day, and then throughout the conference itself. Looking back, more proactivity on my part would have mitigated some of this, but much of the difficulty seems inherent in the process.

We moved to a two-stage ingestion process (main conference papers, then later workshops), which in practice was six or seven steps. This corrected our mistake for EMNLP where we insisted on sticking to our rule of ingesting nothing until we have the complete proceedings for all main volumes and workshops. This resulted in the proceedings not being ingested in time and created lots of extra work. The basic problem is that tough love is impossible; there are no real deadlines as there were in the days of print and everyone knows this.

The process is improved over EMNLP 2022, with all workshops and main conference volumes being created as separate repositories in a single Github org. However, we received the data at the last minute, and there were many changes and new issues that had to be accommodated and addressed. The volumes come together at the last minute, and workshops organizers are often late or non responsive. Many proceedings did not have the correct format despite [https://github.com/rycolab/aclpub2#Expected-output the nice documentation] developed by [https://github.com/rycolab/aclpub2 the ACLPUB2 team]. It is often easier just to correct these ourselves than to try to get submitters to correct them.

No doubt, conference and workshop organizers also put in inordinate amounts of time and have reasons for these delays—my goal here is only to describe our perspective. The whole setup begs for automation, increased centralized coordination, and professional support.

=== Looking forward ===
The Anthology would likely not function were it not for the financial support we receive for operations. '''I would like to request support for''' '''''development''''', which would help us get ahead of some of our problems. There are three projects in particular that I think would have high payoff in reducing pain and grief among volunteers in the community:

* '''Automating revisions and metadata corrections'''. As noted, we spend a lot of time entering corrections and revisions ourselves. With Github actions, however, we could automate much of this process, automatically creating pull requests.
* '''Development of the Anthology Python library'''. The (software) library we use to build the site could use some updating and refactoring. This would improve our internal projects and . This would also benefit the community, since there are many research projects that make use of code for reading our metadata.
* '''A web-based interface for proceedings construction and submission'''. Softconf made ACLPUBv1 usable by busy academics by integrating the code into STARTv2. We should build a standalone GUI tool that would assemble watermarked PDFs, receive conference metadata, and would generate a validated proceedings for ingestion by the Anthology.

2023Q1 Reports: Anthology Director

2023-03-02T20:36:54Z

Matt Post: Created page with "The Anthology is doing fine. == What’s new == * We can now represent event-related metadata in the Anthology (e.g., keynotes and plenary events, handbooks). We have not a..."

The Anthology is doing fine.

== What’s new ==

* We can now represent event-related metadata in the Anthology (e.g., keynotes and plenary events, handbooks). We have not actually ingested this yet, since it’s a lot of manual work
* New volumes: TAL, NEJLT,
* Ingested videos: NAACL 2021, ACL 2022, EMNLP 2021

== Pain points ==
* EMNLP ingestion was rough. We typically ask for a full delivery of materials prior to ingestion. We still do not have all the volumes, e.g., the Industry track. At the end of January we simply merged the materials we had on hand. This created a lot of frustration that was directed at us. We still do not have an understanding of what happened.
* Processing corrections continues to be time-consuming. Ideally we should move to a dynamic, user-authenticated site where this could be managed by individuals without editorial intervention. However, there are many complexities involved. I doubt we could undertake such a rewrite based only on volunteer help. We lucked out last time.

I continue to recommend that ACL put together paid technical staff to manage the publications process across ACL, NAACL, AACL, EACL, and possibly EMNLP. It would ease the lives of all the volunteers (GC down) by easing their load and carrying institutional knowledge.

2022Q3 Reports: Anthology Director

2022-07-23T16:39:16Z

Matt Post: first-pass report

== What's new ==

Here are noteworthy changes and accomplishments from March through July 2022.

* Some volumes have been accepted for indexing in important indexes (volume and index identities to follow)

* Papers with Code crawls our site and adds explicit links to software and data linked in papers. This continues to run smoothly.

* We continue to work with Slideslive ingesting videos of current conferences. 2021 is done, and we are processing 2022's main conference videos. Slideslive has been helpful and responsive here and it has been a pleasure working with them.

* (Small, and actually from February, but my favorite) We now have buttons on each paper page that allow the user to quickly copy formal and informal citations to their clipboard (thanks to Marcel Bollmann).

== Pain Points ==

The following items continue to consume a lot of our time.

'''Ingestion'''

* Conferences are growing, with more and more workshops, all of which has to be ingested together and linked up. This is an increasingly complicated and error-prone process, often involving new and inexperienced people. Ryan Cotterell and his team have vastly simplified and improved this process by writing ACLPUB2 and by simply serving extended terms, accruing institutional knowledge and familiarity. The importance of this experience on this technical task is hard to overstate.

* On numerous occasions, workshops erroneously submit non-archival materials, which then needs to be removed.

'''Corrections'''

* Processing revisions and correcting metadata requires manual approval from Anthology staff. We have moved to a monthly processing window, which helps, but it is still needlessly complicated.

== Roadmap ==

We plan the following projects, moving from short-term to long-term.

* (Summer 2022) ''Explicit event representation''. Many archival-worthy items are not associated with a paper (e.g., keynotes, business meeting videos), but we have no way to represent them. Events in the Anthology are inferred from a collection of volumes (e.g., [https://aclanthology.org/events/naacl-2022 NAACL'22]). We are in the process of explicitly representing events, which will permit us to incorporate event-related (versus volume-related) items.

* (Late 2022) ''Announcements mechanism''. We will add a blog of sorts that allows us to post announcements and host other content related to the management of the Anthology.

* (2022) ''Videos'' We continue to ingest old videos and host them locally.

* (2023+) ''Dynamic site''. The Anthology is currently built statically from public data on Github. Medium-term, we should move to a proper digital management system. This will easy paint points, allowing for example authors to claim their papers and manage many revisions and corrections themselves. Ideally this work will be in-house. It should be coordinated with the IT director, and the work should be paid.

2022Q1 Reports: Anthology Director

2022-03-04T03:13:17Z

Matt Post: Created page with "All is well with the Anthology. We continue to engage a number of volunteers, and also have two paid assistants who are helping with day-to-day tasks as well as backlogged ite..."

All is well with the Anthology. We continue to engage a number of volunteers, and also have two paid assistants who are helping with day-to-day tasks as well as backlogged items.

* We have finished ingesting the [https://mt-archive.net MT Archive], including [https://aclanthology.org/venues/earlymt/ some of the earliest papers in the field] (thanks to David Stap). This has been a year-long effort involving digitizing and ingesting this important resource, whose papers are now available with many Anthology features, such as nice BibTeX.

* With Exec approval last year, we have implemented a new retractions policy, modeled on the ACM policy. It has only been used a couple of times, but seems to be working well.

* Anthology papers now feature links to [Papers with Code](https://paperswithcode.com), which scrapes papers for links to external software, and also provides tools for claiming papers and making corrections (thanks to Robert Stojnic, who helped create a special API for us)

* We are working with a group (led by Ryan Cotterell) to rewrite ACLPUB, the tool for producing proceedings.

* A. Seza Doğruöz (Universiteit Gent) has signed on as a volunteer for submitting Anthology volumes to scientific indexing services, an important task for tenure-track faculty in Europe and Asia.

* We have taken the first step in straightening out the video ingestion situation. [https://aclanthology.org/events/naacl-2013/ Videos for NAACL 2013] are now hosted locally, except for a number of them that were permanently lost. We are working through the backlog and also creating a policy to ensure this is done in a timely fashion after conferences.

2021Q3 Reports: Anthology Director

2021-07-22T18:37:30Z

Matt Post: added links to example

Things are going well with the Anthology. We continue to engage 5 or so regular volunteers, without whose work the Anthology would suffer immensely. See below for quick updates, and please make sure to read the note about the retraction policy.

== Quick updates ==

Ordered by decreasing suspected average general appeal to the ACL Exec.

* We continue to have problems managing and storing videos. We do not have existing files dating back to NAACL 2013 in order, and there is no consistent, enforceable policy for new videos. We continue to work on these two issues, but do not have much bandwidth for this.

* As of July 1, the official canonical page for the ACL Anthology is https://aclanthology.org/. Old links from the previous site at https://aclweb.org/anthology/ still work (via 301 redirects). We plan to use this page until the end of time. We are also working to see whether the LDC is willing to redirect first-generation Anthology links from https://acl.ldc.upenn.edu/.

* We have [[https://github.com/acl-org/ACLPUB/blob/master/templates/copyright/acl-copyright-transfer-2021.pdf a new copyright form]], which I hope to have live by EMNLP 2021.

* I hired an assistant, Xinru Yan, who has been working with me since April, handling day-to-day operations. This has been immensely helpful, and I don't know how I did this work without her. She works about 5--8 hours per week. '''We easily have enough work to employ another person at this level''', if there are funds for it.

* We are ingesting the MT Archive, which contains proceedings of Machine Translation conferences back to the 60s. This is being done by David Stap (a Ph.D. student in MT) with funding from the IAMT. This should be completed by September.

== Requiring Exec attention: retractions ==

We have had to process a handful of retracted papers, which requires us to adopt a policy for this, as well as make decisions for how to disseminate and display them. Here is our proposed policy, which I have built with input from a number of people. '''Please note that I plan to implement this policy, so now is the time to speak up if you have comments or suggestions.''' The policy below was crafted to balance two competing interests: the need to disseminate retractions, without unduly punishing authors for their honesty.

# We follow [[https://www.acm.org/publications/policies/retraction-policy The ACM policy on retractions]].
# The paper is processed as a revision. A prominent WITHDRAWN watermark is added to each page of the paper. A note at the top directs the reader to the paper page in the Anthology.
# The paper page itself displays a prominent error message. The title, author list, and abstract are stricken. No bibtex is generated.
# In the volume listing, the paper appears with its title and author list in stricken text.
# On the author page listing, the paper is not displayed at all.

The idea behind excluding the paper from the author listing page, and that page alone, is to avoid creating a permanent, prominent black mark on the author's record. In all other settings, the retraction is prominently noted.

An example (dummy) retraction [[https://preview.aclanthology.org/retractions/W18-6319/ can be viewed here]]. Note that

* The retraction is prominently displayed [[https://preview.aclanthology.org/retractions/W18-6319/ on the paper page]], as well as [[https://preview.aclanthology.org/retractions/volumes/W18-63/ on the volume page]], but is removed entirely from [[https://preview.aclanthology.org/retractions/people/m/matt-post/ the author page]].
* A preview watermark [[http://cs.jhu.edu/~post/tmp/W18-6319v2.pdf can be seen here]].

== Future plans ==

We are working with next year's conference planning teams (specifically, Dan Roth and NAACL 2022) to rewrite the ACLPUB tool, with the goal of simplifying the publications and ingestion process. More detail will follow from appropriate venues in the months to come.

2021Q3 Reports: Anthology Director

2021-07-22T18:31:03Z

Matt Post:

Things are going well with the Anthology.

== Quick updates ==

Ordered by decreasing suspected average general appeal to the ACL Exec.

* We continue to have problems managing and storing videos. We do not have existing files dating back to NAACL 2013 in order, and there is no consistent, enforceable policy for new videos. We continue to work on these two issues, but do not have much bandwidth for this.

* As of July 1, the official canonical page for the ACL Anthology is https://aclanthology.org/. Old links from the previous site at https://aclweb.org/anthology/ still work (via 301 redirects). We plan to use this page until the end of time. We are also working to see whether the LDC is willing to redirect first-generation Anthology links from https://acl.ldc.upenn.edu/.

* We have [[https://github.com/acl-org/ACLPUB/blob/master/templates/copyright/acl-copyright-transfer-2021.pdf a new copyright form]], which I hope to have live by EMNLP 2021.

* I hired an assistant, Xinru Yan, who has been working with me since April, handling day-to-day operations. This has been immensely helpful, and I don't know how I did this work without her. She works about 5--8 hours per week. '''We easily have enough work to employ another person at this level''', if there are funds for it.

* We are ingesting the MT Archive, which contains proceedings of Machine Translation conferences back to the 60s. This is being done by David Stap (a Ph.D. student in MT) with funding from the IAMT. This should be completed by September.

== Requiring Exec attention: retractions ==

We have had to process a handful of retracted papers, which requires us to adopt a policy for this, as well as make decisions for how to disseminate and display them. Here is our proposed policy, which I have built with input from a number of people. '''Please note that I plan to implement this policy, so now is the time to speak up if you have comments or suggestions.''' The policy below was crafted to balance two competing interests: the need to disseminate retractions, without unduly punishing authors for their honesty.

# We follow [[https://www.acm.org/publications/policies/retraction-policy The ACM policy on retractions]].

# The paper is processed as a revision. A prominent WITHDRAWN watermark is added to each page of the paper. A note at the top directs the reader to the paper page in the Anthology.

# The paper page itself displays a prominent error message. The title, author list, and abstract are stricken. No bibtex is generated.

# In the volume listing, the paper appears with its title and author list in stricken text.

# On the author page listing, the paper is not displayed at all.

The idea behind excluding the paper from the author listing page, and that page alone, is to avoid creating a permanent, prominent black mark on the author's record. In all other settings, the retraction is prominently noted.

https://preview.aclanthology.org/retractions/

== Future plans ==

We are working with next year's conference planning teams (specifically, Dan Roth and NAACL 2022) to rewrite the ACLPUB tool, with the goal of simplifying the publications and ingestion process. More detail will follow from appropriate venues in the months to come.

2021Q3 Reports: Anthology Director

2021-07-22T18:28:53Z

Matt Post: added report

Things are going well with the Anthology.

== Quick updates ==

Ordered by decreasing suspected average general appeal to the ACL Exec.

* We continue to have problems managing and storing videos. We do not have existing files dating back to NAACL 2013 in order, and there is no consistent, enforceable policy for new videos. We continue to work on these two issues, but do not have much bandwidth for this.

* As of July 1, the official canonical page for the ACL Anthology is https://aclanthology.org/. Old links from the previous site at https://aclweb.org/anthology/ still work (via 301 redirects). We plan to use this page until the end of time. We are also working to see whether the LDC is willing to redirect first-generation Anthology links from https://acl.ldc.upenn.edu/.

* We have [[https://github.com/acl-org/ACLPUB/blob/master/templates/copyright/acl-copyright-transfer-2021.pdf a new copyright form]], which I hope to have live by EMNLP 2021.

* I hired an assistant, Xinru Yan, who has been working with me since April, handling day-to-day operations. This has been immensely helpful, and I don't know how I did this work without her.

* We are ingesting the MT Archive, which contains proceedings of Machine Translation conferences back to the 60s. This is being done by David Stap (a Ph.D. student in MT) with funding from the IAMT. This should be completed by September.

== Requiring Exec attention: retractions ==

We have had to process a handful of retracted papers, which requires us to adopt a policy for this, as well as make decisions for how to disseminate and display them. Here is our proposed policy, which I have built with input from a number of people. '''Please note that I plan to implement this policy, so now is the time to speak up if you have comments or suggestions.''' The policy below was crafted to balance two competing interests: the need to disseminate retractions, without unduly punishing authors for their honesty.

1. We follow [[https://www.acm.org/publications/policies/retraction-policy The ACM policy on retractions]].

2. The paper is processed as a revision. A prominent WITHDRAWN watermark is added to each page of the paper. A note at the top directs the reader to the paper page in the Anthology.

3. The paper page itself displays a prominent error message. The title, author list, and abstract are stricken. No bibtex is generated.

4. In the volume listing, the paper appears with its title and author list in stricken text.

5. On the author page listing, the paper is not displayed at all.

The idea behind excluding the paper from the author listing page, and that page alone, is to avoid creating a permanent, prominent black mark on the author's record. In all other settings, the retraction is prominently noted.

https://preview.aclanthology.org/retractions/

== Future plans ==

We are working with next year's conference planning teams (specifically, Dan Roth and NAACL 2022) to rewrite the ACLPUB tool, with the goal of simplifying the publications and ingestion process. More detail will follow from appropriate venues in the months to come.

2021Q1 Reports: Anthology Director

2021-03-21T23:29:57Z

Matt Post: Created report

== Assistant hiring status ==
Last year ACL approved for me to hire an assistant. I ran an ad through the ACL Portal January of 2021. I have been running the interview process myself. Here are some statistics:

* 37 applications (12+ female)
* Selected 14 for half-hour video interviews (7 female)
* Selected 8 of those for a final-round problem set (3 female)

The test is currently underway, and I will make a selection the week of March 21.

We also have about $3k from IAMT for ingesting the MT Archive website (mt-archive.info). After paying someone to digitize it, it now needs to be QA'd and ingested. I had been doing this myself but it is time-consuming. I will likely ask another one of the applicants to do this job.

== Revision woes ==
We are spending a lot of time processing corrections to author lists, and I think the ACL should reconsider its policy a bit.

Many ACL conferences have adopted a form of the following policy that prevents any changes to the author list after submission (emphasis mine)

<blockquote>The author list for submissions should include all (and only) individuals who made substantial contributions to the work presented. Each author listed on a submission to ACL-IJCNLP 2021 will be notified of submissions, revisions and the final decision. **No changes to the order or composition of authorship may be made to submissions to ACL-IJCNLP 2021 after the abstract submission deadline**, which is January 25, 2011.</blockquote>

The Anthology treats PDFs as authoritative, meaning that we automatically correct metadata (such as names and titles) so as to be in line with the PDF. However, this could allow the ACL policy above to be trivially subverted: authors could submit their final PDF with an altered author list, and then request correction after ingestion into the Anthology. In order to prevent this, we require permission from the program chairs of a conference or workshop in order to make any changes to the author list, even when the metadata differs from the PDF. This has added some work. We receive requests along these lines perhaps every month. Most of them are requests are not to add authors, but for minor shufflings of author order among non-first authors.

The ACL might consider loosening this policy a bit. For example, you might allow author reorderings only (or, say, reorderings among non-first authors only). This might reasonably accommodate real-world differences in effort levels that arise after submission, without leaving open the abuse which I assume inspired this policy in the first place.

== Style files and documentation ==
Until recently, there was no central repository for style files. Each conference would typically grab the style files from its previous conference. This meant that changes and bugfixes often didn’t make it across conferences (say from EMNLP to ACL), even within a year.

David Chiang and I made revisions to the style files and consolidated documentation in an attempt to address this. We have been in touch with conference organizers, and the files are being used for NAACL 2021 and EMNLP 2021 (we were too late in contacting ACL). The centralized documentation can be found here:

https://acl-org.github.io/ACLPUB/

With style files here:

https://github.com/acl-org/ACLPUB/tree/master/templates/latex

A working Overleaf template is available here:

https://www.overleaf.com/read/crtcwgxzjskr

Here is a summary of changes:
* Replaces \aclfinalcopy with a package option
* Bugfixes related to the hyperref package
* Pulled generic formatting information to the web page, which makes it easier to link to.

== Up next ==

Next quarter, I plan to have updates on copyright and the status of video ingestion.

2020Q3 Reports: Anthology Director

2020-07-23T16:12:54Z

Matt Post: fixed bold

== Updates ==

I will start with updates on issues from [https://www.aclweb.org/adminwiki/index.php?title=2020Q1_Reports:_Anthology_Director The Q1 report].

* '''New ID format'''. We have successfully converted to the new ID format, and are using it for all data ingested into the Anthology since January 1, 2020 (including volumes from prior years).
* '''Hiring an Assistant'''. I have done an informal search through word of mouth without success. I will soon post an advertisement in the usual places to begin this search. Anthology issues continue to be very time-consuming (I could easily spend 10–20 hours per week on issues related to maintenance, ingestion, and planning), and I am hopeful that this will help.
* '''Videos'''. These continue to be a problem; many are not ingested, and the process for doing so remains an externality. This is one of the first things I hope to have the assistant tackle. We hope to have ACL videos ingested by September; the issue is a bit complicated by the new vendor we used (Slideslive).
* '''Backfilling the catalog'''. We now have all of IWPT. The LiLT journal should be completed within the next week. The MT Archive has been digitized but not yet ingested, in part because it requires many time-consuming editorial decisions. We have some money left from IAMT to help with this process.

== Legal issues and Copyright ==

I had a conversation recently with the ACL lawyer. I will send a written summary to the Exec mailing list. The bottom line is that the Anthology needs to straighten out its copyright situation. A few points:

* It's is helpful that we obtain a copyright transfer, because it simplifies matters, but there are situations where (a) the authors refuse to sign this form and (b) the authors sign it but may not be authorized to do so. The lawyer is going to review our transfer form and provide advice here. This is going to add work that I am hoping can be addressed with paid (rather than volunteer) labor.
* We should take care to ensure that we have documented license when we host third-party materials. I see this as important because we are increasingly receiving requests to host such material.

On another point, the Anthology currently provides data under two licenses: [https://creativecommons.org/licenses/by-nc-sa/3.0/ CC BY-NC-SA 3.0] for material prior to 2016, and [https://creativecommons.org/licenses/by/4.0/ CC BY 4.0] for data afterwards. Inquiries I've made suggest this was decided in a somewhat ad-hoc manner. This is an issue the Exec should consider. I propose to simplify things by making all data in the Anthology available under a single CC BY 4.0 license.

2020Q3 Reports: Anthology Director

2020-07-23T16:12:12Z

Matt Post:

== Updates ==

I will start with updates on issues from [https://www.aclweb.org/adminwiki/index.php?title=2020Q1_Reports:_Anthology_Director The Q1 report].

* '''New ID format'''. We have successfully converted to the new ID format, and are using it for all data ingested into the Anthology since January 1, 2020 (including volumes from prior years).
* ""Hiring an Assistant"". I have done an informal search through word of mouth without success. I will soon post an advertisement in the usual places to begin this search. Anthology issues continue to be very time-consuming (I could easily spend 10–20 hours per week on issues related to maintenance, ingestion, and planning), and I am hopeful that this will help.
* ""Videos"". These continue to be a problem; many are not ingested, and the process for doing so remains an externality. This is one of the first things I hope to have the assistant tackle. We hope to have ACL videos ingested by September; the issue is a bit complicated by the new vendor we used (Slideslive).
* ""Backfilling the catalog"". We now have all of IWPT. The LiLT journal should be completed within the next week. The MT Archive has been digitized but not yet ingested, in part because it requires many time-consuming editorial decisions. We have some money left from IAMT to help with this process.

== Legal issues and Copyright ==

I had a conversation recently with the ACL lawyer. I will send a written summary to the Exec mailing list. The bottom line is that the Anthology needs to straighten out its copyright situation. A few points:

* It's is helpful that we obtain a copyright transfer, because it simplifies matters, but there are situations where (a) the authors refuse to sign this form and (b) the authors sign it but may not be authorized to do so. The lawyer is going to review our transfer form and provide advice here. This is going to add work that I am hoping can be addressed with paid (rather than volunteer) labor.
* We should take care to ensure that we have documented license when we host third-party materials. I see this as important because we are increasingly receiving requests to host such material.

On another point, the Anthology currently provides data under two licenses: [https://creativecommons.org/licenses/by-nc-sa/3.0/ CC BY-NC-SA 3.0] for material prior to 2016, and [https://creativecommons.org/licenses/by/4.0/ CC BY 4.0] for data afterwards. Inquiries I've made suggest this was decided in a somewhat ad-hoc manner. This is an issue the Exec should consider. I propose to simplify things by making all data in the Anthology available under a single CC BY 4.0 license.

2020Q3 Reports: Anthology Director

2020-07-23T16:11:03Z

Matt Post: Anthology Q3 report

== Updates ==

I will start with updates on issues from [https://www.aclweb.org/adminwiki/index.php?title=2020Q1_Reports:_Anthology_Director The Q1 report].

- '''New ID format'''. We have successfully converted to the new ID format, and are using it for all data ingested into the Anthology since January 1, 2020 (including volumes from prior years).
- ""Hiring an Assistant"". I have done an informal search through word of mouth without success. I will soon post an advertisement in the usual places to begin this search. Anthology issues continue to be very time-consuming (I could easily spend 10–20 hours per week on issues related to maintenance, ingestion, and planning), and I am hopeful that this will help.
- ""Videos"". These continue to be a problem; many are not ingested, and the process for doing so remains an externality. This is one of the first things I hope to have the assistant tackle. We hope to have ACL videos ingested by September; the issue is a bit complicated by the new vendor we used (Slideslive).
- ""Backfilling the catalog"". We now have all of IWPT. The LiLT journal should be completed within the next week. The MT Archive has been digitized but not yet ingested, in part because it requires many time-consuming editorial decisions. We have some money left from IAMT to help with this process.

== Legal issues and Copyright ==

I had a conversation recently with the ACL lawyer. I will send a written summary to the Exec mailing list. The bottom line is that the Anthology needs to straighten out its copyright situation. A few points:

- It's a good thing that we obtain a copyright transfer, because it simplifies matters, but there are situations where (a) the authors refuse to sign this form and (b) the authors sign it but may not be authorized to do so. The lawyer is going to review our transfer form and provide advice here.
- We should take care to ensure that we have documented license when we host third-party materials. I see this as important because we are increasingly receiving requests to host such material.

On another point, the Anthology currently provides data under two licenses: [https://creativecommons.org/licenses/by-nc-sa/3.0/ CC BY-NC-SA 3.0] for material prior to 2016, and [https://creativecommons.org/licenses/by/4.0/ CC BY 4.0] for data afterwards. Inquiries I've made suggest this was decided in a somewhat ad-hoc manner. This is an issue the Exec should consider. I propose to simplify things by making all data in the Anthology available under a single CC BY 4.0 license.

2020Q1 Reports: Anthology Director

2020-03-04T04:20:34Z

Matt Post:

== New ID format ==

Starting this year, to enable growth, we will move to a new ID format for Anthology articles. We will replace the DOS-inspired ###-#### format (e.g., P19-1017) with a more explicit format of the form {year}.{name}-{volume}.{#} (e.g., 2020.acl-long.17). This new format will solve a number of problems we are facing:

* We were running out of conference codes, with everything piled under "W" (which originally meant "workshop" but had been overloaded to also include most non-ACL events)
* We could only have 99 non-ACL events, which we over went last year
* Workshops could only have 99 papers, which [http://www.statmt.org WMT] (which is also no longer a workshop) broke in 2018, leading to unnatural volume breaks

== Videos ==

ACL continues to spend a lot of money on videos, which are not always turned over and ingested into the Anthology. It requires a lot of effort post-conference to chase down organizers and convince video providers to upload their videos and produce the mapping file that we can use for ingestion. For example, for 2019:

* [https://www.aclweb.org/anthology/events/naacl-2019/ NAACL] Uploaded to Vimeo; not ingested
* [https://www.aclweb.org/anthology/events/acl-2019/ ACL] Fully ingested, thanks to post-conference help from Lluis Marquez, David Traum, and Simonetta Montemagni, Maria Cristina Schiavone, and the folks at [http://studiovisio.it Studio Visio].
* [https://www.aclweb.org/anthology/events/emnlp-2019/ EMNLP]: Uploading in process; in active communication

It is a ton of work to track this down and it gets pushed aside. Moving forward, I have written [https://github.com/acl-org/acl-anthology/wiki/Contract-Guidelines-for-Recording-Talks a contract] that should be used before hiring companies so that the upload and delivery are part of the contract. ACL 2020 is on top of this.

== Volunteers ==

We have an active volunteer staff of around six or seven people, committing at various levels. I have a small proposal for a token of appreciation for committed volunteers for discussion.

== Hiring an Assistant ==

Thank you for permission to hire an assistant. I will be advertising for this soon. This should help with things like videos etc.

== The catalog ==

=== Backfilling ===

We have been working on identifying papers missing from the Anthology. Two of note are:

* [https://github.com/acl-org/acl-anthology/issues/355 IWPT] Headed up by Kilian Gebhardt, we have hired out the scanning of years 1991 to 2000, and are now in the process of manually entering metadata.
* [http://www.mt-archive.info MT Archive] With funding provided by [http://www.eamt.org/iamt.php IAMT], I have hired [https://cl.lingfil.uu.se/~marie/ Marie Dubremetz] to convert a large back-catalog of MT papers and ingest them into the Anthology.
* [http://csli-lilt.stanford.edu/ojs/index.php/LiLT/index LiLT journal] Via a request from Martha Palmer, we will soon host LiLT (Linguistic Issues in Language Technology), previously hosted at Stanford and edited by Annie Zaenen.

Both should be done in the coming months.

=== Looking forward ===

We continue to receive requests to host proceedings. In general I accept them if they look to be of good quality, can be attested by senior folks in our area, and are at least marginally related to NLP or CL. In this coming year, we will be adding:

* [http://www.sigcnl.org/cnl2020.html CNL 2020]: Seventh International Workshop on Controlled Natural Language (CNL 2020)

2020Q1 Reports: Anthology Director

2020-03-04T02:16:08Z

Matt Post: added report

== New ID format ==

Starting this year, to enable growth, we will move to a new ID format for Anthology articles. We will replace the DOS-inspired ###-#### format (e.g., P19-1017) with a more explicit format of the form {year}.{name}-{volume}.{#} (e.g., 2020.acl-long.17). This new format will solve a number of problems we are facing:

* We were running out of conference codes, with everything piled under "W" (which originally meant "workshop" but had been overloaded to also include most non-ACL events)
* We could only have 99 non-ACL events, which we over went last year
* Workshops could only have 99 papers, which [http://www.statmt.org WMT] (which is also no longer a workshop) broke in 2018, leading to unnatural volume breaks

== Videos ==

ACL continues to spend a lot of money on videos, which are not always turned over and ingested into the Anthology. It requires a lot of effort post-conference to chase down organizers and convince video providers to upload their videos and produce the mapping file that we can use for ingestion. For example, for 2019:

* [https://www.aclweb.org/anthology/events/naacl-2019/ NAACL] Not ingested
* [https://www.aclweb.org/anthology/events/acl-2019/ ACL] Fully ingested, thanks to post-conference help from Lluis Marquez, David Traum, and Simonetta Montemagni, Maria Cristina Schiavone, and the folks at [http://studiovisio.it Studio Visio].
* [https://www.aclweb.org/anthology/events/emnlp-2019/ EMNLP]: Not ingested (though contact established)

It is a ton of work to track this down and it gets pushed aside. Moving forward, I have written [https://github.com/acl-org/acl-anthology/wiki/Contract-Guidelines-for-Recording-Talks a contract] that should be used before hiring companies so that the upload and delivery are part of the contract. ACL 2020 is on top of this.

== Hiring an Assistant ==

Thank you for permission to hire an assistant. I will be advertising for this soon. This should help with things like videos etc.

== The catalog ==

=== Backfilling ===

We have been working on identifying papers missing from the Anthology. Two of note are:

* [https://github.com/acl-org/acl-anthology/issues/355 IWPT] Headed up by Kilian Gebhardt, we have hired out the scanning of years 1991 to 2000, and are now in the process of manually entering metadata.
* [http://www.mt-archive.info MT Archive] With funding provided by [http://www.eamt.org/iamt.php IAMT], I have hired [https://cl.lingfil.uu.se/~marie/ Marie Dubremetz] to convert a large back-catalog of MT papers and ingest them into the Anthology.
* [http://csli-lilt.stanford.edu/ojs/index.php/LiLT/index LiLT journal] Via a request from Martha Palmer, we will soon host LiLT (Linguistic Issues in Language Technology), previously hosted at Stanford and edited by Annie Zaenen.

Both should be done in the coming months.

=== Looking forward ===

We continue to receive requests to host proceedings. In general I accept them if they look to be of good quality, can be attested by senior folks in our area, and are at least marginally related to NLP or CL. In this coming year, we will be adding:

* [http://www.sigcnl.org/cnl2020.html CNL 2020]: Seventh International Workshop on Controlled Natural Language (CNL 2020)

User:Matt Post

2020-02-17T12:43:22Z

Matt Post: Removed redundant lines

Research Scientist at Johns Hopkins University.