Admin Wiki - User contributions [en]

2022Q3 Reports: SIGMORPHON

2022-08-02T16:07:45Z

GarrettNicolai:

2022Q3 Reports: SIGMORPHON

2022-08-02T16:07:25Z

GarrettNicolai: Created page with "This is the 2020-2021 annual report for SIGMORPHON, ACL's special interest group for computational morphology, phonology, and phonetics. == Membership == The SIG membership..."

2021Q3 Reports: SIGMORPHON

2021-07-11T14:56:42Z

GarrettNicolai: /* Mentorship program */

This is the 2020-2021 annual report for SIGMORPHON, ACL's special interest group for computational morphology, phonology, and phonetics.

== Membership ==
The SIG membership is documented in the following table, observing 11% growth from 157 to 175 members in the past 5 years. We are planning to hold a membership drive to further promote growth of the SIG.

{|
! Year !! Membership
|-
| 2021 || 175
|-
| 2020 || 176
|-
| 2019 || 176
|-
| 2018 || 157
|-
| 2017 || 167
|-
| 2016 || 157
|-
| 2015 || 150
|-
| 2014 || 144
|-
| 2013 || 142
|-
| 2012 || 137
|-
| 2011 || 120
|-
| 2010 || 105
|-
| 2009 || 96
|-
| 2008 || 90
|-
| 2007 || 73
|-
| 2006 || 55
|}

== Workshop ==

The 18th SIG workshop will be held at ACL 2021, chaired by Garrett Nicolai, Kyle Gorman and Ryan Cotterell. There is a push now to hold the workshop every year to increase interest in the SIG’s target areas among the wider ACL community. This is especially important now as our community is undergoing rapid growth.

The 2021 Workshop had 25 submissions from which the program committee selected 14 for publication (56% acceptance rate). There will also be invited talks from Kenny Smith, Reut Tsarfaty, Kristine Yu, and Ekaterina Vylomova. This will be the second SIGMORPHON workshop to be held entirely online.

== Shared Tasks ==

In 2021, SIGMORPHON looked to build off the success of its previous shared tasks, and held an open solicitation for shared tasks, selecting 3. Each task was separately proposed by an organizing committee, and separately approved by the SIG Executive Committee, who worked with the organizing committee in some cases. This structure was inspired by other groups (SIGSEM and SIGNLL) that run multiple shared tasks, and we expect to keep it in future years.

=== Task 0 ===
SIGMORPHON's sixth installment of its inflection generation shared task is divided
into two parts: Generalization, and cognitive plausibility.

In the first part, participants designed a model that learned to generate morphological inflections from a lemma and a set of morphosyntactic features of the target form, similar to previous year's tasks. This year, participants learned
morphological tendencies on a set of development languages, and then generalized
these findings to new languages - without much time to adapt their models to new
phenomena.

The second part asks participants to inflect nonce words in the past tense, which are then judged for plausibility by native speakers. This task aims to investigate whether
state-of-the-art inflectors are learning in a way that mimics human learners.

=== Task 1 ===

The second SIGMORPHON shared task on grapheme-to-phoneme conversion expands on the task from last year, recategorizing data as belonging to one of three different classes: low-resource, medium-resource, and high-resource.

The task saw 23 submissions from 9 participants.

=== Task 2 ===
Task 2 continues the effort from the 2020 shared task in unsupervised morphology. Unlike last year's task, which asked participants to implement a complete unsupervised morphology induction pipeline, this year's task concentrates on a single aspect of morphology discovery: paradigm induction. This task asks participants to cluster words into inflectional paradigms, given no more than raw text.

== Other Activities (Online) ==

=== Mentorship program ===
This year saw the continuation of a mentorship program, which will take place at ACL. Due to the fact that ACL 2021 will be held online, the mentorship program is virtual; if they take place, future iterations should also be in person. The program was spearheaded by Ryan Cotterell, but at the suggestion of Kyle Gorman who forwarded a request from a SIGMOPHON member inquiring if such a program is possible to the SIGMORPHON Exec. Interested mentees were advised to sign up online on a Google form [https://docs.google.com/forms/d/e/1FAIpQLSfjEixHNavRJKr2pY-dkq3Y1ZR70OvwbMs6sYmoNgF5zb4pAg/viewform?usp=send_form], and were paired with more senior researchers who will serve as mentors to them.

=== Membership drive ===
With the successful migration of the mailing list to Google groups, we are expecting to conduct the planned membership drive in the coming year.

== Elections ==

An election of the executive committee of the SIG was held in January, 2021. The elected officers of the SIG are listed at [https://sigmorphon.github.io/], and are serving a 2-year term. The next elections are scheduled to take place in January, 2023.

2021Q3 Reports: SIGMORPHON

2021-07-11T14:56:16Z

This is the 2020-2021 annual report for SIGMORPHON, ACL's special interest group for computational morphology, phonology, and phonetics.

== Membership ==
The SIG membership is documented in the following table, observing 11% growth from 157 to 175 members in the past 5 years. We are planning to hold a membership drive to further promote growth of the SIG.

{|
! Year !! Membership
|-
| 2021 || 175
|-
| 2020 || 176
|-
| 2019 || 176
|-
| 2018 || 157
|-
| 2017 || 167
|-
| 2016 || 157
|-
| 2015 || 150
|-
| 2014 || 144
|-
| 2013 || 142
|-
| 2012 || 137
|-
| 2011 || 120
|-
| 2010 || 105
|-
| 2009 || 96
|-
| 2008 || 90
|-
| 2007 || 73
|-
| 2006 || 55
|}

== Workshop ==

The 18th SIG workshop will be held at ACL 2021, chaired by Garrett Nicolai, Kyle Gorman and Ryan Cotterell. There is a push now to hold the workshop every year to increase interest in the SIG’s target areas among the wider ACL community. This is especially important now as our community is undergoing rapid growth.

The 2021 Workshop had 25 submissions from which the program committee selected 14 for publication (56% acceptance rate). There will also be invited talks from Kenny Smith, Reut Tsarfaty, Kristine Yu, and Ekaterina Vylomova. This will be the second SIGMORPHON workshop to be held entirely online.

== Shared Tasks ==

In 2021, SIGMORPHON looked to build off the success of its previous shared tasks, and held an open solicitation for shared tasks, selecting 3. Each task was separately proposed by an organizing committee, and separately approved by the SIG Executive Committee, who worked with the organizing committee in some cases. This structure was inspired by other groups (SIGSEM and SIGNLL) that run multiple shared tasks, and we expect to keep it in future years.

=== Task 0 ===
SIGMORPHON's sixth installment of its inflection generation shared task is divided
into two parts: Generalization, and cognitive plausibility.

In the first part, participants designed a model that learned to generate morphological inflections from a lemma and a set of morphosyntactic features of the target form, similar to previous year's tasks. This year, participants learned
morphological tendencies on a set of development languages, and then generalized
these findings to new languages - without much time to adapt their models to new
phenomena.

The second part asks participants to inflect nonce words in the past tense, which are then judged for plausibility by native speakers. This task aims to investigate whether
state-of-the-art inflectors are learning in a way that mimics human learners.

=== Task 1 ===

The second SIGMORPHON shared task on grapheme-to-phoneme conversion expands on the task from last year, recategorizing data as belonging to one of three different classes: low-resource, medium-resource, and high-resource.

The task saw 23 submissions from 9 participants.

=== Task 2 ===
Task 2 continues the effort from the 2020 shared task in unsupervised morphology. Unlike last year's task, which asked participants to implement a complete unsupervised morphology induction pipeline, this year's task concentrates on a single aspect of morphology discovery: paradigm induction. This task asks participants to cluster words into inflectional paradigms, given no more than raw text.

== Other Activities (Online) ==

=== Mentorship program ===
This year saw the continuation of a mentorship program, which will take place at ACL. Due to the fact that ACL 2021 will be held online, the mentorship program is virtual; if they take place, future iterations should also be in person. The program was spearheaded by Ryan Cotterell, but at the suggestion of Kyle Gorman who forwarded a request from a SIGMOPHON member inquiring if such a program is possible to the SIGMORPHON Exec. Interested mentees were advised to sign up online on a Google form [https://docs.google.com/forms/d/e/1FAIpQLSfjEixHNavRJKr2pY-dkq3Y1ZR70OvwbMs6sYmoNgF5zb4pAg/viewform?usp=send_form], and were paired with more senior researchers who will serve as mentors to them. At the time of writing, 10 people have signed up; all who signed up were either graduate students or prospective graduate students; some did not have papers at the conference. One mentee who signed up early has been paired so far; we are working on pairing the rest. The success of the program will not be known until after the workshop in July, but this early success suggests that we should run the program again next year.

=== Membership drive ===
With the successful migration of the mailing list to Google groups, we are expecting to conduct the planned membership drive in the coming year.

== Elections ==

An election of the executive committee of the SIG was held in January, 2021. The elected officers of the SIG are listed at [https://sigmorphon.github.io/], and are serving a 2-year term. The next elections are scheduled to take place in January, 2023.

2019Q3 Reports: SIGMORPHON

2019-07-25T19:10:03Z

GarrettNicolai: Uploaded 2019 Report

Jason Eisner

=== Membership: ===

SIGMORPHON is ACL's special interest group for computational morphology,
phonology, and phonetics. Membership currently stands at 176,
notably up from 55/73/90/96/105/120/137/142/144/150/157/167/157 in July
2006/2007/2008/2009/2010/2011/2012/2013/2014/2015/2016/2017/2018 respectively. We are
planning to hold a membership drive to increase membership.

=== Workshop: ===

The 15th SIG workshop was held at EMNLP 2018, chaired by Sandra Kübler and Garrett Nicolai. The 16th SIG workshop will be held at ACL 2019, chaired by Garrett Nicolai and Ryan
Cotterell. Previous SIGMORPHON custom had the the workshop only occuring in evennumbered years; however, following high participation in 2018, and to accommodate a new
shared task, the decision was made to hold an off-year workshop in 2019. The workshop
received 20 submissions, accepting 12.

=== Shared Tasks: ===

The third edition of the shared task was held at CoNLL 2018, as the CoNLL—
SIGMORPHON shared task on universal morphological reinflection. The task consisted of
two sub-tasks: the first asked participants to reinflect words in more than 100 languages – the
largest such task ever; the second sub-task was the first ever shared task on contextual
inflection. The first task received 27 submissions, while the second task received 6.
A system overview paper (https://www.aclweb.org/anthology/papers/K/K18/K18-3001/)
and individual system description papers appeared in the proceedings for CONLL. The shared
task website is available at (https://sigmorphon.github.io/sharedtasks/2018/). Thanks to Ryan
Cotterell, Mans Hulden, Christo Kirov, John Sylak-Glassman, Géraldine Vylomova, Arya
McCarthy, Katharina Kann, Sebastian Mielke, Garrett Nicolai, Miikka Silfverberg, David
Yarowsky, and Jason Eisner for organizing the task.

The fourth iteration of the shared task has been organized for this year, but following
CoNLL’s tradition of only holding shared tasks in back-to-back years, the task was solely
organized by SIGMORPHON, as the SIGMORPHON shared task on crosslinguality and
context in morphology. As with previous years, the task consists of two subtasks: the first
continues the tradition of context-free inflection, however this year, participants are encouraged
to use high-resource language data to aid in the inflection of low-resource languages; the
second task expands the contextual inflection task of last year to perform complete contextual
morphological tagging. Five teams submitted systems for the first task, while nine participated
in the second.

As with previous tasks, a system overview paper and invidual system descriptions will be
included in the workshop proceedings. The shared task website is available at
(https://sigmorphon.github.io/sharedtasks/2019/. Thanks to Arya D. McCarthy, Ekaterina
Vylomova, Shijie Wu, Chaitanya Malaviya, Lawrence Wolf-Sonkin, Garrett Nicolai, Christo Kirov,
Miikka Sifverberg, Sebastian J. Mielke, Svetlana Toldova, Olga Lyashevskaya, Karina
Mishchenkova, Elena Klyachko, Jeffrey Heinz, Ryan Cotterell, and Mans Hulden for organizing
the task.

=== Online Activities: ===

We have recently harvested metadata for hundreds of relevant papers that appeared in
the ACL Anthology from 2011-2017. We plan to use this to hold a membership drive in the next
year.

=== Elections: ===

An election of the executive committee of the SIG was held in January, 2019. The newly elected officers of the SIG are listed at (https://sigmorphon.github.io/), and will serve a 2- year term.