Dear Colleagues,
We are pleased to announce the Call for Participation for SemEval-2027 Task 3: Semantic Change Across Multiple Time Periods.
SemEval-2027 Task 3 investigates how word meanings evolve across multiple historical time periods. While previous shared tasks have focused on comparisons between just two time points, this task extends the setting to ten time periods, using a multilingual benchmark of approximately 120,000 human annotations, allowing participants to model the evolution of individual word senses over time.
The benchmark spans six languages annotated across ten time periods ranging roughly 1880–2023: Swedish, English, Italian, Spanish, Dutch, and Russian (140 words in total).
The task consists of two subtasks:
-
Subtask 1: Diachronic Word Sense Induction – discover how word meanings evolve over time without predefined sense inventories.
Evaluated via two tracks: Track 1a, Diachronic Sense Assignment (BCubed F1), and Track 1b, Sense Dynamics (Spearman's rank correlation over Jensen-Shannon Divergence). - Subtask 2: Hypothesis-Driven Change Detection – given a target sense definition, identify which usages express that sense. Evaluated via Average F1-score.
Register now to participate:
https://www.codabench.org/competitions/17510/
Important Dates:
- Training data ready: 1 September 2026
-
Evaluation period: 10–31 January 2027
- Subtask 1: 10–21 January 2027
- Subtask 2: 22–31 January 2027
- Paper submission: February 2027
- Notification to authors: March 2027
- Camera-ready due: April 2027
- SemEval workshop: Summer 2027 (co-located with a major NLP conference)
Additional Information:
-
Task website:
https://www.changeiskey.org/event/2027-semeval/ -
Mailing list:
https://groups.google.com/d/forum/semeval2027-task3-SCxMTP
Organizers:
Nina Tahmasebi, Pierluigi Cassotti, Felix Morger, Lucia Siciliani, Eduardo Calò, Pablo Mosteiro, Stefano De Pascale, and Mariia Fedorova
We look forward to your participation!