————————————————————————————————————————
Call for Participation: CRAC 2025 Shared Task on Multilingual Coreference Resolution
————————————————————————————————————————
https://ufal.mff.cuni.cz/corefud/crac25
We are excited to announce the fourth edition of the Shared Task on Multilingual Coreference Resolution! The upcoming edition mainly focuses on LLMs and challenges their abilities in predicting coreference across a range of typologically different languages.
The results will be presented at the CODI-CRAC 2025 workshop, co-located with the EMNLP 2025 conference in Suzhou, China. System description papers will be published in the proceedings of the CRAC, also available in the ACL anthology.
—————————————
Task description
—————————————
The task is to identify mentions and cluster them according to their reference to the same entity.
Participants may choose between two tracks:
(1) LLM track
(2) Unconstrained track
—————————————
Data
—————————————
The Shared Task is based on the upcoming CorefUD 1.3. collection, which comprises datasets with coreference annotation for more than 15 languages, but you can participate only for a subset of the languages.
—————————————
Timeline
—————————————
March, 2025 - start of the development phase
* release of training and development data
* evaluation tool available on GitHub
* baseline system available at GitHub
* development evaluation possible via CodaLab
June 4, 2025 - start of the evaluation phase
* test evaluation via CodaLab
June 17, 2025 (AoE) - end of the evaluation phase
August, 2025 - submission of system description papers to the CODI-CRAC 2025 workshop
November 5-9, 2025 – the CODI-CRAC workshop at EMNLP
—————————————
Participation
—————————————
Please let us know by filling in the registration form:
https://ufal.mff.cuni.cz/corefud/crac25#llm-registration
—————————————
Organizers
—————————————
Michal Novák, Charles University, Czechia
Martin Popel, Charles University, Czechia
Zdeněk Žabokrtský, Charles University, Czechia
Dan Zeman, Charles University, Czechia
Anna Nedoluzhko, Charles University, Czechia
Milan Straka, Charles University, Czechia
Ondřej Pražák, University of West Bohemia, Czechia
Miloslav Konopík, University of West Bohemia, Czechia
Jakub Sido, University of West Bohemia, Czechia