A Workflow Manager for Complex NLP and Content Curation Workflows

Julian Moreno-Schneider, Peter Bourgonje, Florian Kintzel, Georg Rehm


Abstract
We present a workflow manager for the flexible creation and customisation of NLP processing pipelines. The workflow manager addresses challenges in interoperability across various different NLP tasks and hardware-based resource usage. Based on the four key principles of generality, flexibility, scalability and efficiency, we present the first version of the workflow manager by providing details on its custom definition language, explaining the communication components and the general system architecture and setup. We currently implement the system, which is grounded and motivated by real-world industry use cases in several innovation and transfer projects.
Anthology ID:
2020.iwltp-1.12
Volume:
Proceedings of the 1st International Workshop on Language Technology Platforms
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Georg Rehm, Kalina Bontcheva, Khalid Choukri, Jan Hajič, Stelios Piperidis, Andrejs Vasiļjevs
Venue:
IWLTP
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
73–80
Language:
English
URL:
https://aclanthology.org/2020.iwltp-1.12
DOI:
Bibkey:
Cite (ACL):
Julian Moreno-Schneider, Peter Bourgonje, Florian Kintzel, and Georg Rehm. 2020. A Workflow Manager for Complex NLP and Content Curation Workflows. In Proceedings of the 1st International Workshop on Language Technology Platforms, pages 73–80, Marseille, France. European Language Resources Association.
Cite (Informal):
A Workflow Manager for Complex NLP and Content Curation Workflows (Moreno-Schneider et al., IWLTP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.iwltp-1.12.pdf