Extraction of Common-Sense Relations from Procedural Task Instructions using BERT

Viktor Losing, Lydia Fischer, Jörg Deigmöller


Abstract
Manipulation-relevant common-sense knowledge is crucial to support action-planning for complex tasks. In particular, instrumentality information of what can be done with certain tools can be used to limit the search space which is growing exponentially with the number of viable options. Typical sources for such knowledge, structured common-sense knowledge bases such as ConceptNet or WebChild, provide a limited amount of information which also varies drastically across different domains. Considering the recent success of pre-trained language models such as BERT, we investigate whether common-sense information can directly be extracted from semi-structured text with an acceptable annotation effort. Concretely, we compare the common-sense relations obtained from ConceptNet versus those extracted with BERT from large recipe databases. In this context, we propose a scoring function, based on the WordNet taxonomy to match specific terms to more general ones, enabling a rich evaluation against a set of ground-truth relations.
Anthology ID:
2021.gwc-1.10
Volume:
Proceedings of the 11th Global Wordnet Conference
Month:
January
Year:
2021
Address:
University of South Africa (UNISA)
Editors:
Piek Vossen, Christiane Fellbaum
Venue:
GWC
SIG:
SIGLEX
Publisher:
Global Wordnet Association
Note:
Pages:
81–90
Language:
URL:
https://aclanthology.org/2021.gwc-1.10
DOI:
Bibkey:
Cite (ACL):
Viktor Losing, Lydia Fischer, and Jörg Deigmöller. 2021. Extraction of Common-Sense Relations from Procedural Task Instructions using BERT. In Proceedings of the 11th Global Wordnet Conference, pages 81–90, University of South Africa (UNISA). Global Wordnet Association.
Cite (Informal):
Extraction of Common-Sense Relations from Procedural Task Instructions using BERT (Losing et al., GWC 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.gwc-1.10.pdf
Data
Recipe1M+WebChildWikiHow