Eliciting Knowledge from Experts: Automatic Transcript Parsing for Cognitive Task Analysis

Junyi Du, He Jiang, Jiaming Shen, Xiang Ren


Abstract
Cognitive task analysis (CTA) is a type of analysis in applied psychology aimed at eliciting and representing the knowledge and thought processes of domain experts. In CTA, often heavy human labor is involved to parse the interview transcript into structured knowledge (e.g., flowchart for different actions). To reduce human efforts and scale the process, automated CTA transcript parsing is desirable. However, this task has unique challenges as (1) it requires the understanding of long-range context information in conversational text; and (2) the amount of labeled data is limited and indirect—i.e., context-aware, noisy, and low-resource. In this paper, we propose a weakly-supervised information extraction framework for automated CTA transcript parsing. We partition the parsing process into a sequence labeling task and a text span-pair relation extraction task, with distant supervision from human-curated protocol files. To model long-range context information for extracting sentence relations, neighbor sentences are involved as a part of input. Different types of models for capturing context dependency are then applied. We manually annotate real-world CTA transcripts to facilitate the evaluation of the parsing tasks.
Anthology ID:
P19-1420
Volume:
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2019
Address:
Florence, Italy
Editors:
Anna Korhonen, David Traum, Lluís Màrquez
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4280–4291
Language:
URL:
https://aclanthology.org/P19-1420
DOI:
10.18653/v1/P19-1420
Bibkey:
Cite (ACL):
Junyi Du, He Jiang, Jiaming Shen, and Xiang Ren. 2019. Eliciting Knowledge from Experts: Automatic Transcript Parsing for Cognitive Task Analysis. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4280–4291, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Eliciting Knowledge from Experts: Automatic Transcript Parsing for Cognitive Task Analysis (Du et al., ACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/P19-1420.pdf
Video:
 https://aclanthology.org/P19-1420.mp4
Code
 cnrpman/procedural-extraction