Comparison of Machine Learning Methods for Multi-label Classification of Nursing Education and Licensure Exam Questions

John Langton, Krishna Srihasam, Junlin Jiang


Abstract
In this paper, we evaluate several machine learning methods for multi-label classification of text questions. Every nursing student in the United States must pass the National Council Licensure Examination (NCLEX) to begin professional practice. NCLEX defines a number of competencies on which students are evaluated. By labeling test questions with NCLEX competencies, we can score students according to their performance in each competency. This information helps instructors measure how prepared students are for the NCLEX, as well as which competencies they may need help with. A key challenge is that questions may be related to more than one competency. Labeling questions with NCLEX competencies, therefore, equates to a multi-label, text classification problem where each competency is a label. Here we present an evaluation of several methods to support this use case along with a proposed approach. While our work is grounded in the nursing education domain, the methods described here can be used for any multi-label, text classification use case.
Anthology ID:
2020.clinicalnlp-1.10
Volume:
Proceedings of the 3rd Clinical Natural Language Processing Workshop
Month:
November
Year:
2020
Address:
Online
Editors:
Anna Rumshisky, Kirk Roberts, Steven Bethard, Tristan Naumann
Venue:
ClinicalNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
85–93
Language:
URL:
https://aclanthology.org/2020.clinicalnlp-1.10
DOI:
10.18653/v1/2020.clinicalnlp-1.10
Bibkey:
Cite (ACL):
John Langton, Krishna Srihasam, and Junlin Jiang. 2020. Comparison of Machine Learning Methods for Multi-label Classification of Nursing Education and Licensure Exam Questions. In Proceedings of the 3rd Clinical Natural Language Processing Workshop, pages 85–93, Online. Association for Computational Linguistics.
Cite (Informal):
Comparison of Machine Learning Methods for Multi-label Classification of Nursing Education and Licensure Exam Questions (Langton et al., ClinicalNLP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.clinicalnlp-1.10.pdf
Video:
 https://slideslive.com/38939809