Cluster Analysis of Online Mental Health Discourse using Topic-Infused Deep Contextualized Representations

Atharva Kulkarni, Amey Hengle, Pradnya Kulkarni, Manisha Marathe


Abstract
With mental health as a problem domain in NLP, the bulk of contemporary literature revolves around building better mental illness prediction models. The research focusing on the identification of discussion clusters in online mental health communities has been relatively limited. Moreover, as the underlying methodologies used in these studies mainly conform to the traditional machine learning models and statistical methods, the scope for introducing contextualized word representations for topic and theme extraction from online mental health communities remains open. Thus, in this research, we propose topic-infused deep contextualized representations, a novel data representation technique that uses autoencoders to combine deep contextual embeddings with topical information, generating robust representations for text clustering. Investigating the Reddit discourse on Post-Traumatic Stress Disorder (PTSD) and Complex Post-Traumatic Stress Disorder (C-PTSD), we elicit the thematic clusters representing the latent topics and themes discussed in the r/ptsd and r/CPTSD subreddits. Furthermore, we also present a qualitative analysis and characterization of each cluster, unraveling the prevalent discourse themes.
Anthology ID:
2021.louhi-1.10
Volume:
Proceedings of the 12th International Workshop on Health Text Mining and Information Analysis
Month:
April
Year:
2021
Address:
online
Editors:
Eben Holderness, Antonio Jimeno Yepes, Alberto Lavelli, Anne-Lyse Minard, James Pustejovsky, Fabio Rinaldi
Venue:
Louhi
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
83–93
Language:
URL:
https://aclanthology.org/2021.louhi-1.10
DOI:
Bibkey:
Cite (ACL):
Atharva Kulkarni, Amey Hengle, Pradnya Kulkarni, and Manisha Marathe. 2021. Cluster Analysis of Online Mental Health Discourse using Topic-Infused Deep Contextualized Representations. In Proceedings of the 12th International Workshop on Health Text Mining and Information Analysis, pages 83–93, online. Association for Computational Linguistics.
Cite (Informal):
Cluster Analysis of Online Mental Health Discourse using Topic-Infused Deep Contextualized Representations (Kulkarni et al., Louhi 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.louhi-1.10.pdf