Recognising suicidal messages in Dutch social media

Bart Desmet, Véronique Hoste


Abstract
Early detection of suicidal thoughts is an important part of effective suicide prevention. Such thoughts may be expressed online, especially by young people. This paper presents on-going work on the automatic recognition of suicidal messages in social media. We present experiments for automatically detecting relevant messages (with suicide-related content), and those containing suicide threats. A sample of 1357 texts was annotated in a corpus of 2674 blog posts and forum messages from Netlog, indicating relevance, origin, severity of suicide threat and risks as well as protective factors. For the classification experiments, Naive Bayes, SVM and KNN algorithms are combined with shallow features, i.e. bag-of-words of word, lemma and character ngrams, and post length. The best relevance classification is achieved by using SVM with post length, lemma and character ngrams, resulting in an F-score of 85.6% (78.7% precision and 93.8% recall). For the second task (threat detection), a cascaded setup which first filters out irrelevant messages with SVM and then predicts the severity with KNN, performs best: 59.2% F-score (69.5% precision and 51.6% recall).
Anthology ID:
L14-1482
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
830–835
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/597_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Bart Desmet and Véronique Hoste. 2014. Recognising suicidal messages in Dutch social media. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 830–835, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Recognising suicidal messages in Dutch social media (Desmet & Hoste, LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/597_Paper.pdf