Automatic In-the-wild Dataset Annotation with Deep Generalized Multiple Instance Learning

Joana Correia, Isabel Trancoso, Bhiksha Raj


Abstract
The automation of the diagnosis and monitoring of speech affecting diseases in real life situations, such as Depression or Parkinson’s disease, depends on the existence of rich and large datasets that resemble real life conditions, such as those collected from in-the-wild multimedia repositories like YouTube. However, the cost of manually labeling these large datasets can be prohibitive. In this work, we propose to overcome this problem by automating the annotation process, without any requirements for human intervention. We formulate the annotation problem as a Multiple Instance Learning (MIL) problem, and propose a novel solution that is based on end-to-end differentiable neural networks. Our solution has the additional advantage of generalizing the MIL framework to more scenarios where the data is stil organized in bags but does not meet the MIL bag label conditions. We demonstrate the performance of the proposed method in labeling the in-the-Wild Speech Medical (WSM) Corpus, using simple textual cues extracted from videos and their metadata. Furthermore we show what is the contribution of each type of textual cues for the final model performance, as well as study the influence of the size of the bags of instances in determining the difficulty of the learning problem
Anthology ID:
2020.lrec-1.435
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
3542–3550
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.435
DOI:
Bibkey:
Cite (ACL):
Joana Correia, Isabel Trancoso, and Bhiksha Raj. 2020. Automatic In-the-wild Dataset Annotation with Deep Generalized Multiple Instance Learning. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 3542–3550, Marseille, France. European Language Resources Association.
Cite (Informal):
Automatic In-the-wild Dataset Annotation with Deep Generalized Multiple Instance Learning (Correia et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.435.pdf