Discovering Biased News Articles Leveraging Multiple Human Annotations

Konstantina Lazaridou, Alexander Löser, Maria Mestre, Felix Naumann


Abstract
Unbiased and fair reporting is an integral part of ethical journalism. Yet, political propaganda and one-sided views can be found in the news and can cause distrust in media. Both accidental and deliberate political bias affect the readers and shape their views. We contribute to a trustworthy media ecosystem by automatically identifying politically biased news articles. We introduce novel corpora annotated by two communities, i.e., domain experts and crowd workers, and we also consider automatic article labels inferred by the newspapers’ ideologies. Our goal is to compare domain experts to crowd workers and also to prove that media bias can be detected automatically. We classify news articles with a neural network and we also improve our performance in a self-supervised manner.
Anthology ID:
2020.lrec-1.159
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
1268–1277
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.159
DOI:
Bibkey:
Cite (ACL):
Konstantina Lazaridou, Alexander Löser, Maria Mestre, and Felix Naumann. 2020. Discovering Biased News Articles Leveraging Multiple Human Annotations. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 1268–1277, Marseille, France. European Language Resources Association.
Cite (Informal):
Discovering Biased News Articles Leveraging Multiple Human Annotations (Lazaridou et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.159.pdf