Cipher: A Prototype Game-with-a-Purpose for Detecting Errors in Text

Liang Xu, Jon Chamberlain


Abstract
Errors commonly exist in machine-generated documents and publication materials; however, some correction algorithms do not perform well for complex errors and it is costly to employ humans to do the task. To solve the problem, a prototype computer game called Cipher was developed that encourages people to identify errors in text. Gamification is achieved by introducing the idea of steganography as the entertaining game element. People play the game for entertainment while they make valuable annotations to locate text errors. The prototype was tested by 35 players in a evaluation experiment, creating 4,764 annotations. After filtering the data, the system detected manually introduced text errors and also genuine errors in the texts that were not noticed when they were introduced into the game.
Anthology ID:
2020.gamnlp-1.3
Volume:
Workshop on Games and Natural Language Processing
Month:
May
Year:
2020
Address:
Marseille, France
Editor:
Stephanie M. Lukin
Venue:
GAMESandNLP
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
17–25
Language:
English
URL:
https://aclanthology.org/2020.gamnlp-1.3
DOI:
Bibkey:
Cite (ACL):
Liang Xu and Jon Chamberlain. 2020. Cipher: A Prototype Game-with-a-Purpose for Detecting Errors in Text. In Workshop on Games and Natural Language Processing, pages 17–25, Marseille, France. European Language Resources Association.
Cite (Informal):
Cipher: A Prototype Game-with-a-Purpose for Detecting Errors in Text (Xu & Chamberlain, GAMESandNLP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.gamnlp-1.3.pdf