Decoding Anagrammed Texts Written in an Unknown Language and Script

Bradley Hauer, Grzegorz Kondrak


Abstract
Algorithmic decipherment is a prime example of a truly unsupervised problem. The first step in the decipherment process is the identification of the encrypted language. We propose three methods for determining the source language of a document enciphered with a monoalphabetic substitution cipher. The best method achieves 97% accuracy on 380 languages. We then present an approach to decoding anagrammed substitution ciphers, in which the letters within words have been arbitrarily transposed. It obtains the average decryption word accuracy of 93% on a set of 50 ciphertexts in 5 languages. Finally, we report the results on the Voynich manuscript, an unsolved fifteenth century cipher, which suggest Hebrew as the language of the document.
Anthology ID:
Q16-1006
Volume:
Transactions of the Association for Computational Linguistics, Volume 4
Month:
Year:
2016
Address:
Cambridge, MA
Editors:
Lillian Lee, Mark Johnson, Kristina Toutanova
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
75–86
Language:
URL:
https://aclanthology.org/Q16-1006
DOI:
10.1162/tacl_a_00084
Bibkey:
Cite (ACL):
Bradley Hauer and Grzegorz Kondrak. 2016. Decoding Anagrammed Texts Written in an Unknown Language and Script. Transactions of the Association for Computational Linguistics, 4:75–86.
Cite (Informal):
Decoding Anagrammed Texts Written in an Unknown Language and Script (Hauer & Kondrak, TACL 2016)
Copy Citation:
PDF:
https://aclanthology.org/Q16-1006.pdf
Video:
 https://aclanthology.org/Q16-1006.mp4