Cortical Speech Databases For Deciphering the Articulatory Code

Harald Höge


Abstract
The paper relates to following ‘AC-hypotheses’: The articulatory code (AC) is a neural code exchanging multi-item messages between the short-term memory and cortical areas as the vSMC and STG. In these areas already neurons active in the presence of articulatory features have been measured. The AC codes the content of speech segmented in chunks and is the same for both modalities - speech perception and speech production. Each AC-message is related to a syllable. The items of each message relate to coordinated articulatory gestures composing the syllable. The mechanism to transport the AC and to segment the auditory signal is based on Ɵ/γ-oscillations, where a Ɵ-cycle has the duration of a Ɵ-syllable. The paper describes the findings from neuroscience, phonetics and the science of evolution leading to the AC-hypotheses. The paper proposes to verify the AC-hypotheses by measuring the activity of all ensembles of neurons coding and decoding the AC. Due to state of the art, the cortical measurements to be prepared, done and further processed need a high effort from scientists active in different areas. We propose to launch a project to produce cortical speech databases with cortical recordings synchronized with the speech signal allowing to decipher the articulatory code.
Anthology ID:
2020.lrec-1.17
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
133–137
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.17
DOI:
Bibkey:
Cite (ACL):
Harald Höge. 2020. Cortical Speech Databases For Deciphering the Articulatory Code. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 133–137, Marseille, France. European Language Resources Association.
Cite (Informal):
Cortical Speech Databases For Deciphering the Articulatory Code (Höge, LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.17.pdf