A Tale of Two Lexica Testing Computational Hypotheses with Deep Convolutional Neural Networks

by   Enes Avcu, et al.

Gow's (2012) dual lexicon model suggests that the primary purpose of words is to mediate the mappings between acoustic-phonetic input and other forms of linguistic representation. Motivated by evidence from functional imaging, aphasia, and behavioral results, the model argues for the existence of two parallel wordform stores: the dorsal and ventral processing streams. In this paper, we tested the hypothesis that the complex, but systematic mapping between sound and articulation in the dorsal stream poses different computational pressures on feature sets than the more arbitrary mapping between sound and meaning. To test this hypothesis, we created two deep convolutional neural networks (CNNs). While the dorsal network was trained to identify individual spoken words, the ventral network was trained to map them onto semantic classes. We then extracted patterns of network activation from the penultimate level of each network and tested how well features generated by the network supported generalization to linguistic categorization associated with the dorsal versus ventral processing streams. Our preliminary results showed both models successfully learned their tasks. Secondary generalization testing showed the ventral CNN outperformed the dorsal CNN on a semantic task: concreteness classification, while the dorsal CNN outperformed the ventral CNN on articulation tasks: classification by onset phoneme class and syllable length. These results are consistent with the hypothesis that the divergent processing demands of the ventral and dorsal processing streams impose computational pressures for the development of multiple lexica.


A High Quality Text-To-Speech System Composed of Multiple Neural Networks

While neural networks have been employed to handle several different tex...

Short-segment heart sound classification using an ensemble of deep convolutional neural networks

This paper proposes a framework based on deep convolutional neural netwo...

Sub-band Convolutional Neural Networks for Small-footprint Spoken Term Classification

This paper proposes a Sub-band Convolutional Neural Network for spoken t...

Testing the Channels of Convolutional Neural Networks

Neural networks have complex structures, and thus it is hard to understa...

Analyzing and Interpreting Convolutional Neural Networks in NLP

Convolutional neural networks have been successfully applied to various ...

Neural Activation Semantic Models: Computational lexical semantic models of localized neural activations

Neural activation models that have been proposed in the literature use a...

Please sign up or login with your details

Forgot password? Click here to reset