No CrossRef data available.
Article contents
Even deeper problems with neural network models of language
Published online by Cambridge University Press: 06 December 2023
Abstract
We recognize today's deep neural network (DNN) models of language behaviors as engineering achievements. However, what we know intuitively and scientifically about language shows that what DNNs are and how they are trained on bare texts, makes them poor models of mind and brain for language organization, as it interacts with infant biology, maturation, experience, unique principles, and natural law.
- Type
- Open Peer Commentary
- Information
- Copyright
- Copyright © The Author(s), 2023. Published by Cambridge University Press
References
Bever, T. G., Fodor, J. A., & Garrett, M. (1968). A formal limitation of associationism. In Dixon, T. R. & Horton, D. L. (Eds.), Verbal behavior and general behavior theory (pp. 582–585). Prentice Hall.Google Scholar
Chomsky, N. (in press). The miracle creed and SMT. In Greco, M. & Mocci, D. (Eds.), A Cartesian dream: A geometrical account of syntax: In honor of Andrea Moro. Rivista di Grammatica Generativa/Research in Generative Grammar. Lingbuzz Press.Google Scholar
Gleitman, L., & Landau, B. (2013). Every child an isolate: Nature's experiments in language learning. In Piattelli-Palmarini, M. & Berwick, R. C. (Eds.), Rich languages from poor inputs (pp. 91–106). Oxford University Press.Google Scholar
Goodfellow, I., Shlens, J., & Szegedy, C. (2015). Explaining and harnessing adversarial examples. In Bengio, Y. & LeCun, Y. (Eds.), 3rd International conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7–9.Google Scholar
McDonough, J. K. (2022). A miracle creed: The principle of optimality in Leibniz's physics and philosophy. Oxford University Press.CrossRefGoogle Scholar
Musso, M., Moro, A., Glauche, V., Rijntjes, M., Reichenbach, J., Buechel, C., & Weiler, C. (2003). Broca's area and the language instinct. Nature Neuroscience, 6(7), 774–781.CrossRefGoogle ScholarPubMed
Yang, C. (2011). Learnability. In Roeper, T. & de Villiers, J. (Eds.) Handbook of language acquisition (pp. 119–154). Kluwer.Google Scholar
Target article
Deep problems with neural network models of human vision
Related commentaries (29)
Explananda and explanantia in deep neural network models of neurological network functions
A deep new look at color
Beyond the limitations of any imaginable mechanism: Large language models and psycholinguistics
Comprehensive assessment methods are key to progress in deep learning
Deep neural networks are not a single hypothesis but a language for expressing computational hypotheses
Even deeper problems with neural network models of language
Fixing the problems of deep neural networks will require better training data and learning algorithms
For deep networks, the whole equals the sum of the parts
For human-like models, train on human-like tasks
Going after the bigger picture: Using high-capacity models to understand mind and brain
Implications of capacity-limited, generative models for human vision
Let's move forward: Image-computable models and a common model evaluation scheme are prerequisites for a scientific understanding of human vision
Modelling human vision needs to account for subjective experience
Models of vision need some action
My pet pig won't fly and I want a refund
Neither hype nor gloom do DNNs justice
Neural networks need real-world behavior
Neural networks, AI, and the goals of modeling
Perceptual learning in humans: An active, top-down-guided process
Psychophysics may be the game-changer for deep neural networks (DNNs) to imitate the human vision
Statistical prediction alone cannot identify good models of behavior
The model-resistant richness of human visual experience
The scientific value of explanation and prediction
There is a fundamental, unbridgeable gap between DNNs and the visual cortex
Thinking beyond the ventral stream: Comment on Bowers et al.
Using DNNs to understand the primate vision: A shortcut or a distraction?
Where do the hypotheses come from? Data-driven learning in science and the brain
Why psychologists should embrace rather than abandon DNNs
You can't play 20 questions with nature and win redux
Author response
Clarifying status of DNNs as models of human vision