Skip to main content Accessibility help

Multisensory integration substantiates distributed and overlapping neural networks

  • Achille Pasqualotto (a1)


The hypothesis that highly overlapping networks underlie brain functions (neural reuse) is decisively supported by three decades of multisensory research. Multisensory areas process information from more than one sensory modality and therefore represent the best examples of neural reuse. Recent evidence of multisensory processing in primary visual cortices further indicates that neural reuse is a basic feature of the brain.



Hide All
Alain, C., Woods, D. L. & Knight, R. T. (1998) A distributed cortical network for auditory sensory memory in humans. Brain Research 812:2337.
Amad, A., Cachia, A., Gorwood, P., Pins, D., Delmaire, C., Rolland, B., Mondino, M., Thomas, P. & Jardri, R. (2014) The multimodal connectivity of the hippocampal complex in auditory and visual hallucinations. Molecular Psychiatry 19:184–91.
Amedi, A., Raz, N., Pianka, P., Malach, R. & Zohary, E. (2003) Early “visual” cortex activation correlates with superior verbal memory performance in the blind. Nature Neuroscience 6:758–66.
Andersen, R. A., Essick, G. K. & Siegel, R. M. (1985) Encoding of spatial location by posterior parietal neurons. Science 230:456–58.
Anderson, M. L. (2010) Neural reuse: A fundamental organizational principle of the brain. Behavioral and Brain Sciences 33(4):245–66. doi: 10.1017/S0140525X10000853.
Anderson, M. L. (2014) After phrenology: Neural reuse and the interactive brain. MIT Press.
Bach-Y-Rita, P., Collins, C. C., Saunders, F. A., White, B. & Scadden, L. (1969) Vision substitution by tactile image projection. Nature 221:963–64.
Beauchamp, M. S. (2005) See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex. Current Opinion in Neurobiology 15:145–53.
Beauchamp, M. S., Yasar, N. E., Frye, R. E. & Ro, T. (2008) Touch, sound and vision in human superior temporal sulcus. NeuroImage 41:1011–20.
Beer, A. L., Plank, T. & Greenlee, M. W. (2011) Diffusion tensor imaging shows white matter tracts between human auditory and visual cortex. Experimental Brain Research 213:299308.
Beer, A. L., Plank, T., Meyer, G. & Greenlee, M. W. (2013) Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing. Frontiers in Integrative Neuroscience 7:5.
Borra, E. & Rockland, K. S. (2011) Projections to early visual areas V1 and V2 in the calcarine fissure from parietal association areas in the macaque. Frontiers in Neuroanatomy 5:35.
Bruce, C., Desimone, R. & Gross, C. G. (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. Journal of Neurophysiology 46:369–84.
Burgess, N., Maguire, E. A., Spiers, H. J. & O'Keefe, J. (2001) A temporoparietal and prefrontal network for retrieving the spatial context of lifelike events. NeuroImage 14:439–53.
De Gelder, B. & Bertelson, P. (2003) Multisensory integration, perception and ecological validity. Trends in Cognitive Sciences 7:460–67.
Decharms, R. C. & Zador, A. (2000) Neural representation and the cortical code. Annual Review of Neuroscience 23:613–47.
Desgranges, B., Baron, J. C. & Eustache, F. (1998) The functional neuroanatomy of episodic memory: The role of the frontal lobes, the hippocampal formation, and other areas. NeuroImage 8:198213.
Driver, J. & Noesselt, T. (2008) Multisensory interplay reveals crossmodal influences on “sensory-specific” brain regions, neural responses, and judgments. Neuron 57:1123.
Duffau, H. (2008) The anatomo-functional connectivity of language revisited: New insights provided by electrostimulation and tractography. Neuropsychologia 46:927–34.
Filippetti, M. L., Lloyd-Fox, S., Longo, M. R., Farroni, T. & Johnson, M. H. (2015) Neural mechanisms of body awareness in infants. Cerebral Cortex 25:3779–87.
Fuster, J. M. (1988) Prefrontal cortex. Birkhäuser.
Gallese, V., Fadiga, L., Fogassi, L. & Rizzolatti, G. (1996) Action recognition in the premotor cortex. Brain 119:593609.
Ganis, G., Thompson, W. L. & Kosslyn, S. M. (2004) Brain areas underlying visual mental imagery and visual perception: An fMRI study. Cognitive Brain Research 20:226–41.
Gauthier, I., Skudlarski, P., Gore, J. C. & Anderson, A. W. (2000) Expertise for cars and birds recruits brain areas involved in face recognition. Nature Neuroscience 3:191–97.
Gerstner, W., Kreiter, A. K., Markram, H. & Herz, A. V. (1997) Neural codes: Firing rates and beyond. Proceedings of the National Academy of Sciences 94:12740–41.
Gobbelé, R., Schürmann, M., Forss, N., Juottonen, K., Buchner, H. & Hari, R. (2003) Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction. NeuroImage 20:503–11.
Goldstein, E. (2009) Sensation and perception. Cengage Learning.
Grafton, S. T., Fadiga, L., Arbib, M. A. & Rizzolatti, G. (1997) Premotor cortex activation during observation and naming of familiar tools. NeuroImage 6:231–36.
Guerreiro, M. J., Putzar, L. & Röder, B. (2015) The effect of early visual deprivation on the neural bases of multisensory processing. Brain 138:1499–504.
Hagen, M. C., Franzén, O., McGlone, F., Essick, G., Dancer, C. & Pardo, J. V. (2002) Tactile motion activates the human middle temporal/V5 (MT/V5) complex. European Journal of Neuroscience 16:957–64.
Horwitz, B. & Braun, A. R. (2004) Brain network interactions in auditory, visual and linguistic processing. Brain and Language 89:377–84.
Iachini, T., Ruggiero, G. & Ruotolo, F. (2014) Does blindness affect egocentric and allocentric frames of reference in small and large scale spaces? Behavioural Brain Research 273:7381.
Jiang, W., Wallace, M. T., Jiang, H., Vaughan, J. W. & Stein, B. E. (2001) Two cortical areas mediate multisensory integration in superior colliculus neurons. Journal of Neurophysiology 85:506–22.
Kauffman, T., Hamilton, R., Keenan, J. P., Warde, A. & Pascual-Leone, A. (2000) The role of visual cortex in tactile Braille reading: The early blind, the sighted, and the blindfolded. Annals of Neurology 48:418–19.
Kawachi, Y., Grove, P. M. & Sakurai, K. (2014) A single auditory tone alters the perception of multiple visual events. Journal of Vision 14:113.
Kayser, C., Petkov, C. I. & Logothetis, N. K. (2008) Visual modulation of neurons in auditory cortex. Cerebral Cortex 18:1560–74.
Kim, M., Ducros, M., Carlson, T., Ronen, I., He, S., Ugurbil, K. & Kim, D.-S. (2006) Anatomical correlates of the functional organization in the human occipitotemporal cortex. Magnetic Resonance Imaging 24:583–90.
Lakatos, P., Chen, C. M., O'Connell, M. N., Mills, A. & Schroeder, C. E. (2007) Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 53:279–92.
Lawson, R., Boylan, A. & Edwards, L. (2014) Where you look can influence haptic object recognition. Attention, Perception, and Psychophysics 76:559–74.
Liang, M., Mouraux, A., Hu, L. & Iannetti, G. D. (2013) Primary sensory cortices contain distinguishable spatial patterns of activity for each sense. Nature Communications 4:1979.
Longo, M. R., Azañón, E. & Haggard, P. (2010) More than skin deep: Body representation beyond primary somatosensory cortex. Neuropsychologia 48:655–68.
Matsuhashi, M., Ikeda, A., Ohara, S., Matsumoto, R., Yamamoto, J., Takayama, M., Satowa, T., Begum, T., Usui, K., Nagamine, T., Mikuni, N., Takahashi, J., Miyamoto, S., Fukuyama, H. & Shibasaki, H. (2004) Multisensory convergence at human temporo-parietal junction – epicortical recording of evoked responses. Clinical Neurophysiology 115:1145–60.
Murray, M. M., Molholm, S., Michel, C. M., Heslenfeld, D. J., Ritter, W., Javitt, D. C., Schroeder, C. E. & Foxe, J. J. (2005) Grabbing your ear: Rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. Cerebral Cortex 15:963–74.
Öngür, D. & Price, J. L. (2000) The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. Cerebral Cortex 10:206–19.
Pascual-Leone, A. & Hamilton, R. (2001) The metamodal organization of the brain. Progress in Brain Research 134:427–45.
Pasqualotto, A., Finucane, C. M. & Newell, F. N. (2013a) Ambient visual information confers a context-specific, long-term benefit on memory for haptic scenes. Cognition 128:363–79.
Pasqualotto, A., Lam, J. S. Y. & Proulx, M. J. (2013b) Congenital blindness improves semantic and episodic memory. Behavioural Brain Research 244:162–65.
Pessoa, L. (2012) Beyond brain regions: Network perspective of cognition-emotion interactions. Behavioral and Brain Sciences 35:158–59.
Poirier, C., Collignon, O., Scheiber, C., Renier, L., Vanlierde, A., Tranduy, D., Veraart, C. & De Volder, A. G. (2006) Auditory motion perception activates visual motion areas in early blind subjects. NeuroImage 31:279–85.
Posner, M. I. & Rothbart, M. K. (2007) Research on attention networks as a model for the integration of psychological science. Annual Review of Psychology 58:123.
Proulx, M. J., Ptito, M. & Amedi, A. (2014) Multisensory integration, sensory substitution and visual rehabilitation. Neuroscience and Biobehavioral Reviews 41:12.
Ravassard, P., Kees, A., Willers, B., Ho, D., Aharoni, D., Cushman, J., Aghajan, Z. M. & Mehta, M. R. (2013) Multisensory control of hippocampal spatiotemporal selectivity. Science 340:1342–46.
Ricciardi, E., Bonino, D., Pellegrini, S. & Pietrini, P. (2014) Mind the blind brain to understand the sighted one! Is there a supramodal cortical functional architecture? Neuroscience and Biobehavioral Reviews 41:6477.
Rolls, E. T. & Tovee, M. J. (1995) Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. Journal of Neurophysiology 73:713–26.
Sadato, N., Pascual-Leone, A., Grafman, J., Ibañez, V., Deiber, M.P., Dold, G. & Hallett, M. (1996) Activation of the primary visual cortex by Braille reading in blind subjects. Nature 380:526–28.
Saenz, M., Lewis, L. B., Huth, A. G., Fine, I. & Koch, C. (2008) Visual motion area MT+/V5 responds to auditory motion in human sight-recovery subjects. Journal of Neuroscience 28:5141–48.
Sathian, K. & Zangaladze, A. (2002) Feeling with the mind's eye: Contribution of visual cortex to tactile perception. Behavioural Brain Research 135:127–32.
Sereno, M. I. & Huang, R. S. (2006) A human parietal face area contains aligned head-centered visual and tactile maps. Nature Neuroscience 9:1337–43.
Serino, A., Canzoneri, E. & Avenanti, A. (2011) Fronto-parietal areas necessary for a multisensory representation of peripersonal space in humans: An rTMS study. Journal of Cognitive Neuroscience 23:2956–67.
Shinkareva, S. V., Mason, R. A., Malave, V. L., Wang, W., Mitchell, T. M. & Just, M. A. (2008) Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS One 3:e1394.
Shulman, G. L., Ollinger, J. M., Akbudak, E., Conturo, T. E., Snyder, A. Z., Petersen, S. E. & Corbetta, M. (1999) Areas involved in encoding and applying directional expectations to moving objects. Journal of Neuroscience 19:9480–96.
Stein, B. E., Huneycutt, W. S. & Meredith, M. A. (1988) Neurons and behavior: The same rules of multisensory integration apply. Brain Research 448: 355–58.
Stein, B. E. & Stanford, T. R. (2008) Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience 9:255–66.
Takahashi, T., Kansaku, K., Wada, M., Shibuya, S. & Kitazawa, S. (2013) Neural correlates of tactile temporal-order judgment in humans: An fMRI study. Cerebral Cortex 23:1952–64.
Uesaki, M. & Ashida, H. (2015) Optic-flow selective cortical sensory regions associated with self-reported states of vection. Frontiers in Psychology 6:775.
Vallar, G., Lobel, E., Galati, G., Berthoz, A., Pizzamiglio, L. & Le Bihan, D. (1999) A fronto-parietal system for computing the egocentric spatial frame of reference in humans. Experimental Brain Research 124:281–86.
Van Dijk, K. R. A., Hedden, T., Venkataraman, A., Evans, K. C., Lazar, S. W. & Buckner, R. L. (2010) Intrinsic functional connectivity as a tool for human connectomics: Theory, properties, and optimization. Journal of Neurophysiology 103:297321.
Vidal, M. & Barrès, V. (2014) Hearing (rivalling) lips and seeing voices: How audiovisual interactions modulate perceptual stabilization in binocular rivalry. Frontiers in Human Neuroscience 8:677.
Yeo, B. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., Roffman, J. L., Smoller, J. W., Zollei, L., Polimeni, J. R., Fischl, B., Liu, H. & Buckner, R. L. (2011) The organization of the human cerebral cortex estimated by intrinsic functional connectivity. Journal of Neurophysiology 106:1125–65.
Zangaladze, A., Epstein, C. M., Grafton, S. T. & Sathian, K. (1999) Involvement of visual cortex in tactile discrimination of orientation. Nature 401:587–90.

Multisensory integration substantiates distributed and overlapping neural networks

  • Achille Pasqualotto (a1)


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed