Skip to main content Accessibility help

Multimodal infant-directed communication: how caregivers combine tactile and linguistic cues*



Both touch and speech independently have been shown to play an important role in infant development. However, little is known about how they may be combined in the input to the child. We examined the use of touch and speech together by having mothers read their 5-month-olds books about body parts and animals. Results suggest that speech+touch multimodal events are characterized by more exaggerated touch and speech cues. Further, our results suggest that maternal touches are aligned with speech and that mothers tend to touch their infants in locations that are congruent with names of body parts. Thus, our results suggest that tactile cues could potentially aid both infant word segmentation and word learning.


Corresponding author

[*]Address for correspondence: Rana Abu-Zhaya, Purdue University, Lyles-Porter Hall, West Lafayette, IN 47907. e-mail:


Hide All
Anisfeld, E., Casper, V., Nozyce, M. & Cunningham, N. (1990). Does infant carrying promote attachment? An experimental study of the effects of increased physical contact on the development of attachment. Child Development 61(5), 1617–27.
Bergelson, E. & Swingley, D. (2012). At 6–9 months, human infants know the meanings of many common nouns. Proceedings of the National Academy of Sciences of the United States of America 109(9), 3253–8.
Boersma, P. & Weenink, D. (2013). Praat: doing phonetics by computer [Computer program], Version 5.3·45, online: <> (retrieved 30 December 2013).
Bortfeld, H., Morgan, J., Golinkoff, R. M. & Rathbun, K. (2005). Mommy and Me: familiar names help launch babies into speech-stream segmentation. Psychological Science 16(4), 298304.
Brand, R. J., Baldwin, D. A. & Ashburn, L. A. (2002). Evidence for ‘motionese’: modifications in mothers’ infant-directed action. Developmental Science 5(1), 7283.
Brand, R. J. & Shallcross, W. L. (2008). Infants prefer motionese to adult-directed action. Developmental Science 11(6), 853–61.
Brand, R. J., Shallcross, W. L., Sabatos, M. G. & Massie, K. P. (2007). Fine-grained analysis of motionese: eye gaze, object exchanges, and action units in infant- versus adult-directed action. Infancy 11(2), 203–14.
Brugman, H. & Russel, A. (2004). Annotating multimedia/multi-modal resources with ELAN. In Proceedings of LREC 2004, Fourth International Conference on Language Resources and Evaluation. Nijmegen: The Language Archive, Max Planck Institute for Psycholinguistics Online: <>.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20(1), 3746.
Falk, D. (2004). Prelinguistic evolution in early hominins: Whence motherese? Behavioral and Brain Sciences 27(4), 491541.
Feldman, R., Singer, M. & Zagoory, O. (2010). Touch attenuates infants’ physiological reactivity to stress. Developmental Science 13(2), 271–8.
Fenson, L., Dale, P., Reznick, S., Thal, D., Bates, E., Hartung, J., … Reilly, J. (1993). The MacArthur Communicative Development Inventories. San Diego, CA: Singular Publishing Group.
Ferber, S. G. (2004). The nature of touch in mothers experiencing maternity blues: the contribution of parity. Early Human Development 79(1), 6575.
Ferber, S. G., Feldman, R. & Makhoul, I. R. (2008). The development of maternal touch across the first year of life. Early Human Development 84(6), 363–70.
Fernald, A. & Simon, T. (1984). Expanded intonation contours in mothers’ speech to newborns. Developmental Psychology 20(1), 104–13.
Fernald, A., Taeschner, T., Dunn, J., Papousek, M., de Boysson-Bardies, B. & Fukui, I. (1989). A cross-language study of prosodic modifications in mothers’ and fathers’ speech to preverbal infants. Journal of Child Language 16(03), 477501.
Fisher, C. & Tokura, H. (1996). Acoustic cues to grammatical structure in infant-directed speech: cross-linguistic evidence. Child Development 67(6), 3192–218.
Fisher, R. A. (1935). The design of experiments. Edinburgh: Oliver and Boyd.
Franco, F., Fogel, A., Messinger, D. S. & Frazier, C. A. (1996). Cultural differences in physical contact between Hispanic and Anglo mother–infant dyads living in the United States. Early Development and Parenting 5(3), 119–27.
Gamer, M., Lemon, J., Fellows, I. & Singh, P. (2015). irr: Various Coefficients of Interrater Reliability and Agreement. Online: <> (retrieved 3 June 2015).
Gogate, L. J., Bahrick, L. E. & Watson, J. D. (2000). A study of multimodal motherese: the role of temporal synchrony between verbal labels and gestures. Child Development 71(4), 878–94.
Graf Estes, K., Evans, J. L., Alibali, M. W. & Saffran, J. R. (2007). Can infants map meaning to newly segmented words? Psychological Science 18(3), 254–9.
Graf Estes, K. & Hurley, K. (2013). Infant-directed prosody helps infants map sounds to meanings. Infancy 18(5), 797824.
Herrera, E., Reissland, N. & Shepherd, J. (2004). Maternal touch and maternal child-directed speech: effects of depressed mood in the postnatal period. Journal of Affective Disorders 81(1), 2939.
Hertenstein, M. J. (2002). Touch: its communicative functions in infancy. Human Development 45(2), 7094.
Hills, T. (2012). The company that words keep: comparing the statistical structure of child- versus adult-directed language. Journal of Child Language 40(3), 119.
Jean, A. D. L. & Stack, D. M. (2009). Functions of maternal touch and infants’ affect during face-to-face interactions: new directions for the still-face. Infant Behavior & Development 32(1), 123–8.
Jean, A. D. L. & Stack, D. M. (2012). Full-term and very-low-birth-weight preterm infants’ self-regulating behaviors during a still-face interaction: influences of maternal touch. Infant Behavior & Development 35(4), 779–91.
Jean, A. D. L., Stack, D. M. & Fogel, A. (2009). A longitudinal investigation of maternal touching across the first 6 months of life: age and context effects. Infant Behavior & Development 32(3), 344–9.
Junge, C., Kooijman, V., Hagoort, P. & Cutler, A. (2012). Rapid recognition at 10 months as a predictor of language development. Developmental Science 15(4), 463–73.
Jusczyk, P. W. (1999). How infants begin to extract words from speech. Trends in Cognitive Sciences 3(9), 323–8.
Kooijman, V., Junge, C., Johnson, E. K., Hagoort, P. & Cutler, A. (2013). Predictive brain signals of linguistic development. Frontiers in Psychology 4(25), 113.
Landis, J. R. & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics 33(1), 159–74.
Lewkowicz, D. J. (1996). Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception and Performance 22(5), 1094–106.
Makin, L. (2006). Literacy 8–12 months: What are babies learning? Early Years 26(3), 267–77.
McNeill, D. (2012). How language began. New York: Cambridge University Press.
Meyer, M., Hard, B., Brand, R. J., McGarvey, M. & Baldwin, D. A. (2011). Acoustic packaging: maternal speech and action synchrony. IEEE Transactions on Autonomous Mental Development 3(2), 154–62.
Mol, S. E., Bus, A. G., de Jong, M. T. & Smeets, D. J. H. (2008). Added value of dialogic parent–child book readings: a meta-analysis. Early Education and Development 19(1), 726.
Moszkowski, R. J. & Stack, D. M. (2007). Infant touching behavior during mother–infant face-to-face interactions. Infant and Child Development , 16(3) 307–19.
Muir, D. W. (2002). Adult communications with infants through touch: the forgotten sense. Human Development 45(2), 95–9.
Nakata, T. & Trehub, S. E. (2004). Infants’ responsiveness to maternal speech and singing. Infant Behavior and Development 27(4), 455–64.
Newman, R., Ratner, N. B., Jusczyk, A. M., Jusczyk, P. W. & Dow, K. A. (2006). Infants’ early ability to segment the conversational speech signal predicts later language development: a retrospective analysis. Developmental Psychology 42(4), 643–55.
Nomikou, I. & Rohlfing, K. J. (2011). Language does something: body action and language in maternal input to three-month-olds. IEEE Transactions on Autonomous Mental Development 3(2), 113–28.
Richman, A. L., Miller, P. M. & LeVine, R. A. (1992). Cultural and educational variations in maternal responsiveness. Developmental Psychology 28(4), 614–21.
Seidl, A., Tincoff, R., Baker, C. & Cristia, A. (2015). Why the body comes first: effects of experimenter touch on infants’ word finding. Developmental Science 18(1), 155–64.
Sénéchal, M., LeFevre, J. A., Thomas, E. M. & Daley, K. E. (1998). Differential effects of home literacy experiences on the development of oral and written language. Reading Research Quarterly 33(1), 96116.
Shute, B. & Wheldall, K. (1999). Fundamental frequency and temporal modifications in the speech of British fathers to their children. Educational Psychology 19(2), 221–33.
Singh, L., Nestor, S., Parikh, C. & Yull, A. (2009). Influences of infant-directed speech on early word recognition. Infancy 14(6), 654–66.
Singh, L., Reznick, J. S. & Xuehua, L. (2012). Infant word segmentation and childhood vocabulary development: a longitudinal analysis. Developmental Science 15(4), 482–95.
Stack, D. M. & Arnold, S. L. (1998). Changes in mothers’ touch and hand gestures influence infant behavior during face-to-face interchanges. Infant Behavior and Development 21(3), 451–68.
Stack, D. M. & Muir, D. W. (1990). Tactile stimulation as a component of social interchange: new interpretations for the still-face effect. British Journal of Developmental Psychology 8, 131–45.
Tamis-LeMonda, C. S., Kuchirko, Y. & Tafuro, L. (2013). From action to interaction: infant object exploration and mothers’ contingent responsiveness. IEEE Transactions on Autonomous Mental Development 5(3), 202–9.
Tamis-LeMonda, C. S., Song, L., Leavell, A. S., Kahana-Kalman, R. & Yoshikawa, H. (2012). Ethnic differences in mother–infant language and gestural communications are associated with specific skills in infants. Developmental Science 15(3), 384–97.
Thiessen, E. D., Hill, E. A. & Saffran, J. R. (2005). Infant-directed speech facilitates word segmentation. Infancy 7(1), 5371.
Tincoff, R. & Jusczyk, P. W. (2012). Six-month-olds comprehend words that refer to parts of the body. Infancy 17(4), 432–44.
Weiss, S. J., Wilson, P., Hertenstein, M. J. & Campos, R. (2000). The tactile context of a mother's caregiving: implications for attachment of low birth weight infants. Infant Behavior and Development 23(1), 91111.
Weiss, S. J., Wilson, P. & Morrison, D. (2004). Maternal tactile stimulation and the neurodevelopment of low birth weight infants. Infancy 5(1), 85107.
Zukow-Goldring, P. (1997). A social ecological realist approach to the emergence of the lexicon: educating attention to amodal invariants in gesture and speech. In Dent-Read, C. & Zukow-Goldring, P. (eds), Evolving explanations of development: ecological approaches to organism-environment systems, (pp. 199250). Washington, DC: American Psychological Association.

Related content

Powered by UNSILO

Multimodal infant-directed communication: how caregivers combine tactile and linguistic cues*



Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.