Skip to main content Accessibility help
×
Hostname: page-component-848d4c4894-ttngx Total loading time: 0 Render date: 2024-05-19T13:44:21.729Z Has data issue: false hasContentIssue false

3 - Iconicity, Schematicity, and Representation in Gesture

from Part I - Gestural Types: Forms and Functions

Published online by Cambridge University Press:  01 May 2024

Alan Cienki
Affiliation:
Vrije Universiteit, Amsterdam
Get access

Summary

Iconic aspects of postures and hand movements have long been a central issue in gesture research. A speaker’s body may become a dynamic, viewpointed ‘icon’ (Peirce 1960) of someone or something else, or hands may create iconic signs. Recent research on iconicity in spoken and signed languages has (re)established its constitutive role in language (e.g. Jakobson 1990) and more broadly in multimodal interaction, which naturally includes iconic manual gestures and full-body enactments. Peircean semiotics are combined with cognitive linguistic accounts to demonstrate the role of iconicity in embodied conceptual and linguistic structures and to account for modality-specific manifestations of iconicity in gesture. We provide an overview of gestural modes of representation and techniques of depiction and exemplify the ways in which iconicity interacts with other semiotic principles, such as indexicality, viewpoint, and metonymy. The chapter also highlights empirical research into gestural iconicity as it relates to language acquisition, development, and processing, language and cognition, and the fields of computation and robotics.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2024

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Allen, L. Q. (2000). Nonverbal accommodations in foreign language teacher talk. Applied Language Learning, 11(1), 155176.Google Scholar
Andrén, M. (2010). Children’s gestures from 18 to 30 months (Unpublished doctoral dissertation). Lund University, Lund, Sweden.Google Scholar
Arnheim, R. (1969). Visual thinking. Berkeley, CA: University of California.Google Scholar
Bavelas, J., Chovil, N., Lawrie, D. A., & Wade, A. (1992). Interactive gestures. Discourse Processes, 15(4), 469489. https://doi.org/10.1080/01638539209544823CrossRefGoogle Scholar
Bergmann, K., & Kopp, S. (2010). Modeling the production of coverbal iconic gestures by learning Bayesian decision networks. Applied Artificial Intelligence, 24(6), 530551. https://doi.org/10.1080/08839514.2010.492162CrossRefGoogle Scholar
Bouvet, D. (1997). Le corps et la métaphore dans les langues gestuelles: A la recherche des modes de production des signes [The body and metaphor in gestural languages: In search of the modes of production of signs]. Paris, France: L’Harmattan.Google Scholar
Bremner, P., & Leonards, U. (2016). Iconic gestures for robot avatars, recognition and integration with speech. Frontiers in Psychology, 7, Article 183. https://doi.org/10.3389/fpsyg.2016.00183CrossRefGoogle ScholarPubMed
Bressem, J. (2013). Empirical research of body, language, and communication. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Teßendorf, S. (Eds.), Body - language - communication. An international handbook on multimodality in human interaction (Vol. 1, pp. 393416). Berlin, Germany: De Gruyter Mouton.Google Scholar
Bressem, J., & Müller, C. (2014a). A repertoire of German recurrent gestures with pragmatic functions. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 15751591). Berlin, Germany: De Gruyter Mouton.Google Scholar
Bressem, J., & Müller, C. (2014b). The family of away gestures. Negation, refusal and negative assessment. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 15921604). Berlin, Germany: De Gruyter Mouton.Google Scholar
Bressem, J., Stein, N., & Wegener, C. (2017). Multimodal language use in Savosavo: Refusing, excluding and negating with speech and gesture. Pragmatics, 27(2), 173206. https://doi.org/10.1075/prag.27.2.01breGoogle Scholar
Bühler, K. (1982). Sprachtheorie: Die Darstellungsfunktion der Sprache [Theory of Language: The representational function of language]. Stuttgart, Germany: Fischer. (Original work published 1934)Google Scholar
Calbris, G. (1990). The semiotics of French gestures. Bloomington, IN: Indiana University Press.Google Scholar
Calbris, G. (2011). Elements of meaning in gesture. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Capirci, O., Contaldo, A., Caselli, M. C., & Volterra, V. (2005). From action to language through gesture: A longitudinal perspective. Gesture, 5, 155177. https://doi.org/10.1075/gest.5.1.12capGoogle Scholar
Capirci, O., & Volterra, V. (2008). Gesture and speech: The emergence and development of a strong and changing partnership. Gesture, 8(1), 2244. https://doi.org/10.1075/gest.8.1.04capCrossRefGoogle Scholar
Cienki, A. (1998). Metaphoric gestures and some of their relations to verbal metaphoric expression. In Koenig, J.-P. (Ed.), Discourse and cognition: Bridging the gap (pp. 189204). Stanford, CA: CSLI Publications.Google Scholar
Cienki, A. (2013). Image schemas and mimetic schemas in cognitive linguistics and gesture studies. Review of Cognitive Linguistics, 11(2), 417432. https://doi.org/10.1075/rcl.11.2.13cieCrossRefGoogle Scholar
Cienki, A., & Müller, C. (Eds.). (2008). Metaphor and gesture. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Clark, H. H. (2016). Depicting as a method of communication. Psychological Review, 123(3), 324347.CrossRefGoogle ScholarPubMed
Cooperrider, K., & Goldin-Meadow, S. (2017). Gesture, language, and cognition. In Dancygier, B. (Ed.), The Cambridge handbook of cognitive linguistics (pp. 118134). Cambridge, UK: Cambridge University Press. https://doi.org/10.1075/gest.12.2.01cooCrossRefGoogle Scholar
Cooperrider, K., & Núñez, R. (2012). Nose-pointing: Notes on a facial gesture of Papua New Guinea. Gesture, 12(2), 103129. https://doi.org/10.1075/gest.12.2.01cooCrossRefGoogle Scholar
Danaher, D. S. (1998). Peirce’s semiotic and cognitive metaphor theory. Semiotica, 119(1/2), 171207.Google Scholar
Devylder, S. (2018). Diagrammatic iconicity explains asymmetries in Paamese possessive constructions. Cognitive Linguistics, 29(2), 313348. https://doi.org/10.1515/cog-2017-0058CrossRefGoogle Scholar
de Wit, J. (2022). I like the way you move: Robots that gesture, and their potential as second language tutors for children (Unpublished doctoral dissertation). Tilburg University, the Netherlands.Google Scholar
de Wit, J., Willemsen, B., de Haas, M., van den Berghe, R., Leseman, P., Oudgenoeg-Paz, O., Verhagen, J., Vogt, P., & Krahmer, E. (2022). Designing and evaluating iconic gestures for child–robot second language learning. Interacting with Computers, 33(6), 596626. https://doi.org/10.1093/iwc/iwac013CrossRefGoogle Scholar
Dingemanse, M., Blasi, D. E., Lupyan, G., Christiansen, M. H., & Monaghan, P. (2015). Arbitrariness, iconicity, and systematicity in language. Trends in Cognitive Sciences, 19(10), 603615. https://doi.org/10.1016/j.tics.2015.07.013CrossRefGoogle ScholarPubMed
Di Paolo, E., Cuffari, E., & De Jaeger, H. (2018). Linguistic bodies. Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Dudis, P. (2004). Body partitioning and real space blends. Cognitive Linguistics, 15, 223238.CrossRefGoogle Scholar
Ekman, P., & Friesen, W. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1(1), 4998.CrossRefGoogle Scholar
Enfield, N. J. (2009). The anatomy of meaning: Speech, gesture, and composite utterances. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Enfield, N. J. (2011). Elements of formulation. In Streeck, J., Goodwin, C. & LeBaron, C. (Eds.), Embodied interaction: Language and the body in the material world (pp. 5966). Cambridge, UK: Cambridge University Press.Google Scholar
Fenlon, J., Cormier, K., Rentelis, R., Schembri, A., Rowley, K., Adam, R., & Woll, B. (2014). BSL SignBank: A lexical database of British Sign Language (1st ed.). London, UK: Deafness, Cognition and Language Research Centre, University College London. https://bslsignbank.ucl.ac.uk/dictionary/Google Scholar
Ferrara, L., & Hodge, G. (2018). Language as description, indication, and depiction. Frontiers in Psychology, 9, 716. https://doi.org/10.3389/fpsyg.2018.00716CrossRefGoogle ScholarPubMed
Fillmore, C. J. (1982). Frame semantics. In The Linguistic Society of Korea (Ed.), Linguistics in the morning calm (pp. 111137). Seoul, Republic of Korea: Hanshin.Google Scholar
Fricke, E. (2007). Origo, Geste und Raum: Lokaldeixis im Deutschen [Origo, gesture, and space: Spatial deixis in German]. Berlin, Germany: De Gruyter.CrossRefGoogle Scholar
Fricke, E. (2012). Grammatik multimodal: Wie Wörter und Gesten zusammenwirken [Multimodal grammar: How words and gestures interact]. Berlin, Germany: De Gruyter.CrossRefGoogle Scholar
Gaby, A. (2016). Hyponymy and the structure of Kuuk Thaayorre kinship. In J.-C. Verstraete, & D. Hafner, (Eds.), Land and language in Cape York Peninsula and the Gulf Country (pp. 159178). Amsterdam, the Netherlands: John Benjamins. https://benjamins.com/catalog/clu.18.08gabCrossRefGoogle Scholar
GibbsJr, R. W. (2005). Embodiment and cognitive science. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Goldin-Meadow, S. (2003). Hearing gesture: How our hands help us think. Cambridge, MA: Harvard University Press.Google Scholar
Gregersen, T., Olivares-Chuat, G., & Storm, J. (2009). An examination of L1 and L2 gesture use: What role does proficiency play? The Modern Language Journal, 93(2), 195208. https://doi.org/10.1111/j.1540-4781.2009.00856.xCrossRefGoogle Scholar
Gullberg, M. (2014). Gestures and second language acquisition. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 18681874). Berlin, Germany: De Gruyter Mouton.Google Scholar
Haiman, J. (Ed.). (1985). Iconicity in syntax. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Haiman, J. (2008). In defence of iconicity. Cognitive Linguistics, 19(1), 3548. https://doi.org/10.1515/COG.2008.002CrossRefGoogle Scholar
Hassemer, J., & McCleary, L. (2018). The multidimensionality of pointing. Gesture, 17(3), 416461. https://doi.org/10.1075/gest.17018.hasCrossRefGoogle Scholar
Hinnell, J. (2018). The multimodal marking of aspect: The case of five periphrastic auxiliary constructions in North American English. Cognitive Linguistics, 29(4), 773806. https://doi.org/10.1515/cog-2017-0009CrossRefGoogle Scholar
Hinnell, J. (2019). The verbal-kinesic enactment of contrast in North American English. The American Journal of Semiotics, 35(1–2), 5592. https://doi.org/10.5840/ajs20198754CrossRefGoogle Scholar
Hinnell, J. (2020). Language in the body: Multimodality in grammar and discourse (Unpublished doctoral dissertation). University of Alberta, Edmonton, Canada.Google Scholar
Hodge, G., & Ferrara, L. (2022). Iconicity as multimodal, polysemiotic, and plurifunctional. Frontiers in Psychology, 13, Article 808896. https://doi.org/10.3389/fpsyg.2022.808896.CrossRefGoogle ScholarPubMed
Holler, J. & Levinson, S. (2014). The origin of human multi-modal communication. Philosophical Transaction of the Royal Society B, 369(1651), 20130302. https://doi.org/10.1098/rstb.2013.0302Google Scholar
Holler, J., Shovelton, H., & Beattie, G. (2009). Do iconic hand gestures really contribute to the communication of semantic information in a face-to-face context? Journal of Nonverbal Behavior, 33(2), 7388. https://doi.org/10.1007/s10919-008-0063-9CrossRefGoogle Scholar
Hopper, P., & Traugott, E. (2003). Grammaticalization. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gesture as simulated action. Psychonomic Bulletin & Review, 15, 495514. https://doi.org/10.3758/PBR.15.3.495CrossRefGoogle ScholarPubMed
Jakobson, R. (1966). Quest for the essence of language. In Waugh, L. R. & Monville-Burston, M. (Eds.), Roman Jakobson: On language (pp. 407421). Cambridge, MA: Belknap Press.Google Scholar
Jakobson, R., & Pomorska, K. (1983). Dialogues. Cambridge, MA: Harvard University Press.CrossRefGoogle Scholar
Janzen, T., & Shaffer, B. (2002). Gesture as substrate in the process of ASL grammaticalization. In Meier, R. P., Cormier, K., & Quintos-Pozos, D. (Eds.), Modality and structure in signed and spoken language (pp. 199223). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Janzen, T. & Shaffer, B. (Eds.). (2022). Signed language and gesture research in cognitive linguistics. Berlin, Germany: Mouton de Gruyter.Google Scholar
Johnson, M. (1987). The body in the mind: The bodily basis of meaning, imagination, and reason. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
Johnston, T. (1996). Function and medium in the forms of linguistic expression found in a sign language. In Edmondson, W. H. & Wilbur, R. (Eds.), International review of sign linguistics (Vol. 1, pp. 5794). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Kelly, S. D., McDevitt, T., & Esch, M. (2009). Brief training with co-speech gesture lends a hand to word learning in a foreign language. Language and Cognitive Processes, 24(2), 313334. https://doi.org/10.1080/01690960802365567CrossRefGoogle Scholar
Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Kendon, A. (2009). Language’s matrix. Gesture, 9(3), 352372.CrossRefGoogle Scholar
Kendon, A. (2014). Semiotic diversity in utterance production and the concept of “language.Philosophical Transactions of the Royal Society B, 369, 20130293. https://doi.org/10.1098/rstb.2013.0293CrossRefGoogle ScholarPubMed
Kida, T. (2005). Appropriation du geste par les étrangers: Le Cas d’étudiants japonais apprenant le français [The adoption of gestures by foreigners: The case of Japanese students learning French] (Unpublished doctoral dissertation). Université de Provence, Aix-Marseille I, France.Google Scholar
Kita, S. (2000). How representational gestures help speaking. In McNeill, D. (Ed.), Language and gesture (pp. 162185). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Kita, S., Alibali, M. W., & Chu, M. (2017). How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological Review, 124(3), 245266. https://doi.org/10.1037/rev0000059.CrossRefGoogle ScholarPubMed
Kita, S., Danziger, E., & Stolz, C. (2001). Cultural specificity of spatial schemas, as manifested in spontaneous gestures. In Gattis, M. (Ed.), Spatial schemas and abstract thought (pp. 115146). Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Kita, S., & Emmorey, K. (2023). Gesture links language and cognition for spoken and signed languages. Nature Review Psychology, 2, 407–420. https://doi.org/10.1038/s44159-023-00186-90CrossRefGoogle Scholar
Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48, 1632.CrossRefGoogle Scholar
Kopp, S. (2017). Computational gesture research: Studying the functions of gesture in human–agent interaction. In Church, R. B., Alibali, M. W., & Kelly, S. D. (Eds.), Why gesture? How the hands function in speaking, thinking and communicating (pp. 267284). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Ladewig, S. H. (2011). Putting the cyclic gesture on a cognitive basis. CogniTextes, 6, 123. https://doi.org/10.4000/cognitextes.406CrossRefGoogle Scholar
Lakoff, G. & Johnson, M. (1980). Metaphors we live by. Chicago, IL: University of Chicago Press.Google Scholar
Lakoff, G., & Johnson, M. (1999). Philosophy in the flesh: The embodied mind and its challenge to western thought, New York, NY: Basic Books.Google Scholar
Langacker, R. (1993). Reference-point constructions. Cognitive Linguistics, 4(1), 138. https://doi.org/10.1515/cogl.1993.4.1.1CrossRefGoogle Scholar
Lazaraton, A. (2004). Gesture and speech in the vocabulary explanations of one ESL teacher: A microanalytic inquiry. Language Learning, 54(1), 79117. https://doi.org/10.1111/j.1467-9922.2004.00249.xCrossRefGoogle Scholar
Liddell, S. K. (2003). Grammar, gesture and meaning in American Sign Language. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Liebal, K. & Oña, L. (2018). Different approaches to meaning in primate gestural and vocal communication. Frontiers of Psychology, 9, 478. https://doi.org/10.3389/fpsyg.2018.00478CrossRefGoogle ScholarPubMed
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: Chicago University Press.Google Scholar
McNeill, D. (2005). Gesture and thought. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
McNeill, D., Cassell, J., and Levy, E. T. (1993). Abstract deixis. Semiotica, 95(1/2), 520. https://doi.org/10.1515/semi.1993.95.1-2.5CrossRefGoogle Scholar
McNeill, D., & Duncan, S. D. (2000). Growth points in thinking for speaking. In McNeill, D. (Ed.), Language and gesture (pp. 141161). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Macedonia, M., Müller, K., & Friederici, A. D. (2011). The impact of iconic gestures on foreign language word learning and its neural substrate. Human Brain Mapping, 32(6), 982998. https://doi.org/10.1002/hbm.21084CrossRefGoogle ScholarPubMed
Mandel, M. (1977). Iconic devices in American Sign Language. In Friedman, L. (Ed.), On the other hand: New perspectives on American Sign Language (pp. 57107). New York, NY: Academic Press.Google Scholar
Mayberry, R. I. & Nicoladis, E. (2000). Gesture reflects language development: Evidence from bilingual children. Current Directions in Psychological Science, 9(6), 192196. https://doi.org/10.1111/1467-8721.00092CrossRefGoogle Scholar
Merleau-Ponty, M. (1962). Phenomenology of perception. New York, NY: Humanities Press.Google Scholar
Mittelberg, I. (2008). Peircean semiotics meets conceptual metaphor: Iconic modes in gestural representations of grammar. In Cienki, A. & Müller, C. (Eds.), Metaphor and gesture (pp. 115154). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Mittelberg, I. (2013). The exbodied mind: Cognitive-semiotic principles as motivating forces in gesture. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Teßendorf, S. (Eds.), Body - language - communication. An international handbook on multimodality in human interaction (Vol. 1, pp. 755784). Berlin, Germany: De Gruyter Mouton.Google Scholar
Mittelberg, I. (2014). Gestures and iconicity. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 17121732). Berlin, Germany: De Gruyter Mouton.Google Scholar
Mittelberg, I. (2017). Multimodal existential constructions in German: Manual actions of giving as experiential substrate for grammatical and gestural patterns. Linguistics Vanguard, 3(1), 20160047. https://doi.org/10.1515/lingvan-2016-0047CrossRefGoogle Scholar
Mittelberg, I. (2018). Gestures as image schemas and force gestalts: A dynamic systems approach augmented with motion-capture data analysis. Cognitive Semiotics, 11(1), 121. https://doi.org/10.1515/cogsem-2018-0002CrossRefGoogle Scholar
Mittelberg, I. (2019a). Visuo-kinetic signs are inherently metonymic: How embodied metonymy motivates forms, functions, and schematic patterns in gesture. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.00254CrossRefGoogle ScholarPubMed
Mittelberg, I. (2019b). Peirce’s universal categories: On their potential for gesture theory and multimodal analysis. Semiotica, 228, 193212. https://doi.org/10.1515/sem-2018-0090CrossRefGoogle Scholar
Mittelberg, I., & Evola, V. (2014). Iconic and representational gestures. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 17321746). Berlin, Germany: De Gruyter Mouton.Google Scholar
Mittelberg, I. & Hinnell, J. (2022). Gesture studies and semiotics. In Pelkey, J. & Cobley, P. (Eds.), Semiotic movements (pp. 183214). London, UK: Bloomsbury Academic.Google Scholar
Mittelberg, I. & Rekittke, L.-M. (2021). Frames und Diagramme im Dialog: Indexikalische und Ikonische Zeichenmodi im Verbal-Gestischen Konstruieren von Reiserouten [Frames and diagrams in dialogue: Indexical and iconic sign modes in verbo-gestural constructions of travel itineraries]. Zeitschrift für Semiotik [Journal for Semiotics], 43(1–2), 81116.Google Scholar
Mittelberg, I., & Waugh, L. R. (2009). Metonymy first, metaphor second: A cognitive-semiotic approach to multimodal figures of thought in co-speech gesture. In Forceville, C. J. & Urios-Aparisi, E. (Eds.), Multimodal metaphor (pp. 329358). Berlin, Germany: de Gruyter Mouton.CrossRefGoogle Scholar
Mittelberg, I., & Waugh, L.R. (2014). Gestures and metonymy. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 17471766). Berlin, Germany: De Gruyter Mouton.Google Scholar
Müller, C. (1998a). Iconicity and gesture. In Santi, S., Guaïtella, I., Cave, C., & Konopczynski, G. (Eds.), Oralité et gestualité: Communication multimodale et interaction (pp. 321–328). Paris, France: L’Harmattan.Google Scholar
Müller, C. (1998b). Redebegleitende Gesten: Kulturgeschichte – Theorie – Sprachvergleich [Co-speech gesture: Cultural history, theory, linguistic comparison]. Berlin, Germany: Spitz Verlag.Google Scholar
Müller, C. (2004). Forms and uses of the palm up open hand: A case of a gesture family? In Müller, C. & Posner, R. (Eds.), The semantics and pragmatics of everyday gesture (pp. 233256). Berlin, Germany: Weidler Verlag.Google Scholar
Müller, C. (2014). Gestural modes of representation as techniques of depiction. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 16871702). Berlin, Germany: De Gruyter Mouton.Google Scholar
Müller, C. (2017). Waking metaphors: Embodied cognition in multimodal discourse. In Hampe, B. (Ed.), Metaphor: Embodied cognition and discourse (pp. 297316). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Müller, C., Ladewig, S. H., & Bressem, J. (2013). Gestures and speech from a linguistic perspective: A new field and its history. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Teßendorf, S. (Eds.), Body – language – communication. An international handbook on multimodality in human interaction (Vol. 1, pp. 5581). Berlin, Germany: De Gruyter Mouton.Google Scholar
Namy, L. L., Campbell, A. L., & Tomasello, M. (2004). The changing role of iconicity in non-verbal symbol learning: A U-shaped trajectory in the acquisition of arbitrary gestures. Journal of Cognition and Development, 5(1), 3757. https://doi.org/10.1207/s15327647jcd0501_3CrossRefGoogle Scholar
Nicoladis, E. (2002). Some gestures develop in conjunction with spoken language development and others don’t: Evidence from bilingual preschoolers. Journal of Nonverbal Behavior, 26(4), 241266.CrossRefGoogle Scholar
Nicoladis, E. (2007). The effect of bilingualism on the use of manual gestures. Applied Psycholinguistics, 28, 441454. https://doi.org/10.1017.S0142716407070245CrossRefGoogle Scholar
Nicoladis, E., Mayberry, R. I., & Genesee, F. (1999). Gesture and early bilingual development. Developmental Psychology, 35(2), 514526.CrossRefGoogle ScholarPubMed
Nielsen, A. K. & Dingemanse, M. (2021). Iconicity in word learning and beyond: A critical review. Language and Speech, 64(1), 5272. https://doi.org/10.1177/0023830920914339CrossRefGoogle ScholarPubMed
Özyürek, A. (2018a). Cross-linguistic variation in children’s multimodal utterances. In Hickmann, M., Veneziano, E., & Jisa, H. (Eds.), Sources of variation in first language acquisition: Languages, contexts, and learners (pp. 123138). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Özyürek, A. (2018b). Role of gesture in language processing: Toward a unified account for production and comprehension. In Rueschemeyer, S.-A. & Gaskell, M. G. (Eds.), Oxford handbook of psycholinguistics (2nd ed., pp. 592607). Oxford, UK: Oxford University Press.Google Scholar
Özyürek, A., Kita, S., Allen, S., Furman, R., & Brown, A. (2005). How does linguistic framing of events influence co-speech gestures? Insights from crosslinguistic variations and similarities. Gesture, 5(1/2), 219240. https://doi.org/10.1075/gest.5.1.15ozyCrossRefGoogle Scholar
Parrill, F. (2009). Dual viewpoint gestures. Gesture, 9(3), 271289. https://doi.org/10.1075/gest.9.3.01parCrossRefGoogle Scholar
Peirce, C. S. (1931–58). The collected papers of Charles Sanders Peirce, vols. 1–6, Hartshorne, C. & Weiss, P. (Eds.), vols. 7–8, Burks, A. (Ed.). Cambridge, MA: Harvard University Press. Cited as CP. (Original work published 1866–1913)Google Scholar
Peirce, C. S. (1955). Logic as semiotic: The theory of signs (1893–1920). In Bucher, J. (Ed.), Philosophical writings of Peirce. New York, NY: Dover.Google Scholar
Perlman, M., Clark, N., & Tanner, J. E. (2014). Iconicity and ape gesture. Proceedings of the 10th International Conference: The evolution of language (pp. 228235). Singapore: World Scientific.Google Scholar
Perniss, P., Özyürek, A., & Morgan, G. (2015). The influence of the visual modality on language structure and conventionalization: Insights from sign language and gesture. Topics in Cognitive Science, 7, 211. https://doi.org/10.1111/tops.12127CrossRefGoogle ScholarPubMed
Perniss, P., Thompson, R., & Vigliocco, G. (2010). Iconicity as a general property of language: Evidence from spoken and signed languages. Frontiers in Psychology, 1, Article 115. https://doi.org/10.3389/fpsyg.2010.00227CrossRefGoogle ScholarPubMed
Perniss, P., & Vigliocco, G. (2014). The bridge of iconicity: From a world of experience to the experience of language. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), Article 20130300. https://doi.org/10.1098/rstb.2013.0300CrossRefGoogle Scholar
Rohlfing, K. J. (2019). Learning language from the use of gestures. In Horst, J., & J. von Torkildsen, Koss (Eds.), International handbook of language acquisition (pp. 213233). London, UK: Routledge.CrossRefGoogle Scholar
Sandler, W., Gullberg, M., & Padden, C. (Eds.). (2019). Visual language. Frontiers in Psychology, 10, 1765. https://doi.org/10.3389/fpsyg.2019.01765CrossRefGoogle ScholarPubMed
Saussure, F. de (1986). Course in general linguistics (W. Baskin, Trans.). New York, NY: McGraw Hill. (Original work published 1916)Google Scholar
Slobin, D. I. (1991). Learning to think for speaking: Native language, cognition, and rhetorical style. Pragmatics, 1(1), 725. https://doi.org/10.1075/prag.1.1.01sloGoogle Scholar
Slobin, D. I. (1996). From “thought and language” to “thinking for speaking.” In Gumperz, J. & Levinson, S. (Eds.), Rethinking linguistic relativity (pp. 7096). Cambridge, UK: Cambridge University Press.Google Scholar
Sonesson, G. (2014). Some issues in the semiotics of gesture: The perspective of comparative semiotics. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (Vol., 2, pp. 19891999). Berlin, Germany: De Gruyter Mouton.Google Scholar
Stam, G. A. (2006). Changes in patterns of thinking with second language acquisition (Unpublished doctoral dissertation). University of Chicago, Chicago, IL.Google Scholar
Stam, G. (2015). Changes in thinking for speaking: A longitudinal case study. The Modern Language Journal, 99, 8399. www.jstor.org/stable/43650100CrossRefGoogle Scholar
Stec, K. (2012) Meaningful shifts: A review of viewpoint markers in co-speech gesture and sign language. Gesture, 12(3), 327360. https://doi.org/10.1075/gest.12.3.03steCrossRefGoogle Scholar
Stefanini, S., Bello, A., Caselli, M. C., Iverson, J. M., & Volterra, V. (2009). Co-speech gestures in a naming task: Developmental data. Language and Cognitive Processes, 24(2), 168189. https://doi.org/10.1080/01690960802187755CrossRefGoogle Scholar
Streeck, J. (2009). Gesturecraft: The manu-facture of meaning. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Sueyoshi, A. & Hardison, D. M. (2005). The role of gestures and facial cues in second language listening comprehension. Language Learning, 55(4), 661699. https://doi.org/10.1111/j.0023-8333.2005.00320.xCrossRefGoogle Scholar
Sweetser, E. E. (2009). What does it mean to compare language and gesture? Modalities and contrasts. In Guo, J., Liven, E., Budwig, N., Ervin-Tripp, S., Nakamura, K., & Özcaliskan, S. (Eds.), Crosslinguistic approaches to the psychology of language: Research in the tradition of Dan Isaac Slobin (pp. 357366). New York, NY: Psychology Press.Google Scholar
Sweetser, E. E. (2023). Gestural meaning is in the body(-space) as much as in the hands. In Janzen, T. & Shaffer, B. (Eds.), Signed language and gesture research in cognitive linguistics (pp. 157–180). Berlin, Germany: Mouton de Gruyter.Google Scholar
Taub, S. F. (2000). Iconicity in American sign language: Concrete and metaphorical applications. Spatial Cognition and Computation, 2, 3150. https://doi.org/10.1023/A:1011440231221CrossRefGoogle Scholar
Taub, S. (2001). Language from the body: Iconicity and metaphor in American Sign Language, Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Waugh, L. R. (1992). Presidential address: Let’s take the con out of iconicity: Constraints on iconicity in the lexicon. American Journal of Semiotics, 9(1), 748. https://doi.org/10.5840/ajs19929132CrossRefGoogle Scholar
Wehling, E. (2017). Discourse management gestures. Gesture, 16(2), 245276. https://doi.org/10.1075/gest.16.2.04wehCrossRefGoogle Scholar
Wilcox, S. (2004). Cognitive iconicity: Conceptual spaces, meaning, and gesture in signed languages. Cognitive Linguistics, 15(2), 119148. https://doi.org/10.1515/cogl.2004.005CrossRefGoogle Scholar
Wilcox, S. & Occhino, C. (2017). Signed languages. In Dancygier, B. (Ed.), Cambridge handbook of cognitive linguistics (pp. 99117). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Wundt, W. (1973). A psychology of gesture (J. S. Thayer, C. M. Greenleaf, & M. D. Silberman, Trans.). The Hague, the Netherlands: Mouton.Google Scholar
Zlatev, J. (2014). Image schemas, mimetic schemas, and children’s gestures. Cognitive Semiotics, 7(1), 329. https://doi.org/10.1515/cogsem-2014-0002CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×