Skip to main content
×
Home
    • Aa
    • Aa

Using semantic feature norms to investigate how the visual and verbal modes afford metaphor construction and expression*

  • MARIANNA BOLOGNESI (a1)
abstract
<span class='sc'>abstract</span>

In this study, two modalities of expression (verbal and visual) are compared and contrasted, in relation to their ability and their limitations to construct and express metaphors. A representative set of visual metaphors and a representative set of linguistic metaphors are here compared, and the semantic similarity between metaphor terms is modeled within the two sets. Such similarity is operationalized in terms of semantic features produced by informants in a property generation task (e.g., McRae et al., 2005). Semantic features provide insights into conceptual content, and play a role in deep conceptual processing, as opposed to shallow linguistic processing. Thus, semantic features appear to be useful for modeling metaphor comprehension, assuming that metaphors are matters of thought rather than simple figures of speech (Lakoff & Johnson, 1980). The question tackled in this paper is whether semantic features can account for the similarity between metaphor terms of both visual and verbal metaphors. For this purpose, a database of semantic features was collected and then used to analyze fifty visual metaphors and fifty verbal metaphors. It was found that the number of semantic features shared between metaphor terms is predicted by the modality of expression of the metaphor: the terms compared in visual metaphors share semantic features, while the terms compared in verbal metaphors do not. This suggests that the two modalities of expression afford different ways to construct and express metaphors.

Copyright
References
Hide All
BarsalouL. W., SantosA., SimmonsW. K., & WilsonC. D. (2008). Language and simulation in conceptual processing. In De VegaM., GlenbergA. M., & GraesserA. C. A. (Eds.), Symbols, embodiment, and meaning (pp. 245283). Oxford: Oxford University Press.
BinderJ. R., DesaiR. H., GravesW. W., & ConantL. L. (2009). Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cerebral Cortex, 19(12), 27672796.
BlackM. (1979). More about metaphor. In OrtonyA. (Ed.), Metaphor and thought (pp. 1943). Cambridge: Cambridge University Press.
BoroditskyL., & PrinzJ. (2008). What thoughts are made of. In SeminG. & SmithE. (Eds.), Embodied grounding: social, cognitive, affective, and neuroscientific approaches (pp. 98115). New York: Cambridge University Press.
BounegruL., & ForcevilleC. (2011). Metaphors in editorial cartoons representing the global financial crisis. Visual Communication, 10(2), 209229.
BrightP., MossH., & TylerL. (2004). Unitary vs. multiple semantics: PET studies of word and picture processing. Brain and Language, 89, 417432.
BrysbaertM., WarrinerA., & KupermanV. (2014). Concreteness ratings for 40 thousand generally known English word lemmas. Behavior Research Methods, 46, 904911.
CheeM., WeekesB., LeeK., SoonC., SchreiberA., HoonI., & CheeM. (2000). Overlap and dissociation of semantic processing of Chinese characters, English words, and pictures. Neuroimage, 12, 392403.
CreeG. S., McNorganC., & McRaeK. (2006). Distinctive features hold a privileged status in the computation of word meaning: implications for theories of semantic memory. Journal of Experimental Psychology: Learning, Memory, & Cognition, 32, 643658.
CreeG., & McRaeK. (2003). Analyzing the factors underlying the structure and computation of the meaning of chipmunk, cherry, chisel, cheese, and cello and many other such concrete nouns. Journal of Experimental Psychology, 132, 163201.
CreeG. S., McRaeK., & McNorganC. (1999). An attractor model of lexical conceptual processing: simulating semantic priming. Cognitive Science, 23, 371414.
DavidoffJ., & De BleserR. (1994). Impaired picture recognition with preserved object naming and reading. Brain and Cognition, 24, 123.
FarahM. (1990). Visual agnosia: disorders of object recognition and what they tell us about normal vision. Cambridge, MA: MIT Press.
ForcevilleC. (1996). Pictorial metaphors in advertising. London: Routledge.
ForcevilleC. (2011). The JOURNEY metaphor and the Source–Path–Goal schema in Agnès Varda’s autobiographical gleaning documentaries. In FludernikMonika (Ed.), Beyond Cognitive Metaphor Theory: perspectives on literary metaphor (pp. 281297). London: Routledge.
ForcevilleC. (2016a). Pictorial and multimodal metaphor. In KlugN. & StöcklH. (Eds.), Handbuch Sprache im multimodalen Kontext [The Language in Multimodal Contexts Handbook] (Linguistic Knowledge Series). Berlin: Mouton de Gruyter.
ForcevilleC. (2016b). Visual and multimodal metaphor in film: charting the field. In FahlenbrachK. (Ed.), Embodied metaphors in film, television and video games: cognitive approaches (pp. 1732). London: Routledge.
GatesL., & YoonM. (2005). Distinct and shared cortical regions of the human brain activated by pictorial depictions versus verbal descriptions: an fMRI study. Neuroimage, 24, 473486.
GentnerD. (1989). The mechanisms of analogical learning. In VosniadouS. & OrtonyA. (Eds.), Similarity and analogical reasoning (pp. 199241). New York: Cambridge University Press.
GibbsR. J. (2006). Embodiment and cognitive science. Cambridge: Cambridge University Press.
GoodallC., SlaterM., & MyersT. (2013). Fear and anger responses to local news coverage of alcohol-related crimes, accidents, and injuries: explaining news effects on policy support using a representative sample of messages and people. Journal of Communication, 63, 373392.
Gorno-TempiniM., PriceC., JosephsO., VandenbergheR., CappaS., KapurN., & FrackowiakR. (1998). The neural systems sustaining face and proper-name processing. Brain, 121, 21032118.
GrondinR., LupkerS. J., & McRaeK. (2009). Shared features dominate semantic richness effects for concrete concepts. Journal of Memory & Language, 60,119.
HassonU., LevyI., BehrmannM., HendlerT., & MalachR. (2002). Eccentricity bias as an organizing principle for human high-order object areas. Neuron, 34, 490497.
HidalgoL., & KraljevicB. (2011). Multimodal metonymy and metaphor as complex discourse resources for creativity in ICT advertising discourse. In Gonzálvez GarcíaF., PeñaS., & Pérez-HernándezL. (Eds.), Metaphor and metonymy revisited beyond the contemporary theory of metaphor (pp. 153178). Amsterdam/Philadelphia: John Benjamins.
JohnsonM. (1987). The body in the mind: the bodily basis of meaning, imagination, and reason. Chicago: University of Chicago Press.
LakoffG. (1987). Women, fire, and dangerous things. Chicago: University of Chicago Press.
LakoffG., & JohnsonM. (1980). Metaphors we live by. Chicago: University of Chicago Press.
LouwerseM., & HutchinsonS. (2012). Neurological evidence linguistic processes precede perceptual simulation in conceptual processing. Frontiers in Psychology, 3, 385.
McRaeK., & BoisvertS. (1998). Automatic semantic similarity priming. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 558572.
McRaeK., CreeG. S., SeidenbergM. S., & McNorganC. (2005). Semantic feature production norms for a large set of living and nonliving things. Behavior Research Methods, 37, 547559.
McRaeK., CreeG. S., WestmacottR., & de SaV. R. (1999). Further evidence for feature correlations in semantic memory. Canadian Journal of Experimental Psychology: Special Issue on Models of Word Recognition, 53, 360373.
MooreC., & PriceC. (1999). Three distinct posterior basal temporal lobe regions for reading and object naming. Neuroimage, 10, 181192.
OrtizM. J. (2011). Primary metaphors and monomodal visual metaphors. Journal of Pragmatics, 43, 15681580.
PaivioA. (1971). Imagery and verbal processes. New York: Holt, Rinehart, and Winston.
PaivioA. (1986). Mental representations: a dual coding approach. New York: Oxford University Press.
PaivioA. (2010). Dual coding theory and the mental lexicon. The Mental Lexicon, 5, 205230.
Pérez HernándezL. (2014). Cognitive grounding for cross-cultural commercial communication. Cognitive Linguistics, 25(2), 203247.
PexmanP., HolykG., & MonfilsM. (2003). Number of features effects and semantic processing. Memory & Cognition, 31, 842855.
PexmanP. M., LupkerS. J., & HinoY. (2002). The impact of feedback semantics in visual word recognition: number of features effects in lexical decision and naming tasks. Psychonomic Bulletin & Review, 9, 542549.
PhillipsB., & McQuarrieE. (2004). Beyond visual metaphor: a new typology of visual rhetoric in advertising. Marketing Theory, 4, 113136.
RandallB., MossH., RoddJ., GreerM., & TylerL. (2004). Distinctiveness and correlation in conceptual structure: behavioral and computational studies. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 393406.
RecchiaG., & JonesM. (2011). The semantic richness of abstract concepts. Frontiers in Human Neuroscience, 6, Article 315.
ReinholzJ., & PollmannS. (2005). Differential activation of object-selective visual areas by passive viewing of pictures and words. Cognitive Brain Research, 24, 702714.
SheltonJ. R., & CaramazzaA. (1999). Deficits in lexical and semantic processing: implications for models of normal language. Psychonomic Bulletin & Review, 6, 527.
SimmonsW., HamannS., HarenskiC., HuX., & BarsalouL. (2008). fMRI evidence for word association and situated simulation in conceptual processing. Journal of Physiology Paris, 102, 106119.
SteenG. (2008) The paradox of metaphor: why we need a three-dimensional model of metaphor. Metaphor and Symbol, 23(4), 213241.
SteenG., DorstL., HerrmannB., KaalA., KrennmayrT., & PasmaT. (2010). A method for linguistic metaphor identification: from MIP to MIPVU. Amsterdam: John Benjamins.
TverskyA. (1977). Features of similarity. Psychological Review, 84, 327352.
VinsonD., & ViglioccoG. (2008). Semantic feature production norms for a large set of objects and events. Behavior Research Methods, 40, 183190.
WarringtonE. (1985). Agnosia: the impairment of object recognition. In FrederiksJ. (Ed.), Handbook of clinical neurology (pp. 333349). New York: Elsevier.
WuL., & BarsalouL. (2009). Perceptual simulation in conceptual combination: evidence from property generation. Acta Psychologica, 132, 173189.
YuN. (2008). Multimodal manifestation of conceptual metaphors in multimedia communication. Intercultural Communication Studies, 17(1), 7989.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Language and Cognition
  • ISSN: 1866-9808
  • EISSN: 1866-9859
  • URL: /core/journals/language-and-cognition
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 6
Total number of PDF views: 53 *
Loading metrics...

Abstract views

Total abstract views: 362 *
Loading metrics...

* Views captured on Cambridge Core between 18th October 2016 - 22nd October 2017. This data will be updated every 24 hours.