Skip to main content Accessibility help

The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression

  • Paula M. Niedenthal (a1), Martial Mermillod (a2), Marcus Maringer (a3) and Ursula Hess (a4)


Recent application of theories of embodied or grounded cognition to the recognition and interpretation of facial expression of emotion has led to an explosion of research in psychology and the neurosciences. However, despite the accelerating number of reported findings, it remains unclear how the many component processes of emotion and their neural mechanisms actually support embodied simulation. Equally unclear is what triggers the use of embodied simulation versus perceptual or conceptual strategies in determining meaning. The present article integrates behavioral research from social psychology with recent research in neurosciences in order to provide coherence to the extant and future research on this topic. The roles of several of the brain's reward systems, and the amygdala, somatosensory cortices, and motor centers are examined. These are then linked to behavioral and brain research on facial mimicry and eye gaze. Articulation of the mediators and moderators of facial mimicry and gaze are particularly useful in guiding interpretation of relevant findings from neurosciences. Finally, a model of the processing of the smile, the most complex of the facial expressions, is presented as a means to illustrate how to advance the application of theories of embodied cognition in the study of facial expression of emotion.



Hide All
Abe, J. A., Beetham, M. & Izard, C. (2002) What do smiles mean? An analysis in terms of differential emotions theory. In: An empirical reflection on the smile, ed. Abel, M. H., pp. 83110. Edwin Mellen Press.
Abel, M. H. (2002) The elusive nature of smiling. In: An empirical reflection on the smile, ed. Abel, M. H., pp. 113. Edwin Mellen Press.
Achaibou, A., Pourtois, G., Schwartz, S. & Vuilleumier, P. (2008) Simultaneous recording of EEG and facial muscle reactions during spontaneous emotional mimicry. Neuropsychologia 46:1104–13.
Adams, R. B. Jr., Gordon, H. L., Baird, A. A., Ambady, N. & Kleck, R. E. (2003) Effects of gaze on amygdala sensitivity to anger and fear faces. Science 300(5625):1536.
Adolphs, R. (2002) Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews 1:2162.
Adolphs, R. (2003) Cognitive neuroscience of human behavior. National Review of Neuroscience 4:165–78.
Adolphs, R. (2006) Perception and emotion. Current Directions in Cognitive Science 15:222–26.
Adolphs, R. (2008) Fear, faces, and the human amygdala. Current Opinion in Neurobiololgy 18(2):166–72.
Adolphs, R., Damasio, H., Tranel, D., Cooper, G. & Damasio, A. R. (2000) A role for somatosensory cortices in the visual recognition of emotion as revealed by 3-D lesion mapping. Journal of Neuroscience 20:2683–90.
Adolphs, R., Damasio, H., Tranel, D. & Damasio, A. R. (1996) Cortical systems for the recognition of emotion in facial expressions. Journal of Neuroscience 16:7678–87.
Adolphs, R., Gosselin, F., Buchanan, T. W., Tranel, D., Schyns, P. & Damasio, A. R. (2005) A mechanism for impaired fear recognition after amygdala damage. Nature 433(7021):6872.
Adolphs, R., Gosselin, F., Buchanan, T., Tranel, D., Schyns, P. & Damasio, A. (2005) A mechanism for impaired fear recognition after amygdala damage. Nature 433:6872.
Adolphs, R., Tranel, D., Damasio, H. & Damasio, A. R. (1994) Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala. Nature 372(6507):669–72.
Anderson, J. R., Qin, Y., Sohn, M.-H., Stenger, V. A. & Carter, C. S. (2003) An information-processing model of the BOLD response in symbol manipulation tasks. Psychonomic Bulletin and Review 10:241–61.
Argyle, M. (1972) The psychology of interpersonal behavior. Penguin Books.
Atkinson, A. (2007) Face processing and empathy. Empathy in mental illness, pp. 360–85. Cambridge University Press.
Barrett, K. C. (2002) Smiling in children: Displays and their meanings. In: An empirical reflection on the smile, ed. Abel, M. H., pp. 137–54. Edwin Mellen Press.
Barsalou, L. W. (1999) Perceptual symbol systems. Behavioral and Brain Sciences 22(4):577660.
Barsalou, L. W. (2005) Situated conceptualization. In: Handbook of categorization in cognitive science, ed. Cohen, H. & Lefebvre, C., pp. 619–50. Elsevier.
Barsalou, L. W. (2008) Grounded cognition. Annual Review of Psychology 59:617–45.
Barsalou, L. W., Niedenthal, P. M., Barbey, A. & Ruppert, J. (2003) Social embodiment. In: The psychology of learning and motivation, vol. 43, ed. Ross, B., pp. 4392. Academic Press.
Barsalou, L. W., Santos, A., Simmons, W. K. & Wilson, C. D. (2008) Language and simulation in conceptual processing. In: Symbols, embodiment, and meaning, ed. De Vega, M., Glenberg, A. M. & Graesser, A. C., pp. 245–83. Oxford University Press.
Bastiaansen, J. A. C. J., Thiox, M. & Keyers, C. (2009) Evidence for mirror systems in emotions. Philosophical Transactions of the Royal Society 364:2391–404.
Bavelas, J., Black, A., Lemery, C. R. & Mullett, J. (1986) “I show how you feel”: Motor mimicry as a communicative act. Journal of Personality and Social Psychology 50:322–29.
Bernstein, M. J., Young, S. G., Brown, C. M., Sacco, D. F. & Claypool, H. M. (2008) Adaptive responses to social exclusion: Social rejection improves detection of real and fake smiles. Psychological Science 19(10):981–83.
Blairy, S., Herrera, P. & Hess, U. (1999) Mimicry and the judgment of emotional facial expressions. Journal of Nonverbal Behavior 23(1):541.
Blass, E. M. & Camp, C. A. (2001) The ontogeny of face recognition: Eye contact and sweet taste induce face preference in 9- and 12-week-old human infants. Developmental Psychology 37:762–74.
Boksem, M. A. S., Smolders, R. & de Cremer, D. (2009) Social power and approach-related neural activation. Social Cognitive and Affective Neuroscience Advance Access. Published online on March 20, 2009.
Boraston, Z., Corden, B., Miles, L., Skuse, D. & Blakemore, S. (2008) Brief report: Perception of genuine and posed smiles by individuals with autism. Journal of Autism and Developmental Disorders 38:574–80.
Bourgeois, P. & Hess, U. (2008) The impact of social context on mimicry. Biological Psychology 77:343–52.
Bower, G. (1981) Mood and memory. American Psychologist 36:129–48.
Bowers, D., Bauer, R. M., Coslett, H. B. & Heilman, K. M. (1985) Processing of faces by patients with unilateral hemisphere lesions: Dissociation between judgments of facial affect and facial identity. Brain and Cognition 4:258–72.
Breiter, H. C., Etcoff, N. L., Whalen, P. J., Kennedy, W. A., Rauch, S. L., Buckner, R. L., Strauss, M. M., Hyman, S. E. & Rosen, B. R. (1996) Response and habituation of the human amygdala during visual processing of facial expression. Neuron 17:875–87.
Buck, R. (1984) The communication of emotion. Guilford Press.
Buck, R. (1991) Social factors in facial display and communication: A reply to Chovil and others. Journal of Nonverbal Behavior 15:155–62.
Burgoon, J. K., Buller, D. B. & Woodall, W. G. (1996) Nonverbal communication: The unspoken dialog, vol. 2, pp. 259–92. McGraw-Hill.
Cacioppo, J., Petty, R., Losch, M. & Kim, H. (1986) Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. Journal of Personality and Social Psychology 50:260–68.
Calder, A. J., Keane, J., Cole, J., Campbell, R. & Young, A. W. (2000a) Facial expression recognition by people with Mobius syndrome. Cognitive Neuropsychology 17:7387.
Calder, A. J., Keane, J., Lawrence, A. D. & Manes, F. (2004) Impaired recogniton of anger following damage to the ventral striatum. Brain 127:1958–69.
Calder, A. J., Keane, J., Manes, F., Antoun, N. & Young, A. W. (2000b) Impaired recogniton and experience of disgust following brain injury. Nature Neuroscience 3:1077–78.
Calder, A. J., Lawrence, A. D. & Young, A. W. (2001) Neuropsychology of fear and loathing. Nature Reviews Neuroscience 2(5):352–63.
Calder, A .J. & Young, A. W. (2005) Understanding the recognition of facial identity and facial expression. Nature Review Neuroscience 6:641–51.
Calder, A. J., Young, A. W., Rowland, D., Perrett, D. I., Hodges, J. R. & Etcoff, N. L. (1996) Face perception after bilateral amygdala damage: Differentially severe impairment of fear. Cognitive Neuropsychology 13:699745.
Carr, L., Iacoboni, M., Dubeau, M. C., Mazziotta, J. C. & Lenzi, G. L. (2003) Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas. Proceedings of the National Academy of Sciences USA 100:5497–502.
Cashdan, E. (2004) Smiles, speech, and body posture: How women and men display sociometric status and power. Journal of Nonverbal Behavior 22:209–28.
Chakrabarti, B., Kent, L., Suckling, J., Bullmore, E. T. & Baron-Cohen, S. (2006) Variations in human cannabinoid receptor (CNR1) gene modulate striatal response to happy faces. European Journal of Neuroscience 23:1944–48.
Clore, G. L. & Storbeck, J. (2006) Affect as information about liking, efficacy, and importance. In: Hearts and minds: Affective influences on social cognition and behaviour, ed. Forgas, J., pp. 123–42. Psychology Press.
Coussi-Korbel, S. (1994) Learning to outwit a competitor in mangabeys (Cercocebus torquatus torquatus). Journal of Comparative Psychology 108:164–71.
Dalton, K. M., Nacewicz, B. M., Johnstone, T., Schaefer, H. S., Gernsbacher, M. A., Goldsmith, H. H., Alexander, A. & Davidson, R. J. (2005) Gaze fixation and the neural circuitry of face processing in autism. Nature Neuroscience 8:519–26.
Damasio, A. R., Grabowski, T. J., Bechara, A., Damasio, H., Ponto, L. L. B., Parvizi, J. & Hichwa, R. D. (2000) Subcortical and cortical brain activity during the feeling of self-generated emotions. Nature Neuroscience 3:1049–56.
Darwin, C. (1872/1998) The expression of the emotions in man and animals. Oxford University Press.
Davidson, R. J. (1993) The neuropsychology of emotion and affective style. In: Handbook of emotion, ed. Lewis, M. & Haviland, J. M., pp. 143–54. Guilford Press.
Davidson, R. J., Ekman, P., Saron, C., Senulis, J. & Friesen, W. (1990) Approach-withdrawal and cerebral asymmetry: Emotional expression and brain physiology I. Journal of Personality and Social Psychology 58:330–41.
Davidson, R. J. & Irwin, W. (1999) The functional neuroanatomy of emotion and affective style. Trends in Cognitive Science 3:1121.
Decety, J. & Chaminade, T. (2003) Neural correlates of feeling sympathy. Neuropsychologia 41:127–38.
Decety, J. & Chaminade, T. (2004) The neurophysiology of imitation and intersubjectivity. In: ed. Hurley, S. & Chater, N.. Perspectives on imitation: From neuroscience to social science, pp. 119–40. MIT Press.
Decety, J. & Grèzes, J. (1999) Neural mechanisms subserving the perception of human actions. Trends in Cognitive Science 3:172–78.
Decety, J. & Grèzes, J. (2006) The power of simulation: Imagining one's own and other's behavior. [Special Issue]. Social Cognitive Neuroscience of Cognitive Brain Research 1079:414.
Dimberg, U. & Thunberg, M. (1998) Rapid facial reactions to emotional facial expressions. Scandinavian Journal of Psychology 39(1):3945.
Dinstein, I., Gardner, J. L., Jazayeri, M. & Heeger, D. J. (2008) Executed and observed movements have different distributed representations in human aIPS. The Journal of Neuroscience 28:11231–39.
Donovan, W. & Leavitt, L. (1980) Physiologic correlates of direct and averted gaze. Biological Psychology 10:189–99.
Duchenne de Boulogne, C.-B. (1862) The mechanism of human facial expression. Jules Renard.
École Nationale Supériure des Beaux-Arts (1999) Duchenne de Boulogne 1806–1875. Beaux-Arts de Paris.
Eibl-Eibesfeldt, I. (1972) Similarities and differences between cultures in expressive movements. Non-verbal communication. Cambridge University Press.
Ekman, P. (1989) The argument and evidence about universals in facial expressions of emotion. In: Handbook of psychophysiology: The biological psychology of the emotions and social processes, ed. Wagner, H. & Manstead, A., pp. 143–64. John Wiley.
Ekman, P. (1994) Strong evidence for universals in facial expressions: A reply to Russell's mistaken critique. Psychological Bulletin 115:268–87.
Ekman, P. (2001) Telling lies: Clues to deceit in the marketplace, politics, and marriage. W.W. Norton.
Ekman, P., Davidson, R. & Friesen, W. V. (1990) The Duchenne smile: Emotional expression and brain physiology, II. Journal of Personality and Social Psychology 58:342–53.
Ekman, P. & Friesen, W. V. (1978) Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press.
Ekman, P. & Friesen, W. V. (1982) Felt, false and miserable smiles. Journal of Nonverbal Behavior 6:238–52.
Ekman, P., Friesen, W. V. & Ancoli, S. (1980) Facial signs of emotional experience. Journal of Personality and Social Psychology 39:1125–34.
Ekman, P. & Heider, K. G. (1988) The universality of a contempt expression: A replication. Motivation and Emotion 12:303308.
Elliott, R., Friston, K. J. & Dolan, R. J. (2000) Dissociable neural responses in human reward systems. Journal of Neuroscience 20:6159–65.
Fadiga, L., Fogassi, L., Pavesi, G. & Rizzolatti, G. (1995) Motor facilitation during action observation: A magnetic stimulation study. Journal of Neurophysiology 73:2608–11.
Farroni, T., Csibra, G., Simion, F. & Johnson, M. H. (2002) Eye contact detection in humans from birth. Proceedings of the National Academy of Sciences USA 99(14):9602–605.
Farroni, T., Massaccesi, S., Pividori, D. & Johnson, M. (2004) Gaze following in newborns. Infancy 5(1):3960.
Feldman-Barrett, L. & Niedenthal, P. M. (2004) Valence focus and perceptions of facial affect. Emotion 4:266–74.
Fischer, A. & Roseman, I. J. (2007) Beat them or ban them: Characteristics and social functions of anger and contempt. Journal of Personality and Social Psychology 93:103–15.
Fitzgerald, D. A., Angstadt, M., Jelsone, L. M., Nathan, P. J. & Phan, K. L. (2006) Beyond threat: Amygdala reactivity across multiple expressions of facial affect. Neuroimage 30:1441–48.
Fodor, J. A. (1975) The language of thought. Crowel.
Fogel, A., Nelson-Goens, G., Hsu, H. & Shapiro, A. (2000) Do different infant smiles reflect different positive emotions? Social Development 9:497520.
Fraley, R. C., Niedenthal, P. M., Marks, M. J., Brumbaugh, C. C. & Vicary, A. (2006) Adult attachment and the perception of facial expressions of emotion: Probing the hyperactivating strategies underlying anxious attachment. Journal of Personality 74:1163–90.
Frank, M. G. (2002) Smiles, lies, and emotion. In: An empirical reflection on the smile, ed. Abel, M. H., pp. 1544. Edwin Mellen Press.
Frank, M. G., Ekman, P. & Friesen, W. V. (1993) Behavioral markers and recognizability of the smile of enjoyment. Journal of Personality and Social Psychology 64:8393.
Frank, M., Ekman, P. & Friesen, W. (1997) Behavioral markers and recognizability of the smile of enjoyment. What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS), pp. 217–42. Oxford University Press.
Frank, M. & Stennett, J. (2001) The forced-choice paradigm and the perception of facial expression of emotion. Journal of Personality and Social Psychology 80:7585.
Fridlund, A. (1991) The sociality of solitary smiling: Potentiation by an implicit audience. Journal of Personality and Social Psychology 60:229–40.
Fridlund, A. J. (2002) The behavioral ecology view of smiling and other facial expressions. In: An empirical reflection on the smile, ed. Abel, M. H.. Edwin Mellen Press.
Fusar-Poli, P., Placentin, A., Carletti, F., Landi, P., Alle, P., Surguladze, S., Benedetti, F., Abbamont, M., Gasparott, R., Baral, F., Perez, J., McGuire, P. & Politi, P. (2009) Functional atlas of emotional faces processing: A voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. Journal of Psychiatry and Neuroscience 34(6):418–32.
Gallese, V. (2003) The roots of empathy: The shared manifold hypothesis and the neural basis of intersubjectivity. Psychopathology 36:171–80.
Gallese, V. (2005) 'Being like me': Self-other identity, mirror neurons, and empathy. Perspectives on imitation: From neuroscience to social science, vol. 1. Mechanisms of imitation and imitation in animals, pp. 101118. MIT Press.
Gallese, V. (2007) Embodied simulation: From mirror neuron systems to interpersonal relations. Novartis Foundation Symposium 2278:312.
Gallese, V., Fadiga, L., Fogassi, L. & Rizzolatti, G. (1996) Action recognition in the premotor cortex. Brain 119:593609.
Gallese, V. & Goldman, A. (1999) Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Science 2:493500.
Gallese, V. & Lakoff, G. (2005) The brain's concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology 22:455–79.
Goldman, A. I. & Sripada, C. S. (2005) Simulationist models of face-based emotion recognition. Cognition 94(3):193213.
Haidt, J. & Keltner, D. (1999) Culture and facial expression: Open-ended methods find more expressions and a gradient of recognition. Cognition and Emotion 13:225–66.
Hains, S. M. J. & Muir, D. W. (1996) Infant sensitivity to adult eye direction. Child Development 67:1940–51.
Haith, M. M. (1972) The forgotten message of the infant smile. Merrill-Palmer Quarterly 18:321.
Halberstadt, J. & Niedenthal, P. M. (2001) Effects of emotion concepts on perceptual memory for emotional expressions. Journal of Personality and Social Psychology 81:587–98.
Halberstadt, J., Winkielman, P., Niedenthal, P. & Dalle, N. (2009) Emotional conception: How embodied emotion concepts guide perception and facial action. Psychological Science 20:1254–61.
Hamann, S. B., Stefanacci, L., Squire, L. R., Adolphs, R., Tranel, D., Damasio, H. & Damasio, A. (1996) Recognizing facial emotion. Nature 379:497.
Hatfield, E., Cacioppo, J. T. & Rapson, R. L. (1992) Primitive emotional contagion. In: Review of personality and social psychology: Emotion and social behavior, vol. 14, ed. Clark, M. S., pp. 151–77. Sage.
Hatfield, E., Cacioppo, J. T. & Rapson, R. L. (1993) Emotional contagion. Current Directions in Psychological Science 2:9699.
Heberlein, A. S. & Atkinson, A. (2009) Neuroscientific evidence for simulation and shared substrates in emotion recognition: Beyond faces. Emotion Review 1:162–77.
Hecht, M. A. & LaFrance, M. (1998) License or obligation to smile: The effect of power and sex on amount and type of smiling. Personality and Social Psychology Bulletin 24(12):1332–42.
Hennenlotter, A., Dresel, C., Castrop, F., Ceballos-Baumann, A. O., Wohlschläger, A. M. & Haslinger, B. (2009) The link between facial feedback and neural activity within central circuitries of emotion: New insights from Botulinum Toxin-induced denervation of frown muscles. Cerebral Cortex 19:537–42.
Hennenlotter, A., Schroeder, U., Erhard, P., Catrop, F., Haslinger, B., Stoecker, D., Lange, K. W. & Ceballos-Baumann, A. O. (2005) A common neural basis for receptive and expressive communication of pleasant facial affect. NeuroImage 26:581–91.
Hess, U., Adams, R. B. Jr. & Kleck, R. E. (2005) Who may frown and who should smile? Dominance, affiliation, and the display of happiness and anger. Cognition and Emotion 19:515–36.
Hess, U., Adams, R. B. Jr. & Kleck, R. E. (2007) When two do the same, it might not mean the same: The perception of emotional expressions shown by men and women. In: Group dynamics and emotional expression, pp. 3350. Cambridge University Press.
Hess, U. Adams, R. B. Jr. & Kleck, R. E. (2009a) The categorical perception of emotions and traits. Social Cognition 27:319–25.
Hess, U., Banse, R. & Kappas, A. (1995) The intensity of facial expression is determined by underlying affective state and social situation. Journal of Personality and Social Psychology 69:280–88.
Hess, U., Beaupre, M. & Cheung, N. (2002) Who to whom and why–Cultural differences and similarities in the function of smiles. In: An empirical reflection on the smile, ed. Abel, M., pp. 187216. Edwin Mellen Press.
Hess, U. & Blairy, S. (2001) Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy. International Journal of Psychophysiology 40:129–41.
Hess, U., Blairy, S. & Philippot, P. (1999) Facial mimicry. In: The social context of nonverbal behavior, ed. Philippot, P., Feldman, R. & Coats, E., pp. 213–41. Cambridge University Press.
Hess, U. & Bourgeois, P. (in press) You smile–I smile: Emotion expression in social interaction. Biological Psychology.
Hess, U. & Kleck, R. E. (1990) Differentiating emotion elicited and deliberate emotional facial expressions. European Journal of Social Psychology 20:369–85.
Hooker, C. I., Paller, K. A., Gitelman, D. R., Parrish, T. B., Mesulam, M. & Reber, P. J. (2003) Brain networks for analyzing eye gaze. Cognitive Brain Research 17(2):406–18.
Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C. & Rizzolatti, G. (1999) Cortical mechanisms of human imitation. Science 286(5449):2526–28.
Iizuka, Y. (1992) Extraversion, introversion, and visual interaction. Perceptual and Motor Skills 74:4350.
Izard, C. (1971) The face of emotion. Appleton Century Crofts.
Jacob, P. (2008) What do mirror neurons contribute to human social cognition? Mind and Language 23:190223.
Jacob, P. (2009) The tuning-fork model of human social cognition: A critique. Consciousness and Cognition 18:229–43.
Jakobs, E., Manstead, A. S. R. & Fischer, A. H. (1999) Social motives and emotional feelings as determinants of facial displays: The case of smiling. Personality and Social Psychology Bulletin 25:424–35.
Johnson-Laird, P. & Oatley, K. (1989) The language of emotions: An analysis of a semantic field. Cognition and Emotion 3:81123.
Kawagoe, R., Takikawa, Y. & Hikosada, O. (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neuroscience 1:411–16.
Keillor, J. M., Barrett, A. M., Crucian, G. P., Kortenkamp, S. & Heilman, K. M. (2002) Emotional experience and perception in the absence of facial feedback. Journal of the International Neuropsychological Society 8(1):130–35.
Keltner, D. (1995) Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement, and shame. Journal of Personality and Social Psychology 68(3):441–54.
Keltner, D. & Haidt, J. (1999) Social function of emotions at four levels of analysis. Cognition and Emotion 13:505–21.
Keysers, C. & Gazzola, V. (2007) Integrating simulation and theory of mind: From self to social cognition. Trends in Cognitive Sciences 11(5):194–96.
Keysers, C., Wicker, B., Gazzola, V., Anton, J. L., Fogassi, L. & Gallese, V. (2004) A touching sight: SII/PV activation during the observation and experience of touch. Neuron 42(2):335–46.
Kirouac, G. & Hess, U. (1999) Group membership and the decoding of nonverbal behavior. In: The social context of nonverbal behavior, pp. 182210. Cambridge University Press.
Klineberg, O. (1940) Social psychology. Holt.
Klinnert, M., Campos, J., Sorce, J., Emde, R. & Svejda, M. (1983) Emotions as behavior regulators in infancy: Social referencing in infancy. In: Emotion: Theory, research and experience, ed. Plutchik, R. & Kellerman, H., pp. 5786. Academic Press.
Klucharev, V. & Sams, M. (2004) Interaction of gaze direction and facial expressions processing: ERP study. NeuroReport 15:621–25.
Kosslyn, S. M. (1976) Can imagery be distinguished from other forms of internal representation? Evidence from studies of information retrieval time. Memory and Cognition 4:291–97.
Kraut, R. E. & Johnston, R. E. (1979) Social and emotional messages of smiling: An ethological approach. Journal of Personality and Social Psychology 37:1539–53.
Krumhuber, E. & Kappas, A. (2005) Moving smiles: The role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior 29:324.
Krumhuber, E., Manstead, A. S. R. & Kappas, A. (2007) Temporal aspects of facial displays in person and expression perception: The effects of smile dynamics, head-tilt, and gender. Journal of Nonverbal Behavior 31:3956.
LaBarre, W. (1947) The culture basis of emotions and gestures. Journal of Personality 16:4968.
Laird, J. D., Alibozak, T., Davainis, D., Deignan, K., Fontanella, K., Hong, J., Levy, B. & Pacheco, C. (1994) Individual differences in the effects of spontaneous mimicry on emotional contagion. Motivation and Emotion 18:231–46.
Lane, R., Chua, P. & Dolan, R. (1999) Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures. Neuropsychologia 37:989–97.
Lane, R. D., Reiman, E. M., Ahern, G. L., Schwartz, G. E. & Davidson, R. J. (1997) Neuroanatomical correlates of happiness, sadness, and disgust. American Journal of Psychiatry 154:926–33.
Lawrence, A. D., Calder, A. J., McGowan, S. W. & Grasby, P. M. (2002) Selective disruption of the recognition of facial expressions of anger. NeuroReport 13:881–84.
Lawrence, A. D., Chakrabarti, B. & Calder, A. J. (2004) Looking at happy and sad faces: An fMRI study. Paper presented at the Annual Meeting of the Cognitive Neuroscience Society, San Diego, CA, April 18–22, 2004.
LeDoux, J. E. (2007) Emotional memory. Scholarpedia 2(7):180.
Lee, T.-W., Dolan, R. J. & Critchley, H. D. (2007) Controlling emotional expression: Behavioral and neural correlates of nonimitative emotional responses. Cerebral Cortex 18(1):104–13.
Lee, T.-W., Josephs, O., Dolan, R. J. & Critchley, H. D. (2006) Imitating expressions: Emotion-specific neural substrates in facial mimicry. Social Cognitive and Affective Neuroscience 1(2):122–35.
Leslie, K. R., Johnson-Frey, S. H. & Grafton, S. T. (2004) Functional imaging of face and hand imitation: Towards a motor theory of empathy. NeuroImage 21:601607.
Likowski, K. U., Mühlberger, A., Seibt, B., Pauli, P. & Weyers, P. (2008) Modulation of facial mimicry by attitudes. Journal of Experimental Social Psychology 44:1065–72.
Lohaus, A., Keller, H. & Voelker, S. (2001) Relationships between eye contact, maternal sensitivity, and infant crying. International Journal of Behavioral Development 25:542–48.
Maringer, M., Krumhuber, E., Fischer, A. H. & Niedenthal, P. M. (in press) Beyond smile dynamics: Mimicry and beliefs in judgments of smiles. Emotion.
McArthur, L. Z. & Baron, R. M. (1983) Toward an ecological theory of social perception. Psychological Review 90:215–38.
McIntosh, D. (1996) Facial feedback hypotheses: Evidence, implications, and directions. Motivation and Emotion 20:121–47.
McIntosh, D. N. (2006) Spontaneous facial mimicry, liking and emotional contagion. Polish Psychological Bulletin 37:3142.
McIntosh, D. N., Reichmann-Decker, A., Winkielman, P. & Wilbarger, J. L. (2006) When the social mirror breaks: Deficits in automatic, but not voluntary, mimicry of emotional facial expressions in autism. Developmental Science 9:295302.
Melville, H. (1852/1996) Pierre, or, the ambiguities. Penguin.
Menzel, E. W. Jr. (1973) Leadership and communication in young chimpanzees. In: Precultural primate behavior, ed. Menzel, J. E. W., pp. 192225. Karger.
Menzel, E. W. Jr. (1974) A group of young chimpanzees in a one-acre field. In: Behavior of nonhuman primates, ed. Schrier, A. M. & Stollnitz, F., pp. 83153. Academic Press.
Messinger, D. S., Fogel, A. & Dickson, K. L. (2001) All smiles are positive, but some smiles are more positive than others. Developmental Psychology 375:642–53.
Miles, L. & Johnston, L. (2007) Detecting happiness: Perceiver sensitivity to enjoyment and non-enjoyment smiles. Journal of Nonverbal Behavior 31:259–75.
Minagawa-Kawai, Y., Matsuoka, S., Dan, I., Naoi, N., Nakamura, K. & Kojima, S. (2009) Prefrontal activation associated with social attachment: Facial-emotion recognition in mothers and infants. Cerebral Cortex 19:284–92.
Mobbs, D., Greicius, M. D., Abdel-Azim, E., Menon, V. & Reiss, A. L. (2003) Humor modulates the mesolimbic reward centers. Neuron 40:1041–48.
Mojzisch, A., Schilbach, L., Helmert, J., Pannasch, S., Velichkovsky, B. & Vogeley, K. (2006) The effects of self-involvement on attention, arousal, and facial expression during social interaction with virtual others: A psychophysiological study. Social Neuroscience 1:184–95.
Mondillon, L., Niedenthal, P. M., Gil, S. & Droit-Volet, S. (2007) Imitation and in-group versus outgroup members' facial expressions of anger: A test with a time perception task. Social Neuroscience 2:223–37.
Morris, J. S., Friston, K. J., Buchel, C., Frith, C. D., Young, A. W., Calder, A. J. & Dolan, R. J. (1998) A neuromodulatory role for the human amygdala in processing emotional facial expressions. Brain 121:4757.
Morris, J. S., Frith, C. D., Perrett, D. I., Rowland, D., Young, A. W., Calder, A. J. & Dolan, R. J. (1996) A differential neural response in the human amygdala to fearful and happy facial expressions. Nature 383:812–15.
Murphy, F. C., Michael, A., Robbins, T. W. & Sahakian, B. J. (2003) Neuropsychological impairment in patients with major depressive disorder: The effects of feedback on task performance. Psychological Medicine 33:455–67.
Niedenthal, P. M. (2007) Embodying emotion. Science 316:10021005.
Niedenthal, P. M. (2008) Emotion concepts. In: Handbook of emotion, 3rd edition, ed. Lewis, M., Haviland-Jones, J. M. & Barrett, L. F.. Guilford Press.
Niedenthal, P. M., Barsalou, L. W., Ric, F. & Krauth-Gruber, S. (2005a) Embodiment in the acquisition and use of emotion knowledge. In: Emotion: Conscious and unconscious, ed. Feldman-Barrett, L., Niedenthal, P. M. & Winkielman, P., pp. 2150. Guilford Press.
Niedenthal, P. M., Barsalou, L. W., Winkielman, P., Krauth-Gruber, S. & Ric, F. (2005b) Embodiment in attitudes, social perception, and emotion. Personality and Social Psychology Review 9:184211.
Niedenthal, P. M., Brauer, M. Halberstadt, J. & Innes-Ker, A. (2001) When did her smile drop? Facial mimicry and the influence of emotional state on the detection of change in emotional expression. Cognition and Emotion 15:853–64.
Niedenthal, P. M., Halberstadt, J. B., Margolin, J. & Innes-Ker, A. H. (2000) Emotional state and the detection of change in facial expression of emotion. European Journal of Social Psychology 30:211–22.
Niedenthal, P. M., Hess, U. & Miyamoto, Y. (in preparation) Interpreting the smile across cultures.
Niedenthal, P. M., Winkielman, P., Mondillon, L. & Vermeulen, N. (2009) Embodiment of emotion concepts. Journal of Personality and Social Psychology 96(6):1120–36.
Nitschke, J. B., Nelson, E. E., Rusch, B. D., Fox, A .S., Oakes, T. R. & Davidson, R. J. (2004) Orbitofrontal cortex tracks positive mood in mothers viewing pictures of their newborn infants. NeuroImage 21(2):583–92.
Oberman, L. M., Winkielman, P. & Ramachandran, V. S. (2007) Face to face: Blocking facial mimicry can selectively impair recognition of emotional expressions. Social Neuroscience 2:167–78.
O'Doherty, J., Critchley, H., Deichmann, R. & Dolan, R. J. (2003) Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. Journal of Neuroscience 23:7931–39.
O'Doherty, J., Kringelbach, M. L., Rolls, E. T., Hornak, J. & Andrews, C. (2001) Abstract reward and punishment representations in the human orbitofrontal cortex. Nature Neuroscience 4(1):95102.
Öhman, A., Lundqvist, D. & Esteves, F. (2001) The face in the crowd revisited: A threat advantage with schematic stimuli. Journal of Personality and Social Psychology 80(3):381–96.
Okun, M., Bowers, D., Springer, U., Shapira, N., Malone, D., Rezai, A., Nuttin, B., Heilman, K. M., Morecraft, R. J., Rasmussen, S. A., Greenberg, B. D., Foote, K D. Goodman, W. K. (2004) What's in a “Smile”?: Intra-operative observations of contralateral smiles induced by deep brain stimulation. Neurocase 10(4):271–79.
Ortony, A., Clore, G. & Foss, M. (1987) The referential structure of the affective lexicon. Cognitive Science 11:341–64.
Parkinson, J. A., Cardinal, R. N. & Everitt, B. J. (2000) Limbic cortical–ventral striatal systems underlying appetitive conditioning. Progress in Brain Research 126:263–85.
Parr, L. A. & Waller, B. (2006) Understanding chimpanzee facial expression: Insights into the evolution of communication. Social Cognitive and Affective Neuroscience 1:221–28.
Patterson, M. L. (1982) A sequential functional model of nonverbal exchange. Psychological Review 89:231–49.
Patterson, M. L. (1983) Nonverbal behavior: A functional perspective. Springer.
Phillips, M. L., Bullmore, E. T., Howard, R., Woodruff, P. W. R., Wright, I. C., Williams, S. C. R., Simmons, A., Andrew, C., Brammer, M. J. & David, A. S. (1998) Investigation of facial recognition memory and happy and sad facial expression perception: An fMRI study. Psychiatry Research: Neuroimaging 83:127–38.
Pitcher, D., Garrido, L., Walsh, V. & Duchaine, B. (2008) TMS disrupts the perception and embodiment of facial expressions. Journal of Neuroscience 28(36):8929–33.
Pourtois, G., Sander, D., Andres, M., Grandjean, D., Reveret, L., Olivier, E. & Vuilleumier, P. (2004) Dissociable roles of the human somatosensory and superior temporal cortices for processing social face signals. European Journal of Neuroscience 20(12):3507–15.
Pourtois, G. & Vuilleumier, P. (2006) The perception of fear in faces: Involuntary and unconscious responses in the human brain as revealed by functional imaging. In: Fear in cognitive neurosciences, pp. 6395. Nova Science Publishers.
Preuschoft, S. & van Hooff, J. A. R. A. M. (1997) The social function of “smile” and “laughter”: Variations across primate species and societies. In: Non-verbal communication: Where nature meets culture, ed. Segerstrale, U. & Molnàr, P., pp. 171–89. Erlbaum.
Rauch, S. L., Shin, L. M., Dougherty, D. D., Alpert, N. M., Orr, S. P., Lasko, M., Macklin, M. L., Fischman, A. J. & Pitman, R. K. (1999) Neural activation during sexual and competitive arousal in healthy men. Psychiatry Research, Neuroimaging Section 911–10.
Redoute, J., Stoleru, S., Gregoire, M., Costes, N., Cinotti, L., Lavenne, F., Le Bars, D., Forest, M. & Pujol, J. (2000) Brain processing of visual sexual stimuli in human males. Human Brain Mapping 11:162–77.
Richeson, J., Todd, A., Trawalter, S. & Baird, A. (2008) Eye-gaze direction modulates race-related amygdala activity. Group Processes and Intergroup Relations 11:233–46.
Rinn, W. E. (1991) Neuropsychology of facial expression. In: Fundamentals of nonverbal behavior, ed. Feldman, R. S. & Rimé, B., pp. 330. Press Syndicate of the University of Cambridge.
Rizzolatti, G. & Craighero, L. (2004) The mirror-neuron system. Annual Review of Neuroscience 27:169–92.
Rizzolatti, G., Fadiga, L., Gallese, V. & Fogassi, L. (1996) Premotor cortex and the recognition of motor actions. Cognitive Brain Research 3:131–41.
Rolls, E. (2000) The orbitofrontal cortex and reward. Cerebral Cortex 10(3):284–94.
Rolls, E. T. (2004) The functions of the orbitofrontal cortex. Brain and Cognition 55:1129.
Russo, N. (1975) Eye contact, interpersonal distance, and the equilibrium theory. Journal of Personality and Social Psychology 31:497502.
Sander, D., Grafman, J. & Zalla, T. (2003) The human amygdala: An evolved system for relevance detection. Reviews in the Neurosciences 14(4):303–16.
Schilbach, L., Eickhoff, S. B., Mojzisch, A. & Vogeley, K. (2008) What's in a smile? Neural correlates of facial embodiment during social interaction. Social Neuroscience 3:3750.
Schilbach, L., Wohlschlaeger, A., Kraemer, N., Newen, A., Shah, N. & Fink, G., (2006) Being with virtual others: Neural correlates of social interaction. Neuropsychologia 44:718–30.
Schore, A. (2001) Effects of a secure attachment relationship on right brain development, affect regulation, and infant mental health. Infant Mental Health Journal 22:766.
Schrammel, F., Pannasch, S., Graupner, S.-T., Mojzisch, A. & Velichkovsky, B. M. (2009) Virtual friend or threat? The effects of facial expressions and gaze interaction on psychophysiological responses and emotional experience. Psychophysiology 46:922–31.
Schultz, R., Gauthier, I., Klin, A., Fulbright, R., Anderson, A. & Volkmar, F. (2000) Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Archives of General Psychiatry 57:331–40.
Semin, G. R. & Cacioppo, J. T. (2008) Grounding social cognition: Synchronization, entrainment, and coordination. In: Embodied grounding: Social, cognitive, affective, and neuroscientific approaches, ed. Semin, G. R. & Smith, E. R., pp. 119–47. Cambridge University Press.
Senior, C., Phillips, M. L., Barnes, J. & David, A. S. (1999) An investigation into the perception of dominance from schematic faces: A study using the World-Wide Web. Behavior Research Methods, Instruments and Computers 31:341–46.
Smith, E. & Semin, G. (2007) Situated social cognition. Current Directions in Psychological Science 16:132–35.
Smith, M. L., Cottrell, G., Gosselin, F. & Schyns, P. G. (2005) Transmitting and decoding facial expressions of emotions. Psychological Science 16:184–89.
Solomon, K. O. & Barsalou, L. W. (2004) Perceptual simulation in property verification. Memory and Cognition 32:244–59.
Sonnby-Borgström, M. (2002) Automatic mimicry reactions as related to differences in emotional empathy. Scandinavian Journal of Psychology 43:433–43.
Soussignan, R. (2002) Duchenne smile, emotional experience, and autonomic reactivity: A test of the facial feedback hypothesis. Emotion 2:5274.
Spezio, M., Adolphs, R., Hurley, R. & Piven, J. (2007a) Abnormal use of facial information in high-functioning autism. Journal of Autism and Developmental Disorders 37:929–39.
Spezio, M. L., Huang, P.-Y. S., Castelli, F. & Adolphs, R. (2007b) Amygdala damage impairs eye contact during conversations with real people. Journal of Neuroscience 27:3994–97.
Stel, M. & van Knippenberg, A. (2008) The role of facial mimicry in the recognition of affect. Psychological Science 19:984–85.
Strack, F. & Deutsch, R. (2004) Reflective and impulsive determinants of social behavior. Personality and Social Psychology Review 8:220–47.
Strayer, J. (1993) Children's concordant emotions and cognitions in response to observed emotions. Child Development 64(1):188201.
Striano, T., Kopp, F., Grossmann, T. & Reid, V. (2006) Eye contact influences neural processing of emotional expressions in 4-month-old infants. Social Cognitive and Affective Neuroscience 1:8794.
Surakka, V. & Hietanen, J. (1998) Facial and emotional reactions to Duchenne and non-Duchenne smiles. International Journal of Psychophysiology 29(1):2333.
Surguladze, S. A., Brammer, M. J., Young, A. W., Andrew, C., Travis, M. J., Williams, S. C. & Phillips, M. L. (2003) A preferential increase in the extrastriate response to signals of danger. NeuroImage 19:1317–28.
Symons, L. A., Hains, S. M. J. & Muir, D. W. (1998) Look at me: 5-month-old infants's sensitivity to very small deviations in eye-gaze during social interactions. Infant Behavioral Development 21:531–36.
Thibault, P., Levesque, M., Gosselin, P. & Hess, U. (2008) Cultural aspects of smile authenticity. Paper presented at the 29th International Congress of Psychology, Berlin, Germany. July 20–25, 2008.
Thibault, P., Levesque, M., Gosselin, P. & Hess, U. (submitted) The Duchenne marker is NOT a universal signal of smile authenticity: But it can be learned!
Tipples, J., Atkinson, A. P. & Young, A. W. (2002) The eyebrow frown: A salient social signal. Emotion 2:288–96.
Tracy, J. L. & Robins, R. W. (2004) Show your pride: Evidence for a discrete emotion expression. Psychological Science 15:194–97.
Tracy, J. L. & Robins, R. W. (2008) The nonverbal expression of pride: Evidence for cross-cultural recognition. Journal of Personality and Social Psychology 94:516–30.
Trevarthen, C. (1974) Conversations with a two-month-old. New Scientist 2:230–35.
Tronick, E., Als, H., Adamson, L., Wise, S. & Brazelton, T. (1978) The infant's response to entrapment between contradictory messages in face to face interaction. Journal of the American Academy of Child Psychiatry 17:113.
Turella, L., Pierno, A., Tubaldi, F. & Castiello, U. (2009) Mirror neurons in humans: Consisting or confounding evidence? Brain and Language 108:1021.
van der Gaag, C., Minderaa, R. & Keysers, C. (2007) Facial expressions: What the mirror neuron system can and cannot tell us. Social Neuroscience 2:179222.
van Hooff, J. A. R. A. M. (1976) The comparison of the facial expressions in man and higher primates. In: Methods of inference from animal to human behavior, ed. von Cranach, M., pp. 165–96. Aldine.
von Cranach, M. (1971) The role of orienting behavior in human interaction. In: Behavior and environment: The use of space by animal and man, ed. Esser, A. H., pp. 217–37. Plenum Press.
Waller, B. & Dunbar, R. I. M. (2005) Differential behavioural effects of silent bared teeth display and relaxed open mouth display in chimpanzees (Pan troglodytes). Ethology 111:129–42.
Walsh, D. & Hewitt, J. (1985) Giving men the come-on: Effect of eye contact and smiling in a bar environment. Perceptual and Motor Skills 61:873–74.
Whalen, P. J., Rauch, S. L., Etcoff, N. L., McInerney, S. C., Lee, M. & Jenike, M. A. (1998) Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. Journal of Neuroscience 18:411–18.
Whalen, P. J., Shin, L. M., McInerney, S. C., Fischer, H., Wright, C. I. & Rauch, S. L. (2001) A functional MRI study of human amygdala responses to facial expressions of fear vs. anger. Emotion 1:7083.
Wicker, B., Keysers, C., Plailly, J., Royet, J. P., Gallese, V. & Rizzolatti, G. (2003) Both of us disgusted in my insula: The common neural basis of seeing and feeling disgust. Neuron 40:655–64.
Wild, B., Erb, M. & Bartels, M. (2001) Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: Quality, quantity, time course, and gender differences. Psychiatry Research 102:109–24.
Winkielman, P., McIntosh, D. N. & Oberman, L. (2009) Embodied and disembodied emotion processing: Learning from and about typical and autistic individuals. Emotion Review 2:178–90.
Winston, J. S., O'Doherty, J. & Dolan, R. J. (2003) Common and distinct neural responses during direct and incidental processing of multiple facial emotions. NeuroImage 2084–97.
Yang, T. T., Menon, V., Eliez, S., Blasey, C., White, C. D., Reid, A. J., Gotlib, I. H. & Reiss, A. L. (2002) Amygdalar activation associated with positive and negative facial expressions. NeuroReport 13:1737–41.
Zajonc, R. B., Adelmann, P. K., Murphy, S. T. & Niedenthal, P. M. (1987) Convergence in the physical appearance of spouses: An implication of the vascular theory of emotional efference. Motivation and Emotion 11:335–46.
Zajonc, R., Murphy, S. & Inglehart, M. (1989) Feeling and facial efference: Implications of the vascular theory of emotion. Psychological Review 96:395416.
Zink, C. F., Tong, Y., Chen, Q., Bassett, D., Stein, J. L. & Meyer-Lindenberg, A. (2008) Know your place: Neural processing of social hierarchy in humans. Neuron 58: 273–83.


Related content

Powered by UNSILO

The Simulation of Smiles (SIMS) model: Embodied simulation and the meaning of facial expression

  • Paula M. Niedenthal (a1), Martial Mermillod (a2), Marcus Maringer (a3) and Ursula Hess (a4)


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.