Hostname: page-component-8448b6f56d-c4f8m Total loading time: 0 Render date: 2024-04-24T08:29:31.209Z Has data issue: false hasContentIssue false

Accuracy, bias, self-fulfilling prophecies, and scientific self-correction

Published online by Cambridge University Press:  22 March 2017

Lee Jussim*
Affiliation:
Department of Psychology, Rutgers University, Piscataway, NJ 08544. Jussim@rci.rutgers.eduhttp://www.rci.rutgers.edu/~jussim/

Abstract

In my Précis of Social Perception and Social Reality (Jussim 2012, henceforth abbreviated as SPSR), I argued that the social science scholarship on social perception and interpersonal expectancies was characterized by a tripartite pattern: (1) Errors, biases, and self-fulfilling prophecies in person perception were generally weak, fragile, and fleeting; (2) Social perceptions were often quite accurate; and (3) Conclusions appearing throughout the social psychology scientific literature routinely overstated the power and pervasiveness of expectancy effects, and ignored evidence of accuracy. Most commentators concurred with the validity of these conclusions. Two, however, strongly disagreed with the conclusion that the evidence consistently has shown that stereotypes are moderately to highly accurate. Several others, while agreeing with most of the specifics, also suggested that those arguments did not necessarily apply to contexts outside of those covered in SPSR. In this response, I consider all these aspects: the limitations to the tripartite pattern, the role of politics and confirmation biases in distorting scientific conclusions, common obstructions to effective scientific self-correction, and how to limit them.

Type
Author's Response
Copyright
Copyright © Cambridge University Press 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Allport, F. H. (1955) Theories of perception and the concept of structure. Wiley.Google Scholar
Allport, G. W. (1954/1979) The nature of prejudice, 2nd edition. Perseus.Google Scholar
Aronson, E. (2011) The social animal, 11th edition. Worth.Google Scholar
Banaji, M. R. & Greenwald, A. G. (2013) Blindspot: Hidden biases of good people. Delacorte Press.Google Scholar
Baron, R. M., Albright, L. & Malloy, T. E. (1995) The effects of behavioral and social class information on social judgment. Personality and Social Psychology Bulletin 21:308–15.CrossRefGoogle Scholar
Bartlett, F. C. (1932) Remembering: A study in experimental and social psychology. Cambridge University Press.Google Scholar
Baumeister, R. F. & Bushman, B. J. (2014) Social psychology and human nature, 3rd edition. Wadsworth.Google Scholar
Bem, D. (1987) Writing the empirical journal article. In: The compleat academic: A career guide, ed. Zanna, M. P. & Darley, J. M.. 8, pp. 171201. Erlbaum.Google Scholar
Brown, R. (2010) Prejudice: Its social psychology, 2nd edition. Wiley-Blackwell.Google Scholar
Brunswick, E. (1957) Systematic and representative design of psychological experiments. University of California Press.Google Scholar
Charlton, B. G. (2009) Clever sillies: Why high IQ people tend to be deficient in common sense. Medical Hypotheses 73:867–70.Google Scholar
Cohen, C. E. (1981) Personal categories and social perception: Testing some boundaries of the processing effects of prior knowledge. Journal of Personality and Social Psychology 40:441–52.CrossRefGoogle Scholar
Crisp, R. J. & Turner, R. N. (2014) Essential social psychology, 3rd edition. Sage.Google Scholar
Darley, J. M. & Gross, P. H. (1983) A hypothesis-confirming bias in labeling effects. Journal of Personality and Social Psychology 44:2033.CrossRefGoogle Scholar
Devine, P. G., Hirt, E. R. & Gehrke, E. M. (1990) Diagnostic and confirmation strategies in trait hypothesis testing. Journal of Personality and Social Psychology 58:952–63.CrossRefGoogle Scholar
Duarte, J. L., Crawford, J. T., Stern, C., Haidt, J., Jussim, L. & Tetlock, P. E. (2015) Political diversity will improve social psychological science. Behavioral and Brain Sciences 38:e130.CrossRefGoogle ScholarPubMed
Ellemers, N. & Barreto, M. (2009) Collective action in modern times: How modern expressions of prejudice prevent collective action. Journal of Social Issues 65:749–68. Available at: http://doi.org/10.1111/j.1540-4560.2009.01621.x Google Scholar
Firestone, C. & Scholl, B. J. (2016) Cognition does not affect perception: Evaluating the evidence for “top-down” effects. Behavioral and Brain Sciences 39: e229. Available at: https://doi.org/10.1017/S0140525X15000965 CrossRefGoogle Scholar
Fiske, S. T. & Taylor, S. E. (2008) Social cognition: From brains to culture. McGraw-Hill.Google Scholar
Funder, D. C. (1987) Errors and mistakes: Evaluating the accuracy of social judgment. Psychological Bulletin 101:7590.CrossRefGoogle ScholarPubMed
Gigerenzer, G. & Brighton, H. (2009) Homo heuristicus: Why biased minds make better inferences. Topics in Cognitive Science 1:107–43.Google Scholar
Gottfredson, L. S. (2010) Lessons in academic freedom as lived experience. Personality and Individual Differences 49:272–80.Google Scholar
Greenberg, J., Schmader, T., Arndt, J. & Landau, M. (2015) Social psychology: The science of everyday life. Worth.Google Scholar
Greenwald, A. G., Pratkanis, A. R., Leippe, M. R. & Baumgardner, M. H. (1986) Under what conditions does theory obstruct research progress? Psychological Review 93:216–29.Google Scholar
Grison, S., Heatherton, T. F. & Gazzaniga, M. S. (2015) Psychology in your life. W. W. Norton.Google Scholar
Haidt, J. (2012) The Righteous Mind: Why good people are divided by religion and politics. Pantheon Books.Google Scholar
Haselton, M. G. & Buss, D. M. (2000) Error management theory: A new perspective on biases in cross-sex mind reading. Journal of Personality and Social Psychology 78(1):8191.Google Scholar
Hastorf, A. H. & Cantril, H. (1954) They saw a game: A case study. Journal of Abnormal and Social Psychology 49(1):129–34.Google Scholar
Ioannidis, J. P. (2012) Why science is not necessarily self-correcting. Perspectives on Psychological Science 7:645–54.Google Scholar
Jordan, C. H. & Zanna, M. P. (2007) Not all experiments are created equal: On conducting and reporting persuasive experiments. In: Critical thinking in psychology, ed. Sternberg, R. J., Halpern, D. & Roediger, H. L. III, pp. 160–76. Cambridge University Press.Google Scholar
Jost, J. T. (2011) Ideological bias in social psychology? The Situationist. Available at: https://thesituationist.wordpress.com/2011/03/02/ideological-bias-in-social-psychology/ Google Scholar
Jost, J. T. & Kruglanski, A. W. (2002) The estrangement of social constructionism and experimental social psychology: History of the rift and prospects for reconciliation. Personality and Social Psychology Review 6:168–87.Google Scholar
Jussim, L. (1991) Social perception and social reality: A reflection-construction model. Psychological Review 98:5473.Google Scholar
Jussim, L. (2012) Social perception and social reality: Why accuracy dominates bias and self-fulfilling prophecy. Oxford University Press.CrossRefGoogle Scholar
Jussim, L., Crawford, J. T., Anglin, S. M., Chambers, J. R., Stevens, S. T. & Cohen, F. (2016a) Stereotype accuracy: One of the largest and most replicable effects in all of social psychology. In: Handbook of prejudice, stereotyping, and discrimination, 2nd edition, ed. Nelson, T., pp. 3163. Psychology Press.Google Scholar
Jussim, L., Crawford, J. T., Anglin, S. M. & Stevens, S. T. (2015a) Ideological bias in social psychological research. In: Social psychology and politics, ed. Forgas, J. P., Fiedler, K. & Crano, W., pp. 91109. Psychology Press/Taylor & Francis.Google Scholar
Jussim, L., Crawford, J. T., Anglin, S. M., Stevens, S. M. & Duarte, J. L. (2016b) Interpretations and methods: Towards a more effectively self-correcting social psychology. Journal of Experimental Social Psychology 66:116–33.Google Scholar
Jussim, L., Crawford, J. T. & Rubinstein, R. S. (2015b) Stereotype (in)accuracy in perceptions of groups and individuals. Current Directions in Psychological Science 24:490–97.CrossRefGoogle Scholar
Jussim, L., Crawford, J. T., Stevens, S. T. & Anglin, S. M. (2016c) The politics of social psychological science: Distortions in the social psychology of intergroup relations. In: Social psychology of political polarization, ed. Valdesolo, P., & Graham, J., pp. 165–96. Routledge.Google Scholar
Jussim, L., Crawford, J. T., Stevens, S. T., Anglin, S. M. & Duarte, J. L. (2016d) Can high moral purposes undermine scientific integrity? In: The social psychology of morality, ed. Forgas, J., Jussim, L. & van Lange, P., pp. 173–95. Taylor and Francis.Google Scholar
Kahan, D. M., Peters, E., Wittlin, M., Slovic, P., Ouellette, L. L., Braman, D. & Mandel, G. (2012b) The polarizing impact of science literacy and numeracy on perceived climate change risks. Nature: Climate Change 2:732–35.Google Scholar
King, L. A. (2013) Experience psychology, 2nd edition. McGraw-Hill.Google Scholar
Leslie, S. J. (in press) The original sin of cognition: Fear, prejudice and generalization. The Journal of Philosophy.Google Scholar
Leslie, S. J., Khemlani, S. & Glucksberg, S. (2011) Do all ducks lay eggs? The generic overgeneralization effect. Journal of Memory and Language 65(1):1531.Google Scholar
Lilienfeld, S. O. (2010) Can psychology become a science? Personality and Individual Differences 49:281–88.CrossRefGoogle Scholar
Martin, C. (2016) How ideology has hindered sociological insight. The American Sociologist 47(1):115–30. doi: 10.1007/s12108-015-9263-z.Google Scholar
Merton, R. K. (1942/1973) The normative structure of science. In: The sociology of science: Theoretical and empirical investigations, ed. Merton, R. K.. University of Chicago Press.Google Scholar
Monin, B. & Oppenheimer, D. M. (2014) The limitations of direct replications and the virtues of stimulus sampling. Social Psychology 45:299311.Google Scholar
Mook, D. G. (1983) In defense of external invalidity. American Psychologist 38:379–87.Google Scholar
Open Science Collaboration (2015) Estimating the reproducibility of psychological science. Science 349(6251): Article No. 4716. doi: 10.1126/science.aac4716.Google Scholar
Pinker, S. (2002) The blank slate. Penguin.Google Scholar
Planck, M. K. (1950) Scientific autobiography and other papers. Philosophical Library.Google Scholar
Rosenhan, D. L. (1973) On being sane in insane places. Science 179:250–68.Google Scholar
Rosenthal, R. & Jacobson, L. (1968) Pygmalion in the classroom: Teacher expectations and pupils' intellectual development. Holt, Rinehart, and Winston.CrossRefGoogle Scholar
Schacter, D. L., Gilbert, D. T., Wegner, D. M. & Nock, M. K. (2015) Introducing psychology, 3rd edition. Worth.Google Scholar
Simmons, J. P., Nelson, L. D. & Simonsohn, U. (2011) False-positive psychology undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 22:1359–66.Google Scholar
Snyder, M. & Swann, W. B. Jr. (1978a) Behavioral confirmation in social interaction: From social perception to social reality. Journal of Experimental Social Psychology 14:148–62.Google Scholar
Swim, J. K. (1994) Perceived versus meta-analytic effect sizes: An assessment of the accuracy of gender stereotypes. Journal of Personality and Social Psychology 66:2136.Google Scholar
Tetlock, P. E. (1994) Political psychology or politicized psychology: Is the road to scientific hell paved with good moral intentions? Political Psychology 509–29.Google Scholar
Trope, Y. & Bassok, M. (1983) Information-gathering strategies in hypothesis-testing. Journal of Experimental Social Psychology 19:560–76.Google Scholar
Von Hippel, W. & Trivers, R. (2011) The evolution and psychology of self-deception. Behavioral and Brain Sciences 34(1):156.Google Scholar
Vul, E., Harris, C., Winkielman, P. & Pashler, H. (2009) Puzzlingly high correlations in fMRI studies in emotion, personality, and social cognition. Perspectives on Psychological Science 4:274–90.CrossRefGoogle ScholarPubMed
Wells, G. L. & Windschitl, P. D. (1999) Stimulus sampling and social psychological experimentation. Personality and Social Psychology Bulletin 25:1115–25.Google Scholar
Westfall, J., Judd, C. M. & Kenny, D. A. (2015) Replicating studies in which samples of participants respond to samples of stimuli. Perspectives on Psychological Science 10:390–99.CrossRefGoogle ScholarPubMed
Whitley, B. & Kite, M. (2009) The psychology of prejudice and discrimination. Cengage Learning.Google Scholar