Hostname: page-component-6766d58669-h8lrw Total loading time: 0 Render date: 2026-05-21T09:56:08.662Z Has data issue: false hasContentIssue false
  • English
  • Français

What the replication reformation wrought

Published online by Cambridge University Press:  27 July 2018

Barbara A. Spellman  and
Daniel Kahneman
Barbara A. Spellman
Affiliation:
University of Virginia School of Law, Charlottesville, VA 22903. bas6g@virginia.eduhttp://content.law.virginia.edu/faculty/profile/bas6g/1211027
Daniel Kahneman
Affiliation:
Woodrow Wilson School of Public and International Affairs, Princeton University, Princeton, NJ, 08544. kahneman@princeton.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Replication failures were among the triggers of a reform movement which, in a very short time, has been enormously useful in raising standards and improving methods. As a result, the massive multilab multi-experiment replication projects have served their purpose and will die out. We describe other types of replications – both friendly and adversarial – that should continue to be beneficial.

Information

Type
Open Peer Commentary
Information
Behavioral and Brain Sciences , Volume 41 , 2018 , e149
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Kahneman, D. (2014) A new etiquette for replication. Social Psychology 45(4):310–11.Google Scholar
Nelson, L. D., Simmons, J. P. & Simonsohn, U. (2018) Psychology's renaissance. Annual Review of Psychology 69:511–34. Available at: http://doi.org/10.1146/annurev-psych-122216-011836.Google Scholar
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., Ishiyama, J., Karlan, D., Kraut, A., Lupia, A., Mabry, P., Madon, T. A., Malhotra, N., Mayo-Wilson, E., McNutt, M., Miguel, E., Levy Paluck, E., Simonsohn, U., Soderberg, C., Spellman, B. A., Turitto, J., VandenBos, G., Vazire, S., Wagenmakers, E. J., Wilson, R. & Yarkoni, T. (2015) Promoting an open research culture. Science 348:1422–25.Google Scholar
Simmons, J. P., Nelson, L. D. & Simonsohn, U. (2011) False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science 22:1359–66. Available at: http://doi.org/10.1177/0956797611417632.Google Scholar
Simons, D. J., Holcombe, A. O. & Spellman, B. A. (2014) An introduction to Registered Replication Reports at Perspectives on Psychological Science. Perspectives on Psychological Science 9(5):552–55.Google Scholar
Spellman, B. A. (2015) A short (personal) future history of Revolution 2.0. Perspectives on Psychological Science 10:886–99.Google Scholar
Vohs, K. D. (2018) A pre-registered depletion replication project: The paradigmatic replication approach. Presented at the Symposium at the 2018 Society of Personality and Social Psychology Annual Convention, Atlanta, GA.Google Scholar