Hostname: page-component-77f85d65b8-pztms Total loading time: 0 Render date: 2026-03-29T02:33:06.971Z Has data issue: false hasContentIssue false
  • English
  • Français

Improving social and behavioral science by making replication mainstream: A response to commentaries

Published online by Cambridge University Press:  27 July 2018

Rolf A. Zwaan ,
Alexander Etz ,
Richard E. Lucas  and
M. Brent Donnellan
Rolf A. Zwaan
Affiliation:
Department of Psychology, Education, and Child Sciences Erasmus University, 3000 DR, Rotterdam, The Netherlands. zwaan@essb.eur.nlhttps://www.eur.nl/essb/people/rolf-zwaan
Alexander Etz
Affiliation:
Department of Cognitive Sciences, University of California, Irvine, CA 92697-5100. etz.alexander@gmail.comhttps://alexanderetz.com/
Richard E. Lucas
Affiliation:
Department of Psychology, Michigan State University, East Lansing, MI 48824. lucasri@msu.edudonnel59@msu.eduhttps://www.msu.edu/user/lucasri/https://psychology.msu.edu/people/faculty/donnel59
M. Brent Donnellan
Affiliation:
Department of Psychology, Michigan State University, East Lansing, MI 48824. lucasri@msu.edudonnel59@msu.eduhttps://www.msu.edu/user/lucasri/https://psychology.msu.edu/people/faculty/donnel59
Get access Rights & Permissions [Opens in a new window]

Abstract

The commentaries on our target article are insightful and constructive. There were some critical notes, but many commentaries agreed with, or even amplified our message. The first section of our response addresses comments pertaining to specific parts of the target article. The second section provides a response to the commentaries' suggestions to make replication mainstream. The final section contains concluding remarks.

Information

Type
Authors' Response
Information
Behavioral and Brain Sciences , Volume 41 , 2018 , e157
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

1.

Current address: Department of Psychology, Psychology Building, 316 Physics Road, Room 249A, Michigan State University, East Lansing, MI 48824.

References

Baribault, B., Donkin, C., Little, D. R., Trueblood, J. S., Oravecz, Z., van Ravenzwaaij, D., White, C. N., De Boeck, P. & Vandekerckhove, J. (2018) Metastudies for robust tests of theory. Proceedings of the National Academy of Sciences of the United States of America 115(11):2607–12. Available at: http:/doi.org/10.1073/pnas.1708285114.Google Scholar
Bonett, D. G. (2012) Replication-extension studies. Current Directions in Psychological Science 21:409–12.Google Scholar
Box, G. E. P. (1979) Robustness in the strategy of scientific model building. In: Robustness in statistics, ed. Launer, R. L. & Wilkinson, G. N., pp. 201–36. Academic.Google Scholar
Donnellan, M. B., Lucas, R. E. & Cesario, J. (2015) On the association between loneliness and bathing habits: Nine replications of Bargh and Shalev (2012): Study 1. Emotion 15(1):109–19.Google Scholar
Eerland, A., Sherrill, A. M., Magliano, J. P., Zwaan, R. A., Arnal, J. D., Aucoin, P., Berger, S. A., Birt, A. R., Capezza, N., Carlucci, M., Crocker, C., Ferretti, T. R., Kibbe, M. R., Knepp, M. M., Kurby, C. A., Melcher, J. M., Michael, S. W., Poirier, C. & Prenoveau, J. M. (2016) Registered replication report: Hart & Albarracín (2011). Perspectives on Psychological Science 11:158–71.Google Scholar
Etz, A., Haaf, J. M., Rouder, J. N. & Vandekerckhove, J. (in press) Bayesian inference and testing any hypothesis you can specify. Preprint. Available at: https://psyarxiv.com/wmf3r/.Google Scholar
Hagger, M. S., Chatzisarantis, N. L. D., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., Brand, R., Brandt, M. J., Brewer, G., Bruyneel, S., Calvillo, D. P., Campbell, W. K., Cannon, P. R., Carlucci, M., Carruth, N. P., Cheung, T., Crowell, A., De Ridder, D. T. D., Dewitte, S., Elson, M., Evans, J. R., Fay, B. A., Fennis, B. M, Finley, A., Francis, Z., Heise, E., Hoemann, H., Inzlicht, M., Koole, S. L., Koppel, L., Kroese, F., Lange, F., Lau, K., Lynch, B. P., Martijn, C., Merckelbach, H., Mills, N. V., Michirev, A., Miyake, A., Mosser, A. E., Muise, M., Muller, D., Muzi, M., Nalis, D., Nurwanti, R., Otgaar, H, Philipp, M. C., Primoceri, P., Rentzsch, K., Ringos, L., Schlinkert, C., Schmeichel, B. J., Schoch, S. F., Schrama, M., Schütz, A., Stamos, A., Tinghög, G., Ullrich, J., vanDellen, M., Wimbarti, S., Wolff, W., Yusainy, C., Zerhouni, O. & Zwienenberg, M. (2016) A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science 11(4):546–73.Google Scholar
Lakatos, I. (1970) Falsification and the methodology of scientific research programmes. In: Criticism and the growth of knowledge, ed. Lakatos, I. & Musgrave, A., pp. 91–196. Cambridge University Press.Google Scholar
Lucas, R. E. & Donnellan, M. B. (2013) Improving the replicability and reproducibility of research published in the Journal of Research in Personality. Journal of Research in Personality 4(47):453–54.Google Scholar
Nosek, B. A. & Errington, T. M. (2017) Making sense of replications. eLife 6:e23383.Google Scholar
Open Science Collaboration (2015) Estimating the reproducibility of psychological science. Science 349(6251):aac4716. Available at: http://doi.org/10.1126/science.aac4716.Google Scholar
Srivastava, S. (2012, September 17) A Pottery Barn rule for scientific journals. Blog post. Available at: https://hardsci.wordpress.com/2012/09/27/a-pottery-barn-rule-for-scientific-journals/.Google Scholar
Strevens, M. (2001) The Bayesian treatment of auxiliary hypotheses. The British Journal for the Philosophy of Science 52(3):515–37.Google Scholar
Wagenmakers, E.-J., Beek, T., Dijkhoff, L., Gronau, Q. F., Acosta, A., Adams, R. B. Jr., Albohn, D. N., Allard, E. S., Benning, S. D., Blouin-Hudon, E.-M., Bulnes, L. C., Caldwell, T. L., Calin-Jageman, R. J., Capaldi, C. A., Carfagno, N. S., Chasten, K. T., Cleeremans, A., Connell, L., DeCicco, J. M., Dijkstra, K, Fischer, A. H., Foroni, F., Hess, U., Holmes, K. J., Jones, J. L. H., Klein, O., Koch, C., Korb, S., Lewinski, P., Liao, J. D., Lund, S., Lupianez, J., Lynott, D., Nance, C. N., Oosterwijk, S., Ozdoğru, A. A., Pacheco-Unguetti, A. P., Pearson, B., Powis, C., Riding, S., Roberts, T.-A., Rumiati, R. I., Senden, M., Shea-Shumsky, N. B., Sobocko, K., Soto, J. A., Steiner, T. G., Talarico, J. M., van Allen, Z. M., Vandekerckhove, M., Wainwright, B., Wayand, J. F., Zeelenberg, R., Zetzer, E. E. & Zwaan, R. A. (2016a) Registered replication report: Strack, Martin & Stepper (1988). Perspectives on Psychological Science 11:917–28.Google Scholar
Zwaan, R. A. (2017, May 8) Concurrent replication. Blog post. Available at: https://rolfzwaan.blogspot.nl/2017/05/concurrent-replication.html.Google Scholar