Skip to main content Accessibility help

Enhancing research credibility when replication is not feasible

  • Robert J. MacCoun (a1)


Direct replications are not always affordable or feasible, and for some phenomena they are impossible. In such situations, methods of blinded data analysis can help minimize p-hacking and confirmation bias, increasing our confidence in a study's results.



Hide All
Berk, R. A., Campbell, A., Klap, R. & Western, B. (1992) The deterrent effect of arrest in incidents of domestic violence: A Bayesian analysis of four field experiments. American Sociological Review 57:698708.
Cortina, J. M., Aguinis, H. & DeShon, R. P. (2017) Twilight of dawn or of evening? A century of research methods in the Journal of Applied Psychology. Journal of Applied Psychology 102(3):274–90.
Klein, J. R. & Roodman, A. (2005) Blind analysis in nuclear and particle physics. Annual Review of Nuclear and Particle Physics 55:141–63.
Lipsey, M. W. & Wilson, D. B. (1993) The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist 48:1181–209.
MacCoun, R. J. & Perlmutter, S. (2015) Hide results to seek the truth. Nature 526:187–89.
MacCoun, R. J. & Perlmutter, S. (2017) Blind analysis as a correction for confirmatory bias in physics and in psychology In: Psychological science under scrutiny: Recent challenges and proposed solutions, ed. Lilienfeld, S. O. & Waldman, I., pp. 297322. Wiley.
Robertson, C. T. & Kesselheim, A. S. (2016) Blinding as a solution to bias: Strengthening biomedical science, forensic science, and law. Academic.


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed