Hostname: page-component-7c8c6479df-7qhmt Total loading time: 0 Render date: 2024-03-17T11:50:26.724Z Has data issue: false hasContentIssue false

Data replication matters to an underpowered study, but replicated hypothesis corroboration counts

Published online by Cambridge University Press:  27 July 2018

Erich H. Witte
Affiliation:
Institute for Psychology, University of Hamburg, 20146 Hamburg, Germany. witte_e_h@uni-hamburg.dehttps://www.psy.uni-hamburg.de/personen/prof-im-ruhestand/witte-erich.html
Frank Zenker
Affiliation:
Departments of Philosophy and Cognitive Science, Lund University, SE-221 00 Lund, Sweden. frank.zenker@fil.lu.sehttp://www.fil.lu.se/en/person/FrankZenker/

Abstract

Before replication becomes mainstream, the potential for generating theoretical knowledge better be clear. Replicating statistically significant nonrandom data shows that an original study made a discovery; replicating a specified theoretical effect shows that an original study corroborated a theory. Yet only in the latter case is replication a necessary, sound, and worthwhile strategy.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bakker, M., van Dijk, A. & Wicherts, J. M. (2012) The rules of the game called psychological science. Perspectives on Psychological Science 7(6):543–54. Available at: http://doi.org/10.1177/1745691612459060.Google Scholar
Fayant, M. P., Sigall, H., Lemonnier, A., Retsin, E. & Alexopoulos, T. (2017) On the limitations of manipulation checks: An obstacle toward cumulative science. International Review of Social Psychology 30(1):125–30. Available at: https://doi.org/10.5334/irsp.102.Google Scholar
Hagger, M. S., Chatzisarantis, N. L. D., Alberts, H., Anggono, C. O., Batailler, C., Birt, A. R., Brand, R., Brandt, M. J., Brewer, G., Bruyneel, S., Calvillo, D. P., Campbell, W. K., Cannon, P. R., Carlucci, M., Carruth, N. P., Cheung, T., Crowell, A., De Ridder, D. T. D., Dewitte, S., Elson, M., Evans, J. R., Fay, B. A., Fennis, B. M, Finley, A., Francis, Z., Heise, E., Hoemann, H., Inzlicht, M., Koole, S. L., Koppel, L., Kroese, F., Lange, F., Lau, K., Lynch, B. P., Martijn, C., Merckelbach, H., Mills, N. V., Michirev, A., Miyake, A., Mosser, A. E., Muise, M., Muller, D., Muzi, M., Nalis, D., Nurwanti, R., Otgaar, H, Philipp, M. C., Primoceri, P., Rentzsch, K., Ringos, L., Schlinkert, C., Schmeichel, B. J., Schoch, S. F., Schrama, M., Schütz, A., Stamos, A., Tinghög, G., Ullrich, J., vanDellen, M., Wimbarti, S., Wolff, W., Yusainy, C., Zerhouni, O. & Zwienenberg, M. (2016) A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science 11(4):546–73.Google Scholar
Lakatos, I. (1978) The methodology of scientific research programs, vol. I. Cambridge University Press.Google Scholar
Lord, F. M. & Novick, M. R. (1968) Statistical theories of mental test scores. Addison-Wesley.Google Scholar
Open Science Collaboration (2015) Estimating the reproducibility of psychological science. Science 349(6251):aac4716. Available at: http://doi.org/10.1126/science.aac4716.Google Scholar
Wald, A. (1947) Sequential analysis. Wiley.Google Scholar
Witte, E. H. & Melville, P. (1982) Experimentelle Kleingruppenforschung: Methodologische Anmerkungen und eine empirische Studie. [Experimental small group research: Methodological remarks and an empirical study.] Zeitschrift für Sozialpsychologie 13:109–24.Google Scholar
Witte, E. H. & Zenker, F. (2016a) Reconstructing recent work on macro-social stress as a research program. Basic and Applied Social Psychology 38(6):301307.Google Scholar
Witte, E. H. & Zenker, F. (2016b) Beyond schools – reply to Marsman, Ly & Wagenmakers. Basic and Applied Social Psychology 38(6):313–17.Google Scholar
Witte, E. H. & Zenker, F. (2017a) Extending a multilab preregistered replication of the ego-depletion effect to a research program. Basic and Applied Social Psychology 39(1):7480.Google Scholar
Witte, E. H. & Zenker, F. (2017b) From discovery to justification. Outline of an ideal research program in empirical psychology. Frontiers in Psychology 8:1847. Available at: https://www.frontiersin.org/articles/10.3389/fpsyg.2017.01847/full.Google Scholar