Hostname: page-component-89b8bd64d-x2lbr Total loading time: 0 Render date: 2026-05-10T09:39:27.899Z Has data issue: false hasContentIssue false
  • English
  • Français

Science with or without statistics: Discover-generalize-replicate? Discover-replicate-generalize?

Published online by Cambridge University Press:  10 February 2022

John P.A. Ioannidis Open the ORCID record for John P.A. Ioannidis [Opens in a new window]
John P.A. Ioannidis*
Affiliation:
Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA 94305, USA. jioannid@stanford.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Overstated generalizability (external validity) is common in research. It may coexist with inflation of the magnitude and statistical support for effects and dismissal of internal validity problems. Generalizability may be secured before attempting replication of proposed discoveries or replication may precede efforts to generalize. These opposite approaches may decrease or increase, respectively, the use of inferential statistics with advantages and disadvantages.

Information

Type
Open Peer Commentary
Information
Behavioral and Brain Sciences , Volume 45 , 2022 , e23
Check for updates
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Boutron, I., & Ravaud, P. (2018). Misrepresentation and distortion of research in biomedical literature. Proceedings of the National Academy of Sciences of the USA, 115(11), 2613–2619.CrossRefGoogle ScholarPubMed
Ioannidis, J. P. (2016). Exposure-wide epidemiology: Revisiting Bradford Hill. Statistics in Medicine, 35(11), 1749–1762.CrossRefGoogle ScholarPubMed
Ioannidis, J. P. (2019). The importance of predefined rules and prespecified statistical analyses: Do not abandon significance. JAMA, 321(21), 2067–2068.CrossRefGoogle Scholar
Nosek, B. A., & Errington, T. M. (2020). What is replication? PLoS Biology, 18(3), e3000691.CrossRefGoogle ScholarPubMed
Smaldino, P. E., & McElreath, R. (2016). The natural selection of bad science. Royal Society Open Science, 3(9), 160384.CrossRefGoogle ScholarPubMed