Skip to main content Accessibility help
×
Home

Testing for Publication Bias in Political Science

  • Alan S. Gerber (a1), Donald P. Green (a1) and David Nickerson (a1)

Abstract

If the publication decisions of journals are a function of the statistical significance of research findings, the published literature may suffer from “publication bias.” This paper describes a method for detecting publication bias. We point out that to achieve statistical significance, the effect size must be larger in small samples. If publications tend to be biased against statistically insignificant results, we should observe that the effect size diminishes as sample sizes increase. This proposition is tested and confirmed using the experimental literature on voter mobilization.

Copyright

References

Hide All
Adams, William C., and Smith, Dennis J. 1980. “Effects of Telephone Canvassing on Turnout and Preferences: A Field Experiment.” Public Opinion Quarterly 44 (Autumn): 389395.
Begg, C. B. 1985. “A Measure to Aid in the Interpretation of Published Clinical Trials.” Statistics in Medicine 4: 19.
Begg, C. B. 1994. “Publication Bias.” In The Handbook of Research Synthesis, eds. Cooper, H. and Hedges, L. V. New York: Russell Sage Foundation.
Begg, C. B., and Berlin, J. A. 1988. “Publication Bias: A Problem in Interpreting Medical Data.” Journal of the Royal Statistical Society Series B 151: 419463.
Berlin, J. A., Begg, C. B., and Louis, T. A. 1989. “An Assessment of Publication Bias Using a Sample of Published Clinical Trials.” Journal of the American Statistical Association 84: 381392.
Chalmers, I., Hetherington, J., Newdick, M., Mutch, L., Grant, A., Enkin, E., and Dickersin, K. 1986. “The Oxford Database of Perinatal Trials: Developing a Register of Published Reports of Controlled Trials.” Controlled Clinical Trials 7: 306324.
Coursol, A., and Wagner, E. 1986. “Effect of Positive Findings on Submission and Acceptance Rates: A Note on Meta-Analysis Bias.” Professional Psychology 17: 136137.
DeLong, J. B., and Lang, K. 1992. “Are All Economic Hypotheses False?Journal of Political Economy 100: 12571272.
Dickersin, K. 1990. “The Existence of Publication Bias and Risk Factors for Its Occurrence.” Journal of the American Medical Association 263: 13851389.
Eldersveld, Samuel J. 1956. “Experimental Propaganda Techniques and Voting Behavior.” American Political Science Review 50 (Mar.): 154165.
Gerber, Alan S., and Green, Donald P. 2000. “The Effects of Canvassing, Direct Mail, and Telephone Contact on Voter Turnout: A Field Experiment.” American Political Science Review 94 (Sept.): 653663.
Greene, William H. 1997. Econometric Analysis, 3rd ed. Upper Saddle River, NJ: Simon and Schuster.
Greenwald, A. G. 1975. “Consequences of Prejudice Against the Null Hypothesis.” Psychological Bulletin 82: 112.
Iyengar, S., and Greenhouse, J. B. 1988. “Selection Models and the File Drawer Problem.” Statistical Science 3: 9135.
Light, R. J., and Pillemer, D. B. 1984. Summing Up: The Science of Reviewing Research. Cambridge, MA: Harvard University Press.
Mahoney, M. J. 1977. “Publication Prejudices: An Experimental Study of Confirmatory Bias in the Peer Review System.” Cognitive Therapy Research 1: 161175.
Miller, Roy E., Bositis, David A., and Baer, Denise L. 1981. “Stimulating Voter Turnout in a Primary: Field Experiment with a Precinct Committeeman.” International Political Science Review 2(4): 445460.
Sigelman, Lee. 1999. “Publication Bias Reconsidered.” Political Analysis 8: 201210.
Simes, R. J. 1986. “Publication Bias: The Case for an International Registry of Clinical Trials.” Journal of Clinical Oncology 4: 15291541.
MathJax
MathJax is a JavaScript display engine for mathematics. For more information see http://www.mathjax.org.

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed