Skip to main content
×
×
Home

Increasing the Credibility of Political Science Research: A Proposal for Journal Reforms

  • Brendan Nyhan (a1)
Abstract
Copyright
References
Hide All
American Economic Journal: Applied Economics. n.d. “Editorial Policy.” Available atwww.aeaweb.org/aej/app/edpolicy.php (accessed February 7, 2014).
American Economic Review. n.d. “The American Economic Review: Data Availability Policy.” Available atwww.aeaweb.org/aer/data.php (accessed February 6, 2014).
American Journal of Political Science. n.d. “Guidelines for Accepted Articles.” Available athttp://ajps.org/guidelines-for-accepted-articles (accessed February 6, 2014).
APSA Committee on Professional Ethics, Rights, and Freedoms. 2012. “A Guide to Professional Ethics in Political Science.” Second edition. Available athttp://www.apsanet.org/files/Publications/APSAEthicsGuide2012.pdf (accessed April, 2015).
Baicker, Katherine, Taubman, Sarah L., Allen, Heidi L., Bernstein, Mira, Gruber, Jonathan H., Newhouse, Joseph P., Schneider, Eric C., et al. 2013. “The Oregon Experiment: Effects of Medicaid on Clinical Outcomes.” New England Journal of Medicine 368 (18): 1713–22.
Beger, Andreas. 2014. “The Coup in Thailand and Progress in Forecasting.” Predictive Heuristics. May 22. Available athttp://predictiveheuristics.com/2014/05/22/the-coup-in-thailand-and-progress-in-forecasting (accessed June 13, 2014).
Button, Katherine S., Ioannidis, John P. A., Mokrysz, Claire, Nosek, Brian A., Flint, Jonathan, Robinson, Emma S. J., and Munafò, Marcus R.. 2013. “Power Failure: Why Small Sample Size Undermines the Reliability of Neuroscience.” Nature Reviews Neuroscience 14: 365–76.
Cahoy, Daniel R. 2010. “Editor’s Corner: Assembling a Special Issue on Law as a Source of Strategic Advantage.” American Business Law Journal 47 (4): vviii.
Casey, Katherine, Glennerster, Rachel, and Miguel, Edward. 2012. “Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan.” Quarterly Journal of Economics 127 (4): 1755–812.
Ceci, Stephen J., and Williams, Wendy M.. 2011. “Understanding Current Causes of Women’s Underrepresentation in Science.” Proceedings of the National Academy of Sciences 108 (8): 3157–62.
Chambers, Christopher D. 2013. “Registered Reports: A New Publishing Initiative at Cortex.” Cortex 49 (3): 609–10.
Chambers, Christopher D., Feredoes, Eva, Muthukumaraswamy, Suresh D., and Etchells, Peter J.. 2014. “Instead of ‘Playing the Game,’ It Is Time to Change the Rules: Registered Reports at AIMS Neuroscience and Beyond.” AIMS Neuroscience 1 (1): 417.
De Gregory, Jamie. 2004. “Medical Journals Start Granting CME Credit for Peer Review.” Science Editor 27 (6): 190–1.
Dewald, William G., Thursby, Jerry G., and Anderson, Richard G.. 1986. “Replication in Empirical Economics: The Journal of Money, Credit and Banking Project.” American Economic Review 76 (4): 587603.
Donnellan, M. Brent, Lucas, Richard E., and Cesario, Joseph. 2015. “On the Association between Loneliness and Bathing Habits: Nine Replications of Bargh and Shalev (2012) Study.” Emotion 15 (1): 109–19.
Doucouliagos, Chris. 2005. “Publication Bias in the Economic Freedom and Economic Growth Literature.” Journal of Economic Surveys 19 (3): 367–87.
Dwan, Kerry, Gamble, Carrol, Williamson, Paula R., and Kirkham, Jamie J.. 2013. “Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias: An Updated Review.” PLOS One 8 (7): e66844.
Esarey, Justin, and Wu, Ahra. n.d. “The Fault in Our Stars: Measuring and Correcting Significance Bias in Political Science.” Unpublished manuscript.
Ethics. n.d. “What Should I Expect Once I’ve Submitted?” Available atwww.press.uchicago.edu/journals/et/afterSubmission.html?journal=et (accessed February 6, 2014).
Fanelli, Daniele. 2012. “Negative Results Are Disappearing from Most Disciplines and Countries.” Scientometrics 90 (3): 891904.
Ferguson, Christopher J., and Heene, Moritz. 2012. “A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null.” Perspectives on Psychological Science 7 (6): 555–61.
Findley, Michael, Jensen, Nathan, Malesky, Edmund, and Pepinsky, Thomas. 2014. “Call for Papers: Special Issue of Comparative Political Studies on Research Transparency in the Social Sciences.” Available atwww.ipdutexas.org/cps-transparency-special-issue.html (accessed June 11, 2014).
Finkelstein, Amy, and Baicker, Katherine. n.d. “Oregon Health Insurance Experiment: Analysis Plans.” Available atwww.nber.org/oregon/documents.html (accessed February 5, 2014).
Finkelstein, Amy, Taubman, Sarah, Wright, Bill, Bernstein, Mira, Gruber, Jonathan, Newhouse, Joseph P., Allen, Heidi, Baicker, Katherine, and Oregon Health Study Group. 2012. “The Oregon Health Insurance Experiment: Evidence from the First Year.” Quarterly Journal of Economics 127 (3): 1057–106.
Gerber, Alan S., and Malhotra, Neil. 2008a. “Do Statistical Reporting Standards Affect What Is Published? Publication Bias in Two Leading Political Science Journals.” Quarterly Journal of Political Science 3: 313–26.
Gerber, Alan S., and Malhotra, Neil. 2008b. “Publication Bias in Empirical Sociological Research: Do Arbitrary Significance Levels Distort Published Results?” Sociological Methods & Research 37 (1): 330.
Gerber, Alan S., Malhotra, Neil, Dowling, Conor M., and Doherty, David. 2010. “Publication Bias in Two Political Behavior Literatures.” American Politics Research 38 (4): 591613.
Glandon, Philip. 2010. “Report on the American Economic Review Data Availability Compliance Project.” Unpublished manuscript.
Glymour, M. Maria, and Kawachi, Ichiro. 2005. “Review of Publication Bias in Studies on Publication Bias: Here’s a Proposal for Editors That May Help Reduce Publication Bias.” British Medical Journal 331 (7517): 638.
Green, Don, Humphreys, Macartan, and Smith, Jenny. n.d. “Read It, Understand It, Believe It, Use It: Principles and Proposals for a More Credible Research Publication.” Unpublished manuscript.
Greve, Werner, Bröder, Arndt, and Erdfelder, Edgar. 2013. “Result-Blind Peer Reviews and Editorial Decisions.” European Psychologist 18 (4): 19.
Grossman, Guy, and Pierskalla, Jan H.. n.d. “The Effects of Administrative Unit Proliferation on Service Delivery.” Unpublished manuscript.
Hanson, Robin. 2010. “Result Blind Review.” November 6. Available atwww.overcomingbias.com/2010/11/results-blind-peer-review.html (accessed January 28, 2014).
Humphreys, Macartan, Sierra, Raul Sanchez de la, and Windt, Peter van der. 2013. “Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration.” Political Analysis 21 (1): 120.
Ioannidis, John P. A. 2005. “Why Most Published Research Findings Are False.” PLOS Medicine 2 (8): e124.
Ioannidis, John P. A. 2012. “Why Science Is Not Necessarily Self-Correcting.” Perspectives on Psychological Science 7 (6): 645–54.
Ishiyama, John. 2014. “Replication, Research Transparency, and Journal Publications: Individualism, Community Models, and the Future of Replication Studies.” PS: Political Science and Politics 47 (01): 7883.
King, Gary. 1995. “Replication, Replication.” PS: Political Science and Politics 28 (3): 444–52.
King, Gary. 2006. “Publication, Publication.” PS: Political Science and Politics 39 (1): 119–25.
Laitin, David D. 2013. “Fisheries Management.” Political Analysis 21 (1): 42–7.
Lupia, Arthur, and Elman, Colin. 2014. “Openness in Political Science: Data Access and Research Transparency.” PS: Political Science and Politics 47 (01): 1942.
Masicampo, E. J., and Lalande, Daniel R.. 2012. “A Peculiar Prevalence of p Values Just Below 0.05.” Quarterly Journal of Experimental Psychology 65 (11): 2271–9.
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., et al. 2014. “Promoting Transparency in Social Science Research.” Science 343 (6166): 30–1.
Mind. n.d. “Review Procedure.” Available atwww.oxfordjournals.org/our_journals/mind/review_procedure.html (accessed February 6, 2014).
Monogan, James E. 2013. “A Case for Registering Studies of Political Outcomes: An Application in the 2010 House Elections.” Political Analysis 21 (1): 2137.
Montgomery, Jacob, and Nyhan, Brendan. 2010. “Bayesian Model Averaging: Theoretical Developments and Practical Applications.” Political Analysis 18 (2): 245–70.
Moss-Racusin, Corinne A., Dovidio, John F., Brescoll, Victoria L., Graham, Mark J., and Handelsman, Jo. 2012. “Science Faculty’s Subtle Gender Biases Favor Male Students.” Proceedings of the National Academy of Sciences 109 (41): 16474–9.
Nosek, Brian A., and Lakens, Daniel. 2014. “Registered Reports: A Method to Increase the Credibility of Published Results.” Social Psychology 45 (3): 137–41.
Nyhan, Brendan. 2012a. “Academic Reforms: A Four-Part Proposal.” April 16. Available atwww.brendan-nyhan.com/blog/2012/04/academic-reforms-a-four-part-proposal.html (accessed February 6, 2014).
Nyhan, Brendan. 2012b. “More on Pre-Accepted Academic Articles.” April 27. Available atwww.brendan-nyhan.com/blog/2012/04/more-on-pre-accepted-academic-articles.html (accessed February 6, 2014).
Nyhan, Brendan, Sides, John, and Tucker, Joshua A.. 2015. “APSA as Amplifier: How to Encourage and Promote Public Voices within Political Science.” PS: Political Science and Politics 48(Special Issue): this issue.
Perspectives on Psychological Science. n.d. “Registered Replication Reports.” Available atwww.psychologicalscience.org/index.php/replication (accessed February 5, 2014).
Publications Planning Ad Hoc Committee. 2014. “Report to APSA Council.” PS: Political Science and Politics 47 (1): 246–56.
Quarterly Journal of Political Science. n.d. “Author Instructions.” Available athttp://nowpublishers.com/journals/QJPS/author-instructions (accessed June 13, 2014).
Ritchie, Stuart J., Wiseman, Richard, and French, Christopher C.. 2012. “Failing the Future: Three Unsuccessful Attempts to Replicate Bem’s ‘Retroactive Facilitation of Recall’ Effect.” PLOS One 7 (3): e33423.
Ross, Joseph S., Gross, Cary P., Desai, Mayur M., Hong, Yuling, Grant, Augustus O., Daniels, Stephen R., Hachinski, Vladimir C., et al. 2006. “Effect of Blinded Peer Review on Abstract Acceptance.” Journal of the American Medical Association 295 (14): 1675–80.
Said, Chris. 2012. “It’s the Incentive Structure, People!” Available athttp://filedrawer.wordpress.com/2012/04/17 (accessed February 5, 2014).
Simmons, Joseph P., Nelson, Leif D., and Simonsohn, Uri. 2011. “False-Positive Psychology Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant.” Psychological Science 22 (11): 1359–66.
Simonsohn, Uri, Nelson, Leif, and Simmons, Joseph. 2013. P-Curve: A Key to the File Drawer.” Journal of Experimental Psychology: General 143 (2): 534–47.
Smulders, Yvo M. 2013. “A Two-Step Manuscript Submission Process Can Reduce Publication Bias.” Journal of Clinical Epidemiology 66 (9): 946–7.
Sridharan, Lakshmi, and Greenland, Philip. 2009. “Editorial Policies and Publication Bias: The Importance of Negative Studies.” Archives of Internal Medicine 169 (11): 1022–3.
Steinpreis, Rhea E., Anders, Katie A., and Ritzke, Dawn. 1999. “The Impact of Gender on the Review of the Curricula Vitae of Job Applicants and Tenure Candidates: A National Empirical Study.” Sex Roles 41 (7/8): 509–28.
Taubman, Sarah L., Allen, Heidi L., Wright, Bill J., Baicker, Katherine, and Finkelstein, Amy N.. 2014. “Medicaid Increases Emergency-Department Use: Evidence from Oregon’s Health Insurance Experiment.” Science 343 (6168): 263–8.
Ulfelder, Jay. 2014. “Coup Forecasts for 2014.” Dart-Throwing Chimp, January 25. Available athttp://dartthrowingchimp.wordpress.com/2014/01/25/coup-forecasts-for-2014 (accessed June 13, 2014).
Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., and Kievit, Rogier A.. 2012. “An Agenda for Purely Confirmatory Research.” Perspectives on Psychological Science 7 (6): 632–8.
Wennerås, Christine, and Wold, Agnes. 1997. “Nepotism and Sexism in Peer Review.” Nature 387:341–3.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

PS: Political Science & Politics
  • ISSN: 1049-0965
  • EISSN: 1537-5935
  • URL: /core/journals/ps-political-science-and-politics
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 7
Total number of PDF views: 140 *
Loading metrics...

Abstract views

Total abstract views: 3669 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 26th September 2018. This data will be updated every 24 hours.