Skip to main content Accessibility help
×
Home
Hostname: page-component-768dbb666b-v9bzm Total loading time: 0.283 Render date: 2023-02-05T13:58:28.005Z Has data issue: true Feature Flags: { "useRatesEcommerce": false } hasContentIssue true

Reference Rot: An Emerging Threat to Transparency in Political Science

Published online by Cambridge University Press:  03 January 2017

Aaron L. Gertler
Affiliation:
Independent Scholar
John G. Bullock
Affiliation:
University of Texas at Austin

Abstract

Transparency of research is a large concern in political science, and the practice of publishing links to datasets and other online resources is one of the main methods by which political scientists promote transparency. But the method cannot work if the links don’t, and very often, they don’t. We show that most of the URLs ever published in the American Political Science Review no longer work as intended. The problem is severe in recent as well as in older articles; for example, more than one-fourth of links published in the APSR in 2013 were broken by the end of 2014. We conclude that “reference rot” limits the transparency and reproducibility of political science research. We also describe practices that scholars can adopt to combat the problem: when possible, they should archive data in trustworthy repositories, use links that incorporate persistent digital identifiers, and create archival versions of the webpages to which they link.

Type
Articles
Copyright
Copyright © American Political Science Association 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Ainsworth, Scott G., Nelson, Michael L., and Sompel, Herbert Van de. 2015. “Only One Out of Five Archived Web Pages Existed as Presented.” Presented at the Annual Meeting of the ACM Conference on Hypertext and Social Media, Cyprus. http://dx.doi.org/10.1145/2700171.2791044 (accessed April 30, 2016).CrossRef
Altman, Micah and King, Gary. 2007. “A Proposed Standard for the Scholarly Citation of Quantitative Data.” D-Lib Magazine 13 (March-April).
Askitas, Nikos. 2010 June. “What Makes Persistent Identifiers Persistent?” German Data Forum. Manuscript. http://ssrn.com/abstract=1639996 (accessed July 26, 2015). Archived at http://perma.cc/S3FJ-NKZG.
Center for Research Libraries. 2006. “ICPSR Audit Report.” http://www.crl.edu/sites/ default/files/d6/attachments/pages/ICPSR_final.pdf (accessed August 27, 2015). Archived at http://perma.cc/H47N-MJUA.
Dafoe, Allan. 2014. “Science Deserves Better: The Imperative to Share Complete Replication Files.” PS: Political Science & Politics 47 (1): 6066.Google Scholar
Data Access and Research Transparency. 2014. “Data Access and Research Transparency (DA-RT): A Joint Statement by Political Science Journal Editors.” http://media.wix.com/ugd/fa8393_da017d3fed824cf587932534c860ea25.pdf (accessed August 27, 2015). Archived at http://perma.cc/XTZ7-KGNM.
Data Preservation Alliance for the Social Sciences. 2014. “Memorandum of Understanding.” http://data-pass.org/sites/default/files/Data-PASS_MoU_201504.pdf (accessed August 27, 2015). Archived at http://perma.cc/NS5H-KS5H.
Dimitrova, Daniela V. and Bugeja, Michael. 2007. “The Half-Life of Internet References Cited in Communication Journals.” New Media & Society 9 (5): 811–26.CrossRefGoogle Scholar
Gerber, Alan and Malhotra, Neil. 2008. “Do Statistical Reporting Standards Affect What Is Published?” Quarterly Journal of Political Science 3 (October): 313–26.CrossRefGoogle Scholar
Harvard Dataverse. 2015. “Harvard Dataverse Preservation Policy.” http://best-practices.dataverse.org/harvard-policies/harvard-preservation-policy.html (accessed July 27, 2015). Archived at http://perma.cc/P5DL-KG2Y.
International DOI Foundation. 2015. “DOI System and the Handle System.” http: //www.doi.org/factsheets/DOIHandle.html (accessed August 27, 2015). Archived at http://perma.cc/7A6B-ULML.
Internet Archive. 2015. “Removing Documents from the Wayback Machine.” https://archive.org/about/exclude.php (accessed July 26, 2015). Archived at http://perma. cc/ZY3P-RX45.
King, Gary. 2007. “An Introduction to the Dataverse Network as an Infrastructure for Data Sharing.” Sociological Methods & Research 36 (2): 173–99.CrossRefGoogle Scholar
Lepore, Jill. 2015. “The Cobweb.” The New Yorker, January 26, 3341.Google Scholar
Lupia, Arthur and Elman, Colin. 2014. “Openness in Political Science: Data Access and Research Transparency.” PS: Political Science & Politics 47 (1): 1924.Google Scholar
Monogan, James E III. 2015. “Research Preregistration in Political Science: The Case, Counterarguments, and a Response to Critiques.” PS: Political Science & Politics 48 (3): 425–29.Google Scholar
Van de Sompel, Herbert and Treloar, Andrew. 2014. “A Perspective on Archiving the Scholarly Web.” Proceedings of the 11th International Conference on Digital Preservation. http://public.lanl.gov/herbertv/papers/Papers/2014/iPres2014_Sompel_Treloar.pdf (accessed August 27, 2015). Archived at http://perma.cc/F6QX-KJEU.
Wagner, Cassie, Gebremichael, Meseret D., Taylor, Mary K., and Soltys, Michael J.. 2009. “Disappearing Act: Decay of Uniform Resource Locators in Health Care Management Journals.” Journal of the Medical Library Association 97 (2): 122–30.CrossRefGoogle Scholar
Zittrain, Jonathan, Albert, Kendra, and Lessig, Lawrence. 2014. “Perma: Scoping and Addressing the Problem of Link and Reference Rot in Legal Citations.” Harvard Law Review 127 (February): 176–99.Google Scholar
Supplementary material: PDF

Gertler and Bullock supplementary material

Online Appendix

Download Gertler and Bullock supplementary material(PDF)
PDF 84 KB
7
Cited by

Save article to Kindle

To save this article to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Reference Rot: An Emerging Threat to Transparency in Political Science
Available formats
×

Save article to Dropbox

To save this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about saving content to Dropbox.

Reference Rot: An Emerging Threat to Transparency in Political Science
Available formats
×

Save article to Google Drive

To save this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about saving content to Google Drive.

Reference Rot: An Emerging Threat to Transparency in Political Science
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *