Hostname: page-component-76fb5796d-qxdb6 Total loading time: 0 Render date: 2024-04-29T07:44:33.492Z Has data issue: false hasContentIssue false

An Empirical Justification for the Use of Draft Lottery Numbers as a Random Treatment in Political Science Research

Published online by Cambridge University Press:  04 January 2017

Adam J. Berinsky
Affiliation:
Department of Political Science, Massachusetts Institute of Technology, 77 Mass Ave, E53-457, Cambridge, MA 02139. e-mail: berinsky@mit.edu
Sara Chatfield*
Affiliation:
Postdoctoral Associate, Department of Political Science, Massachusetts Institute of Technology, 77 Mass Ave, E53-457, Cambridge, MA 02139
*
e-mail: sarachat@mit.edu (corresponding author)
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Over the past several years, there has been growing use of the draft lottery instrument to study political attitudes and behaviors (see, e.g., Bergan 2009; Erikson and Stoker 2011; Henderson 2012; Davenport 2015). Draft lotteries, held in the United States from 1969 to 1972, provide a potentially powerful design; in theory, they should provide true randomization for the “treatment” of military service or behavioral reactions to the threat of such service. However, the first draft lottery conducted in 1969 was not conducted in a random manner, giving those citizens born in the fourth quarter of the year disproportionately higher chances of being drafted. In this note, we describe the randomization failure and discuss how this failure could in theory compromise the use of draft lottery numbers as an instrumental variable. We then use American National Election Studies data to provide support for the conclusion that individuals most affected by the randomization failure (those born in the fourth quarter of the year) largely do not look statistically distinct from those born at other times of the year. With some caveats, researchers should be able to treat the 1969 draft numbers as if they were assigned at random. We also discuss broader lessons to draw from this example, both for scholars interested in using the draft lottery as an instrumental variable, and for researchers leveraging other instruments with randomization failures. Specifically, we suggest that scholars should pay particular attention to the sources of randomization failure, sample attrition, treatment and dependent variable selection, and possible failure of the exclusion restriction, and we outline ways in which these problems may apply to the draft lottery instrument and other natural experiments.

Type
Letters
Copyright
Copyright © The Author 2015. Published by Oxford University Press on behalf of the Society for Political Methodology 

Footnotes

Authors' note: We thank Mike Sances and Seth Dickinson for helpful comments. Supplementary materials for this article are available on the Political Analysis Web site. Replication data are available at the Harvard Dataverse: see Berinsky and Chatfield (2015) at http://dx.doi.org/10.7910/DVN/4K4VTC.

References

Angrist, Joshua D. 1990. Lifetime earnings and the Vietnam era draft lottery: Evidence from Social Security Administration Records. American Economic Review 80(3): 313–36.Google Scholar
Angrist, Joshua D., and B Krueger, Alan. 1991. Does compulsory school attendance affect schooling and earnings? Quarterly Journal of Economics 106(4): 9791014.Google Scholar
Bergan, Daniel E. 2009. The draft lottery and attitudes towards the Vietnam War. Public Opinion Quarterly 73(2): 379–84.Google Scholar
Berinsky, Adam, and Chatfield, Sara. 2015. Replication data for: An empirical justification for the use of draft lottery numbers as a random treatment in political science research .doi.org/10.7910/DVN/4K4VTC, Harvard Dataverse, V1.Google Scholar
Buckles, Kasey, and Hungerman, Daniel M. 2013. Season of birth and later outcomes: Old questions, new answers. Review of Economics and Statistics 95(3): 711–24.Google Scholar
Davenport, Tiffany C. 2015. Policy-induced risk and responsive participation: The effect of a son's conscription risk on the voting behavior of his parents. American Journal of Political Science 59(1): 225241.Google Scholar
Dunning, Thad. 2010. Design-based inference: Beyond the pitfalls of regression analysis? In Rethinking social inquiry, eds. Brady, Henry E. and Collier, David. Lanham, MD: Rowman and Littlefield.Google Scholar
Dunning, Thad. 2012. Natural experiments in the social sciences: A design-based approach. Cambridge: Cambridge University Press.Google Scholar
Erikson, Robert, and Stoker, Laura. 2011. Caught in the draft: The effects of Vietnam draft lottery status on political attitudes. American Political Science Review 105(2): 221–37.Google Scholar
Fienberg, Stephen E. 1971. Randomization and social affairs: The 1970 draft lottery. Science 171(3968): 255–61.Google Scholar
Henderson, John. 2012. Demobilizing a generation: The behavioral effects of the Vietnam draft lottery. Working Paper. http://www.jahenderson.com/research [Accessed July 14, 2014].Google Scholar
Kreuger, Alan B., and Zhu, Pei. 2004. Another look at the New York City school voucher experiment. American Behavioral Scientist 47(5): 658–98.Google Scholar
Sovey, Allison J., and Green, Donald P. 2011. Instrumental variables estimation in political science: A reader's guide. American Journal of Political Science 55(1): 188200.Google Scholar
Supplementary material: PDF

Berinsky and Chatfield supplementary material

Appendix

Download Berinsky and Chatfield supplementary material(PDF)
PDF 98.3 KB