Skip to main content Accessibility help
×
Hostname: page-component-8448b6f56d-mp689 Total loading time: 0 Render date: 2024-04-19T18:30:55.675Z Has data issue: false hasContentIssue false

34 - Analyzing the Downstream Effects of Randomized Experiments

Published online by Cambridge University Press:  05 June 2012

Rachel Milstein Sondheimer
Affiliation:
United States Military Academy
James N. Druckman
Affiliation:
Northwestern University, Illinois
Donald P. Greene
Affiliation:
Yale University, Connecticut
James H. Kuklinski
Affiliation:
University of Illinois, Urbana-Champaign
Arthur Lupia
Affiliation:
University of Michigan, Ann Arbor
Get access

Summary

The work in this volume provides profound evidence of the value of randomized experimentation in political science research. Laboratory and field experiments can open up new fields for exploration, shed light on old debates, and answer questions previously believed to be intractable. Although acknowledgment of the value of experimentation in political science is becoming more commonplace, significant criticisms remain. The oft-repeated shortcomings of experimental research tend to center on the practical and ethical limitations of randomized interventions. I begin this chapter by detailing some of these criticisms and then explore one means of extending the value of randomized interventions beyond their original intent to ameliorate some of these same perceived limitations.

One of the most prominent critiques of this genre is that randomized experiments tend to be overly narrow in scope in terms of time frame and subject matter, as well as high in cost. Although short-term experiments may incur costs similar to observational research, they often focus on a single or just a few variations in an independent variable, seemingly limiting their applicability to a breadth of topics that a survey could cover. The high cost associated with long-term data collection and the necessity of maintaining contact with the subjects involved impedes the likelihood of gathering information on long-term outcomes. There are also few incentives to conduct interventions in which the impacts may only be determined years down the road.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

,American Psychological Association. 2003. Ethical Principles of Psychologists and Codes of Conduct. Washington, DC: American Psychological Association.Google Scholar
Angrist, Joshua D., Imbens, Guido W., and Rubin, Donald B.. 1996. “Identification of Causal Effects Using Instrumental Variables.” Journal of the American Statistical Association 91: 444–55.CrossRefGoogle Scholar
Angrist, Joshua D., and Krueger, Alan B.. 2001. “Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments.” Journal of Economic Perspectives 15: 69–85.CrossRefGoogle Scholar
Berelson, Bernard, Lazarsfeld, Paul F., and McPhee, William N.. 1954. Voting: A Study of Opinion Formation in a Presidential Campaign. Chicago: The University of Chicago Press.Google Scholar
Bhavnani, Rikhil R. 2009. “Do Electoral Quotas Work after They Are Withdrawn? Evidence from a Natural Experiment in India.” American Political Science Review 103: 23–35.CrossRefGoogle Scholar
Campbell, Angus, Converse, Philip E., Miller, Warren E., and Stokes, Donald E.. 1960. The American Voter. New York: Wiley.Google Scholar
Converse, Philip E. 1972. “Change in the American Electorate.” In The Human Meaning of Social Change, eds. Angus Campbell and Philip E. Converse. New York: Russell Sage Foundation, 263-337.Google Scholar
Davenport, Tiffany C., Gerber, Alan S., Green, Donald P., Larimer, Christopher W., Mann, Christopher B., and Panagopoulos, Costas. 2010. “The Enduring Effects of Social Pressure: Tracking Campaign Experiments over a Series of Elections.” Political Behavior 32: 423–30.CrossRefGoogle Scholar
Carpini, Delli, Michael, X., and Keeter, Scott. 1996. What Americans Know about Politics and Why It Matters. New Haven, CT: Yale University Press.Google Scholar
Gay, Claudine. 2010. “Moving to Opportunity: The Political Effects of a Housing Mobility Experiment.” Working paper, Harvard University.
Gerber, Alan S., Green, Donald P., and Shacher, Ron. 2003. “Voting May Be Habit-Forming: Evidence from a Randomized Field Experiment.” American Journal of Political Science 27: 540–50.CrossRefGoogle Scholar
Green, Donald P., and Gerber, Alan S.. 2002. “The Downstream Benefits of Experimentation.” Political Analysis 10: 394–402.CrossRefGoogle Scholar
Imbens, Guido W., and Angrist, Joshua D.. 1994. “Identification and Estimation of Local Average Treatment Effects.” Econometrica 62: 467–75.CrossRefGoogle Scholar
Imbens, Guido W., and Rubin, Donald B.. 1997. “Bayesian Inference for Causal Effects in Randomized Experiments with Noncompliance.” Annals of Statistics 25: 305–27.Google Scholar
Kam, Cindy, and Palmer, Carl L.. 2008. “Reconsidering the Effects of Education on Civic Participation.” Journal of Politics 70: 612–31.CrossRefGoogle Scholar
Katz, Lawrence F., Kling, Jeffery R., and Liebman, Jeffery B.. 2001. “Moving to Opportunity in Boston: Early Results of a Randomized Mobility Experiment.” Quarterly Journal of Economics 116: 607–54.CrossRefGoogle Scholar
Kellermann, Michael, and Shepsle, Kenneth A.. 2009. “Congressional Careers, Committee Assignments, and Seniority Randomization in the US House of Representatives.” Quarterly Journal of Political Science 4: 87–101.CrossRefGoogle Scholar
Leventhal, Tama, and Brooks-Gunn, Jeanne. 2003. “Moving to Opportunity: An Experimental Study of Neighborhood Effects on Mental Health.” American Journal of Public Health 93: 1576–82.CrossRefGoogle ScholarPubMed
Ludwig, Jens, Duncan, Greg J., and Hirschfield, Paul. 2001. “Urban Poverty and Juvenile Crime: Evidence from a Randomized Housing-Mobility Experiment.” Quarterly Journal of Economics 116: 655–79.CrossRefGoogle Scholar
Milgram, Stanley. 1974. Obedience to Authority: An Experimental View. New York: Harper & Row.Google Scholar
Miller, Warren E., and Shanks, J. Merrill. 1996. The New American Voter. Cambridge, MA:Harvard University Press.Google Scholar
Nie, Norman H., Junn, Jane, and Stehlik-Barry, Kenneth. 1996. Education and Democratic Citizenship in America. Chicago: The University of Chicago Press.Google Scholar
Peffley, Mark, and Hurwitz, Jon. 2007. “Persuasion and Resistance: Race and the Death Penalty in America.” American Journal of Political Science 51: 996–1012.CrossRefGoogle Scholar
Rosenstone, Steven J., and Hansen, John Mark. 1993. Mobilization, Participation, and Democracy in America. New York: Macmillan.Google Scholar
Rosenzweig, Mark R., and Wolpin, Kenneth I.. 2000. “Natural ‘Natural Experiments’ in Economics.” Journal of Economic Literature 38: 827–74.CrossRefGoogle Scholar
Sanbonmatsu, Lisa, Kling, Jeffery R., Duncan, Greg J., and Brooks-Gunn, Jeanne. 2006. “Neighborhoods and Academic Achievement: Results from the Moving to Opportunity Experiment.” Journal of Human Resources XLI: 649–91.CrossRefGoogle Scholar
Schweinhart, L. J., Barnes, Helen V., and Weikart, David P.. 1993. Significant Benefits: The High-Scope Perry Preschool Study through Age 27. Monographs of the High/Scope Educational Research Foundation, vol. 10. Ypsilanti, MI: High/Scope Press.Google Scholar
Sondheimer, Rachel Milstein, and Green, Donald P.. 2010. “Using Experiments to Estimate the Effects of Education on Voter Turnout.” American Journal of Political Science 54: 174–89.CrossRefGoogle Scholar
Sovey, Allison J., and Green, Donald P.. 2011. “Instrumental Variables Estimation in Political Science: A Reader's Guide.” American Journal of Political Science 55: 188–200.CrossRef
Stock, James H., and Watson, Mark W.. 2007. Introduction to Econometrics. 2nd ed. Boston: Pearson Addison Wesley.Google Scholar
Tenn, Steven. 2007. “The Effect of Education on Voter Turnout.” Political Analysis 15: 446–64.CrossRefGoogle Scholar
Verba, Sidney, and Nie, Norman H.. 1972. Participation in America: Political Democracy and Social Equality. New York: Harper & Row.Google Scholar
Wolfinger, Raymond E., and Rosenstone, Steven J.. 1980. Who Votes?New Haven, CT: Yale University Press.Google Scholar
Wooldridge, Jeffrey M. 2009. Introductory Econometrics: A Modern Approach. 4th ed. Mason, OH: South-Western Cengage Learning.Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×