Hostname: page-component-6766d58669-mzsfj Total loading time: 0 Render date: 2026-05-20T09:11:13.110Z Has data issue: false hasContentIssue false
  • English
  • Français

Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008

Part of: PA editors' choice articles

Published online by Cambridge University Press:  04 January 2017

Devin Caughey  and
Jasjeet S. Sekhon
Devin Caughey
Affiliation:
Travers Department of Political Science, University of California, Berkeley, CA 94720-2370
Jasjeet S. Sekhon*
Affiliation:
Travers Department of Political Science, Department of Statistics and Director, Center for Causal Inference and Program Evaluation, Institute of Governmental Studies, University of California, Berkeley, CA 94720-2370
*
e-mail: sekhon@berkeley.edu
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

Following David Lee's pioneering work, numerous scholars have applied the regression discontinuity (RD) design to popular elections. Contrary to the assumptions of RD, however, we show that bare winners and bare losers in U.S. House elections (1942–2008) differ markedly on pretreatment covariates. Bare winners possess large ex ante financial, experience, and incumbency advantages over their opponents and are usually the candidates predicted to win by Congressional Quarterly's pre-election ratings. Covariate imbalance actually worsens in the closest House elections. National partisan tides help explain these patterns. Previous works have missed this imbalance because they rely excessively on model-based extrapolation. We present evidence suggesting that sorting in close House elections is due mainly to activities on or before Election Day rather than postelection recounts or other manipulation. The sorting is so strong that it is impossible to achieve covariate balance between matched treated and control observations, making covariate adjustment a dubious enterprise. Although RD is problematic for postwar House elections, this example does highlight the design's advantages over alternatives: RD's assumptions are clear and weaker than model-based alternatives, and their implications are empirically testable.

Information

Type
Articles
Information
Political Analysis , Volume 19 , Issue 4 , Autumn 2011 , pp. 385 - 408
Copyright
Copyright © The Author 2011. Published by Oxford University Press on behalf of the Society for Political Methodology 

Footnotes

Authors' note: An appendix and supplementary materials for this article are available on the Political Analysis Web site. We thank David Lee for generously providing replication files for Lee (2008). We are grateful to Scott Adler, David Brady, Gary Jacobson, Keith Poole, and Jonathan Wand for sharing their data with us. We thank the editors, the anonymous reviewers, Henry Brady, Andy Eggers, Andrew Gelman, Don Green, Jens Hainmueller, Luke Keele, Winston Lin, Walter Mebane, Jr., Eric Schickler, Laura Stoker, Dan Tokaji, Rocío Titiunik, and Rob Van Houweling for providing helpful comments, and Peter Ryan for helping to shape the project in its formative stages. Willa Caughey, Mona Fang, Julia Gettle, and Sarah Weiner provided excellent research assistance.

References

Albouy, David. 2009. Partisan representation in Congress and the geographic distribution of federal funds. Working paper no. 15224. National Bureau of Economic Research, Cambridge, MA. http://www.nber.org/papers/w15224.Google Scholar
Alvarez, R. Michael, and Hall, Thad E. 2010. Voting technology. In The Oxford handbook of American elections and political behavior, ed. Leighley, Jan E., 219–36. New York: Oxford University Press.Google Scholar
Angrist, Joshua David, and Pischke, Jörn-Steffen. 2009. Mostly harmless econometrics: An empiricist's companion. Princeton, NJ: Princeton University Press.Google Scholar
Angrist, Joshua David, and Pischke, Jörn-Steffen. 2010. The credibility revolution in empirical economics: How better research design is taking the con out of econometrics. Journal of Economic Perspectives 24: 3–30.CrossRefGoogle Scholar
Ansolabehere, Stephen, and Snyder, James M. Jr. 2000. Soft money, hard money, strong parties. Columbia Law Review 100: 598–619.CrossRefGoogle Scholar
Ansolabehere, Stephen, and Snyder, James M. Jr. 2004. Using term limits to estimate incumbency advantages when officeholders retire strategically. Legislative Studies Quarterly 29: 488–515.Google Scholar
Basinger, Scott J., and Lavine, Howard. 2005. Ambivalence, information, and electoral choice. American Political Science Review 99: 169–84.CrossRefGoogle Scholar
Beam, Christopher. 2006. What's ‘Street Money’? Or ‘walking-around money’? Or ‘get-out-the-vote money’? Slate. 2008. http://www.slate.com/id/2202955/ (accessed 8 May 2011).Google Scholar
Benenson, Bob. 2010. Recount. In Elections A to Z. 3rd ed. Washington, DC: CQ Press. http://library.cqpress.com/elections/elaz3d_s472.2.Google Scholar
Benjamini, Y., and Hochberg, Y. 1995. The control of the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B 57: 289–300.Google Scholar
Brady, Henry E., Johnston, Richard, and Sides, John. 2006. The study of political campaigns. In Capturing campaign effects, ed. Brady, Henry E. and Johnston, Richard, 1–26. Ann Arbor: University of Michigan Press.Google Scholar
Brollo, Fernanda, and Nannicini, Tommaso. 2010. Tying your enemy's hands in close races: The politics of federal transfers in Brazil. Working paper no. 358, Innocenzo Gasparini Institute for Economic Research, Università Bocconi. http://www.igier.unibocconi.it/folder.php?vedi=4756&tbn=albero&id_folder=182.Google Scholar
Broockman, David E. 2009. Do congressional candidates have reverse coattails? Evidence from a regression discontinuity design. Political Analysis 17: 418–34.Google Scholar
Butler, Daniel Mark. 2009. A regression discontinuity design analysis of the incumbency advantage and tenure in the U. S. House. Electoral Studies 28: 123–8.Google Scholar
Butler, Matthew J., and Butler, Daniel M. 2006. Splitting the difference? Causal inference and theories of split-party delegations. Political Analysis 14: 439–55.Google Scholar
Cain, Bruce, Ferejohn, John, and Fiorina, Morris. 1987. The personal vote: Constituency service and electoral independence. Cambridge, MA: Harvard University Press.Google Scholar
Campbell, Donald T., and Stanley, Julian C. 1963. Experimental and quasi-experimental designs for research. New York: Houghton-Mifflin.Google Scholar
Campbell, Tracy. 2005. Deliver the vote: A history of election fraud, an American political tradition—1742-2004. New York: Carroll & Graf.Google Scholar
Caro, Robert A. 1990. Means of ascent. The Years of Lyndon Johnson. New York: Vintage Books.Google Scholar
Cellini, Stephanie Riegg, Ferreira, Fernando, and Rothstein, Jesse. 2010. The value of school facility investments: Evidence from a dynamic regression discontinuity design. Quarterly Journal of Economics 125: 215–61.CrossRefGoogle Scholar
Cheng, Ming-Yen, Fan, Jianqing, and Marron, J. S. 1997. On automatic boundary corrections. The Annals of Statistics 25: 1691–708.Google Scholar
Clarke, Peter, and Evans, Susan H. 1983. Covering campaigns: Journalism in congressional elections. Stanford, CA: Stanford University Press.Google Scholar
Cook, Thomas D. 2008. ‘Waiting for Life to Arrive’: A history of the regression-discontinuity design in psychology, statistics and economics. Journal of Econometrics 142: 636–54.Google Scholar
Cook, Thomas D., Shadish, William R., and Wong, Vivian C. 2008. Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management 27: 724–50.CrossRefGoogle Scholar
Cox, Gary W., and Katz, Jonathan N. 1996. Why did the incumbency advantage in U. S. House elections grow? American Journal of Political Science 40: 478–97.Google Scholar
Cox, Gary W., and Katz, Jonathan N. 2002. Elbridge Gerry's salamander: The electoral consequences of the reapportionment revolution. New York: Cambridge University Press.CrossRefGoogle Scholar
Cox, Gary W., and McCubbins, Mathew D. 2005. Setting the agenda: Responsible party government in the U. S. House of Representatives. New York: Cambridge University Press.CrossRefGoogle Scholar
Cox, Gary W., and Munger, Michael C. 1989. Closeness, expenditures, and turnout in the 1982 U. S. House Elections. American Political Science Review 83: 217–31.Google Scholar
DiNardo, John, and Lee, David S. 2004. Economic impacts of new unionization on private sector employers: 1984-2001. Quarterly Journal of Economics 119: 1383–441.Google Scholar
Downs, Timothy, Sautter, Chris, and Young, John Hardin. 1994. The Recount Primer. Sautter Communications. http://www.thekingofsteeltown.com/index.html.Google Scholar
Drucker, David M. 2010. Baucus Sent Staff to Aid Reid in Nevada. Roll Call, November 5, 2010. http://www.rollcall.com/news/-200258-1.html.Google Scholar
Dunning, Thad. 2008. Improving causal inference: Strengths and limitations of natural experiments. Political Research Quarterly 61: 282–93.Google Scholar
Eggers, Andrew C., and Hainmueller, Jens. 2009. MPs for sale? Returns to office in postwar British politics. American Political Science Review 103: 513–33.CrossRefGoogle Scholar
Erikson, Robert S. 1971. The advantage of incumbency in congressional elections. Polity 3: 395–405.Google Scholar
Erikson, Robert, and Palfrey, Thomas. 2000. Equilibria in campaign spending games: Theory and data. American Political Science Review 94: 595–609.CrossRefGoogle Scholar
Erikson, Robert, and Titiunik, Rocío. 2011. Using regression discontinuity to uncover the personal incumbency advantage. Paper presented at the Research Workshop on American Politics, Institute of Governmental Studies, UC Berkeley, May 10, 2011.Google Scholar
Fearon, James D. 1999. Electoral accountability and the control of politicians: Selecting good types versus sanctioning poor performance. In Democracy, accountability, and representation, ed. Przeworski, Adam, Stokes, Susan Carol, and Manin, Bernard. New York: Cambridge University Press.Google Scholar
Feddersen, Timothy, Gailmard, Sean, and Sandroni, Alvaro. 2009. Moral bias in large elections: Theory and experimental evidence. American Political Science Review 103: 175–92.Google Scholar
Ferejohn, John A. 1977. On the decline of competition in congressional elections. American Political Science Review 71: 166–76.Google Scholar
Ferreira, Fernando, and Gyourko, Joseph. 2009. Do political parties matter? Evidence from cities, U. S. Quarterly Journal of Economics 124: 399–422.Google Scholar
Fuji, Daisuke, Imbens, Guido W., and Kalyanaraman, Karthik. 2009. Notes for Matlab and Stata Regression Discontinuity Software. http://www.economics.harvard.edu/faculty/imbens/files/rd_software_09aug4.pdf. Software (rdob, version 10.0).Google Scholar
Gelman, Andrew. 2011. Regression discontinuity designs: looking for the keys under the lamppost? Statistical Modeling, Causal Inference, and Social Science (blog), January 15, 2011, http://andrewgelman.com/2011/01/regression_disc/.Google Scholar
Gelman, Andrew, and King, Gary. 1990. Estimating incumbency advantage without bias. American Journal of Political Science 34: 1142–64.Google Scholar
Gelman, Andrew, and Huang, Zaiying. 2008. Estimating incumbency advantage and its variation, as an example of a before-after study. Journal of the American Statistical Association 103: 437–46.Google Scholar
Gerber, Elisabeth R., and Hopkins, Daniel J. 2011. When mayors matter: Estimating the impact of mayoral partisanship on city policy. American Journal of Political Science 55: 326–39.Google Scholar
Geys, Benny. 2006. Explaining voter turnout: A review of aggregate-level research. Electoral Studies 25: 637–63.CrossRefGoogle Scholar
Glasgow, Garrett. 2002. The efficiency of congressional campaign committee contributions in House elections. Party Politics 8: 657–72.Google Scholar
Green, Donald P., Leong, Terence Y., Kern, Holger L., Gerber, Alan S., and Larimer, Christopher W. 2009. Testing the accuracy of regression discontinuity analysis using experimental benchmarks. Political Analysis 17: 400–17.Google Scholar
Grimmer, Justin, Hersh, Eitan, Feinstein, Brian, and Carpenter, Daniel. 2011. Are close elections random? Working paper.Google Scholar
Hahn, Jinyong, Todd, Petra, and Van der Klaauw, Wilbert. 2001. Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica 69: 201–9.Google Scholar
Hainmueller, Jens, and Kern, Holger Lutz. 2008. Incumbency as a source of spillover effects in mixed electoral systems: Evidence from a regression-discontinuity design. Electoral Studies 27: 213–27.Google Scholar
Harris, Bernard. 1988. Election recounting. The American Statistician 42: 66–8.Google Scholar
Hauser, Christine, and Holusha, John. 2006. Problems lead 8 states to extend some voting hours. International Herald Tribune, November 7, 2006. http://www.nytimes.com/2006/11/08/world/americas/08iht-web.1108day.3441243.html?emc=eta1.Google Scholar
Hays, Jude C., and Franzese, Robert J. Jr. 2007. Estimating the cost of social-democratic government by regression-discontinuity analysis of close elections. Paper presented at the Annual Meeting of the International Political Economy Society, Stanford University, November 2007.Google Scholar
Herzberg, Roberta. 1986. McCloskey versus McIntyre: Implications of contested elections in a federal democracy. Publius 16: 93–109.Google Scholar
Horiuchi, Yusaku, and Leigh, Andrew. 2009. Estimating incumbency advantage: Evidence from three natural experiments. Paper prepared for presentation at the University of New South Wales, October 2009. http://wwwdocs.fce.unsw.edu.au/economics/news/VisitorSeminar/091014_YusakuHoriuchi.pdf.Google Scholar
ICPSR. 1995. Candidate and constituency statistics of elections in the United States, 1788-1990 computer file, 5th ICPSR edition. Ann Arbor, MI: Inter-university Consortium for Political and Social Research (ICPSR), producer and distributor.Google Scholar
Imbens, Guido W., and Kalyanaraman, Karthik. 2009. Optimal bandwidth choice for the regression discontinuity estimator. NBER working paper no. 14726. http://www.economics.harvard.edu/faculty/imbens/files/rd_09feb3.pdf.Google Scholar
Imbens, Guido W., and Lemieux, Thomas. 2008. Regression discontinuity designs: A guide to practice. Journal of Econometrics 142: 615–35.Google Scholar
Jackson, Robert A. 1996. The mobilization of congressional electorates. Legislative Studies Quarterly 21: 425–45.CrossRefGoogle Scholar
Jacob, Suraj, and Singhal, Naveen. 2010. Does women's electoral victory increase political participation and success in future elections? Evidence from India. Working paper. http://www.uic.edu/depts/econ/seminar_papers/singhal.pdf.Google Scholar
Jenkins, Jeffery A. 2004. Partisanship and contested election cases in the House of Representatives, 1789-2002. Studies in American Political Development 18: 112–35.Google Scholar
Katz, Jonathan N. 2008. Comment on ‘Estimating Incumbency Advantage and Its Variation, as an Example of a Before-After Study’. Journal of the American Statistical Association 103: 446–8.Google Scholar
Kimball, David C., Kropf, Martha, and Battles, Lindsay. 2006. Helping America vote? Election administration, partisanship, and provisional voting in the 2004 election. Election Law Journal 5: 447–61.Google Scholar
Krasno, Jonathan S. 1994. Challengers, competition, and reelection: Comparing Senate and House elections. New Haven, CT: Yale University Press.Google Scholar
Lee, David S. 2001. The electoral advantage to incumbency and voters' valuation of politicians' experience: A regression discontinuity analysis of elections to the U. S. House. Working paper no. W8441, National Bureau of Economic Research. http://emlab.berkeley.edu/users/cle/wp/wp31.pdf.CrossRefGoogle Scholar
Lee, David S. 2008. Randomized experiments from non-random selection in U. S. House elections. Journal of Econometrics 142: 675–97.Google Scholar
Lee, David S., and Lemieux, Thomas. 2010. Regression discontinuity designs in economics. Journal of Economic Literature 48: 281–355.Google Scholar
Lee, David S., Moretti, Enrico, and Butler, Matthew J. 2004. Do voters affect or elect policies? Evidence from the U. S. House. Quarterly Journal of Economics 119: 807–59.Google Scholar
Lehoucq, Fabrice. 2003. Electoral fraud: Causes, types, and consequences. Annual Review of Political Science 6: 233–56.Google Scholar
Leigh, Andrew. 2008. Estimating the impact of gubernatorial partisanship on policy settings and economic outcomes: A regression discontinuity approach. European Journal of Political Economy 24: 256–68.Google Scholar
Listokin, Yair. 2008. Management always wins the close ones. American Law and Economics Review 10: 159–84.Google Scholar
Mayhew, David R. 1974. Congressional elections: The case of the vanishing marginals. Polity 6: 295–317.Google Scholar
McCrary, Justin. 2008. Manipulation of the running variable in the regression discontinuity design: A density test. Journal of Econometrics 142: 698–714.Google Scholar
Minnite, Lorraine C. 2010. The myth of voter fraud. Ithaca, NY: Cornell University Press.Google Scholar
Pettersson-Lidbom, Per. 2001. Do parties matter for fiscal policy choices? A regression-discontinuity approach. Working paper. http://courses.gov.harvard.edu/gov3009/fall01/Partyeffects.pdf.Google Scholar
Pettersson-Lidbom, Per. 2008. Do parties matter for economic outcomes? A regression-discontinuity approach. Journal of the European Economic Association 6: 1037–56.Google Scholar
Potholm, Christian P. 2003. This splendid game: Maine campaigns and elections, 1940-2002. Lanham, MD: Lexington Books.Google Scholar
Riker, William H. 1962. The theory of political coalitions. New Haven, CT: Yale University Press.Google Scholar
Riker, William H., and Ordeshook, Peter C. 1968. A theory of the calculus of voting. American Political Science Review 62: 25–42.Google Scholar
Robinson, Gregory, McNulty, John E., and Krasno, Jonathan S. 2009. Observing the counterfactual? The search for political experiments in nature. Political Analysis 17: 341–57.CrossRefGoogle Scholar
Rosenbaum, Paul R. 2002. Observational studies. 2nd ed. New York: Springer-Verlag.Google Scholar
Rosenstone, Steven J., and Hansen, John Mark. 2003. Mobilization, participation, and democracy in America. New York: Longman.Google Scholar
Rubin, Donald B. 1974. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology 66: 688–701.Google Scholar
Schickler, Eric, Pearson, Kathryn, and Feinstein, Brian D. 2010. Congressional parties and civil rights politics from 1933 to 1972. Journal of Politics 72: 672–89.Google Scholar
Shadish, William R., Galindo, Rodolfo, Wong, Vivian C., Steiner, Peter M., and Cook, Thomas D. 2011. A randomized experiment comparing random and cutoff-based assignment. Psychological Methods 16: 179–91.Google Scholar
Shapiro, Margaret, and Balz, Dan. 1985. House seats McCloskey. Washington Post, May 2, 1985, A1.Google Scholar
Snyder, Jason. 2005. Detecting manipulation in U. S. House elections. Working paper. Haas School of Business, UC Berkeley.Google Scholar
Snyder, James M. Jr., 1990. Campaign contributions as investments: The U. S. House of Representatives, 1980-1986. Journal of Political Economy 98: 1195–227.Google Scholar
Splawa-Neyman, Jerzy, Dabrowska, D. M., and Speed, T. P. 1923/1990. On the application of probability theory to agricultural experiments. Essay on principles. Section 9. Statistical Science 5: 465–72.Google Scholar
Thistlethwaite, Donald L., and Campbell, Donald T. 1960. Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational Psychology 51: 309–17.Google Scholar
Titiunik, Rocío. 2009. Incumbency advantage in Brazil: Evidence from municipal Mayor Elections. Working paper. http://www-personal.umich.edu/∼titiunik/papers/Titiunik_IABrazil.pdf.Google Scholar
Tokaji, Dan, and Stoller, Samuel. 2004. Election Law @ Moritz. Part 5: Voting procedures. Section 5.3—Recounts and ther remedies. http://moritzlaw.osu.edu/electionlaw/ebook/part5/procedures_recount04.html (accessed September 16, 2009).Google Scholar
Trounstine, Jessica. 2011. Evidence of a local incumbency advantage. Legislative Studies Quarterly 36: 255–80.Google Scholar
Uppal, Yogesh. 2009. The disadvantaged incumbents: Estimating incumbency effects in Indian state legislatures. Public Choice 138: 9–27.CrossRefGoogle Scholar
Uppal, Yogesh. 2010. Estimating incumbency effects in U. S. State Legislatures: A quasi-experimental study. Economics and Politics 22: 180–99.Google Scholar
Wand, Jonathan. 2007. The allocation of campaign contributions by interest groups and the rise of elite polarization. Working paper. http://wand.stanford.edu/research/mixedmotives.pdf.Google Scholar
Weiner, Jay. 2010. This is not Florida: How Al Franken won the Minnesota Senate recount. Minneapolis, MN: University of Minnesota Press.Google Scholar
Zaller, John. 1998. Politicians as prize fighters: Electoral selection and incumbency advantage. In Party politics and politicians, ed. Geer, John. Baltimore, MD: Johns Hopkins University Press.Google Scholar