Skip to main content
×
×
Home

Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008

  • Devin Caughey (a1) and Jasjeet S. Sekhon (a2)
Abstract

Following David Lee's pioneering work, numerous scholars have applied the regression discontinuity (RD) design to popular elections. Contrary to the assumptions of RD, however, we show that bare winners and bare losers in U.S. House elections (1942–2008) differ markedly on pretreatment covariates. Bare winners possess large ex ante financial, experience, and incumbency advantages over their opponents and are usually the candidates predicted to win by Congressional Quarterly's pre-election ratings. Covariate imbalance actually worsens in the closest House elections. National partisan tides help explain these patterns. Previous works have missed this imbalance because they rely excessively on model-based extrapolation. We present evidence suggesting that sorting in close House elections is due mainly to activities on or before Election Day rather than postelection recounts or other manipulation. The sorting is so strong that it is impossible to achieve covariate balance between matched treated and control observations, making covariate adjustment a dubious enterprise. Although RD is problematic for postwar House elections, this example does highlight the design's advantages over alternatives: RD's assumptions are clear and weaker than model-based alternatives, and their implications are empirically testable.

    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Elections and the Regression Discontinuity Design: Lessons from Close U.S. House Races, 1942–2008
      Available formats
      ×
Copyright
Corresponding author
e-mail: sekhon@berkeley.edu
Footnotes
Hide All

Authors' note: An appendix and supplementary materials for this article are available on the Political Analysis Web site. We thank David Lee for generously providing replication files for Lee (2008). We are grateful to Scott Adler, David Brady, Gary Jacobson, Keith Poole, and Jonathan Wand for sharing their data with us. We thank the editors, the anonymous reviewers, Henry Brady, Andy Eggers, Andrew Gelman, Don Green, Jens Hainmueller, Luke Keele, Winston Lin, Walter Mebane, Jr., Eric Schickler, Laura Stoker, Dan Tokaji, Rocío Titiunik, and Rob Van Houweling for providing helpful comments, and Peter Ryan for helping to shape the project in its formative stages. Willa Caughey, Mona Fang, Julia Gettle, and Sarah Weiner provided excellent research assistance.

Footnotes
References
Hide All
Albouy, David. 2009. Partisan representation in Congress and the geographic distribution of federal funds. Working paper no. 15224. National Bureau of Economic Research, Cambridge, MA. http://www.nber.org/papers/w15224.
Alvarez, R. Michael, and Hall, Thad E. 2010. Voting technology. In The Oxford handbook of American elections and political behavior, ed. Leighley, Jan E., 219–36. New York: Oxford University Press.
Angrist, Joshua David, and Pischke, Jörn-Steffen. 2009. Mostly harmless econometrics: An empiricist's companion. Princeton, NJ: Princeton University Press.
Angrist, Joshua David, and Pischke, Jörn-Steffen. 2010. The credibility revolution in empirical economics: How better research design is taking the con out of econometrics. Journal of Economic Perspectives 24: 330.
Ansolabehere, Stephen, and Snyder, James M. Jr. 2000. Soft money, hard money, strong parties. Columbia Law Review 100: 598619.
Ansolabehere, Stephen, and Snyder, James M. Jr. 2004. Using term limits to estimate incumbency advantages when officeholders retire strategically. Legislative Studies Quarterly 29: 488515.
Basinger, Scott J., and Lavine, Howard. 2005. Ambivalence, information, and electoral choice. American Political Science Review 99: 169–84.
Beam, Christopher. 2006. What's ‘Street Money’? Or ‘walking-around money’? Or ‘get-out-the-vote money’? Slate. 2008. http://www.slate.com/id/2202955/ (accessed 8 May 2011).
Benenson, Bob. 2010. Recount. In Elections A to Z. 3rd ed. Washington, DC: CQ Press. http://library.cqpress.com/elections/elaz3d_s472.2.
Benjamini, Y., and Hochberg, Y. 1995. The control of the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B 57: 289300.
Brady, Henry E., Johnston, Richard, and Sides, John. 2006. The study of political campaigns. In Capturing campaign effects, ed. Brady, Henry E. and Johnston, Richard, 126. Ann Arbor: University of Michigan Press.
Brollo, Fernanda, and Nannicini, Tommaso. 2010. Tying your enemy's hands in close races: The politics of federal transfers in Brazil. Working paper no. 358, Innocenzo Gasparini Institute for Economic Research, Università Bocconi. http://www.igier.unibocconi.it/folder.php?vedi=4756&tbn=albero&id_folder=182.
Broockman, David E. 2009. Do congressional candidates have reverse coattails? Evidence from a regression discontinuity design. Political Analysis 17: 418–34.
Butler, Daniel Mark. 2009. A regression discontinuity design analysis of the incumbency advantage and tenure in the U. S. House. Electoral Studies 28: 123–8.
Butler, Matthew J., and Butler, Daniel M. 2006. Splitting the difference? Causal inference and theories of split-party delegations. Political Analysis 14: 439–55.
Cain, Bruce, Ferejohn, John, and Fiorina, Morris. 1987. The personal vote: Constituency service and electoral independence. Cambridge, MA: Harvard University Press.
Campbell, Donald T., and Stanley, Julian C. 1963. Experimental and quasi-experimental designs for research. New York: Houghton-Mifflin.
Campbell, Tracy. 2005. Deliver the vote: A history of election fraud, an American political tradition—1742-2004. New York: Carroll & Graf.
Caro, Robert A. 1990. Means of ascent. The Years of Lyndon Johnson. New York: Vintage Books.
Cellini, Stephanie Riegg, Ferreira, Fernando, and Rothstein, Jesse. 2010. The value of school facility investments: Evidence from a dynamic regression discontinuity design. Quarterly Journal of Economics 125: 215–61.
Cheng, Ming-Yen, Fan, Jianqing, and Marron, J. S. 1997. On automatic boundary corrections. The Annals of Statistics 25: 1691–708.
Clarke, Peter, and Evans, Susan H. 1983. Covering campaigns: Journalism in congressional elections. Stanford, CA: Stanford University Press.
Cook, Thomas D. 2008. ‘Waiting for Life to Arrive’: A history of the regression-discontinuity design in psychology, statistics and economics. Journal of Econometrics 142: 636–54.
Cook, Thomas D., Shadish, William R., and Wong, Vivian C. 2008. Three conditions under which experiments and observational studies produce comparable causal estimates: New findings from within-study comparisons. Journal of Policy Analysis and Management 27: 724–50.
Cox, Gary W., and Katz, Jonathan N. 1996. Why did the incumbency advantage in U. S. House elections grow? American Journal of Political Science 40: 478–97.
Cox, Gary W., and Katz, Jonathan N. 2002. Elbridge Gerry's salamander: The electoral consequences of the reapportionment revolution. New York: Cambridge University Press.
Cox, Gary W., and McCubbins, Mathew D. 2005. Setting the agenda: Responsible party government in the U. S. House of Representatives. New York: Cambridge University Press.
Cox, Gary W., and Munger, Michael C. 1989. Closeness, expenditures, and turnout in the 1982 U. S. House Elections. American Political Science Review 83: 217–31.
DiNardo, John, and Lee, David S. 2004. Economic impacts of new unionization on private sector employers: 1984-2001. Quarterly Journal of Economics 119: 1383–441.
Downs, Timothy, Sautter, Chris, and Young, John Hardin. 1994. The Recount Primer. Sautter Communications. http://www.thekingofsteeltown.com/index.html.
Drucker, David M. 2010. Baucus Sent Staff to Aid Reid in Nevada. Roll Call, November 5, 2010. http://www.rollcall.com/news/-200258-1.html.
Dunning, Thad. 2008. Improving causal inference: Strengths and limitations of natural experiments. Political Research Quarterly 61: 282–93.
Eggers, Andrew C., and Hainmueller, Jens. 2009. MPs for sale? Returns to office in postwar British politics. American Political Science Review 103: 513–33.
Erikson, Robert S. 1971. The advantage of incumbency in congressional elections. Polity 3: 395405.
Erikson, Robert, and Palfrey, Thomas. 2000. Equilibria in campaign spending games: Theory and data. American Political Science Review 94: 595609.
Erikson, Robert, and Titiunik, Rocío. 2011. Using regression discontinuity to uncover the personal incumbency advantage. Paper presented at the Research Workshop on American Politics, Institute of Governmental Studies, UC Berkeley, May 10, 2011.
Fearon, James D. 1999. Electoral accountability and the control of politicians: Selecting good types versus sanctioning poor performance. In Democracy, accountability, and representation, ed. Przeworski, Adam, Stokes, Susan Carol, and Manin, Bernard. New York: Cambridge University Press.
Feddersen, Timothy, Gailmard, Sean, and Sandroni, Alvaro. 2009. Moral bias in large elections: Theory and experimental evidence. American Political Science Review 103: 175–92.
Ferejohn, John A. 1977. On the decline of competition in congressional elections. American Political Science Review 71: 166–76.
Ferreira, Fernando, and Gyourko, Joseph. 2009. Do political parties matter? Evidence from cities, U. S. Quarterly Journal of Economics 124: 399422.
Fuji, Daisuke, Imbens, Guido W., and Kalyanaraman, Karthik. 2009. Notes for Matlab and Stata Regression Discontinuity Software. http://www.economics.harvard.edu/faculty/imbens/files/rd_software_09aug4.pdf. Software (rdob, version 10.0).
Gelman, Andrew. 2011. Regression discontinuity designs: looking for the keys under the lamppost? Statistical Modeling, Causal Inference, and Social Science (blog), January 15, 2011, http://andrewgelman.com/2011/01/regression_disc/.
Gelman, Andrew, and King, Gary. 1990. Estimating incumbency advantage without bias. American Journal of Political Science 34: 1142–64.
Gelman, Andrew, and Huang, Zaiying. 2008. Estimating incumbency advantage and its variation, as an example of a before-after study. Journal of the American Statistical Association 103: 437–46.
Gerber, Elisabeth R., and Hopkins, Daniel J. 2011. When mayors matter: Estimating the impact of mayoral partisanship on city policy. American Journal of Political Science 55: 326–39.
Geys, Benny. 2006. Explaining voter turnout: A review of aggregate-level research. Electoral Studies 25: 637–63.
Glasgow, Garrett. 2002. The efficiency of congressional campaign committee contributions in House elections. Party Politics 8: 657–72.
Green, Donald P., Leong, Terence Y., Kern, Holger L., Gerber, Alan S., and Larimer, Christopher W. 2009. Testing the accuracy of regression discontinuity analysis using experimental benchmarks. Political Analysis 17: 400–17.
Grimmer, Justin, Hersh, Eitan, Feinstein, Brian, and Carpenter, Daniel. 2011. Are close elections random? Working paper.
Hahn, Jinyong, Todd, Petra, and Van der Klaauw, Wilbert. 2001. Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica 69: 201–9.
Hainmueller, Jens, and Kern, Holger Lutz. 2008. Incumbency as a source of spillover effects in mixed electoral systems: Evidence from a regression-discontinuity design. Electoral Studies 27: 213–27.
Harris, Bernard. 1988. Election recounting. The American Statistician 42: 66–8.
Hauser, Christine, and Holusha, John. 2006. Problems lead 8 states to extend some voting hours. International Herald Tribune, November 7, 2006. http://www.nytimes.com/2006/11/08/world/americas/08iht-web.1108day.3441243.html?emc=eta1.
Hays, Jude C., and Franzese, Robert J. Jr. 2007. Estimating the cost of social-democratic government by regression-discontinuity analysis of close elections. Paper presented at the Annual Meeting of the International Political Economy Society, Stanford University, November 2007.
Herzberg, Roberta. 1986. McCloskey versus McIntyre: Implications of contested elections in a federal democracy. Publius 16: 93109.
Horiuchi, Yusaku, and Leigh, Andrew. 2009. Estimating incumbency advantage: Evidence from three natural experiments. Paper prepared for presentation at the University of New South Wales, October 2009. http://wwwdocs.fce.unsw.edu.au/economics/news/VisitorSeminar/091014_YusakuHoriuchi.pdf.
ICPSR. 1995. Candidate and constituency statistics of elections in the United States, 1788-1990 computer file, 5th ICPSR edition. Ann Arbor, MI: Inter-university Consortium for Political and Social Research (ICPSR), producer and distributor.
Imbens, Guido W., and Kalyanaraman, Karthik. 2009. Optimal bandwidth choice for the regression discontinuity estimator. NBER working paper no. 14726. http://www.economics.harvard.edu/faculty/imbens/files/rd_09feb3.pdf.
Imbens, Guido W., and Lemieux, Thomas. 2008. Regression discontinuity designs: A guide to practice. Journal of Econometrics 142: 615–35.
Jackson, Robert A. 1996. The mobilization of congressional electorates. Legislative Studies Quarterly 21: 425–45.
Jacob, Suraj, and Singhal, Naveen. 2010. Does women's electoral victory increase political participation and success in future elections? Evidence from India. Working paper. http://www.uic.edu/depts/econ/seminar_papers/singhal.pdf.
Jenkins, Jeffery A. 2004. Partisanship and contested election cases in the House of Representatives, 1789-2002. Studies in American Political Development 18: 112–35.
Katz, Jonathan N. 2008. Comment on ‘Estimating Incumbency Advantage and Its Variation, as an Example of a Before-After Study’. Journal of the American Statistical Association 103: 446–8.
Kimball, David C., Kropf, Martha, and Battles, Lindsay. 2006. Helping America vote? Election administration, partisanship, and provisional voting in the 2004 election. Election Law Journal 5: 447–61.
Krasno, Jonathan S. 1994. Challengers, competition, and reelection: Comparing Senate and House elections. New Haven, CT: Yale University Press.
Lee, David S. 2001. The electoral advantage to incumbency and voters' valuation of politicians' experience: A regression discontinuity analysis of elections to the U. S. House. Working paper no. W8441, National Bureau of Economic Research. http://emlab.berkeley.edu/users/cle/wp/wp31.pdf.
Lee, David S. 2008. Randomized experiments from non-random selection in U. S. House elections. Journal of Econometrics 142: 675–97.
Lee, David S., and Lemieux, Thomas. 2010. Regression discontinuity designs in economics. Journal of Economic Literature 48: 281355.
Lee, David S., Moretti, Enrico, and Butler, Matthew J. 2004. Do voters affect or elect policies? Evidence from the U. S. House. Quarterly Journal of Economics 119: 807–59.
Lehoucq, Fabrice. 2003. Electoral fraud: Causes, types, and consequences. Annual Review of Political Science 6: 233–56.
Leigh, Andrew. 2008. Estimating the impact of gubernatorial partisanship on policy settings and economic outcomes: A regression discontinuity approach. European Journal of Political Economy 24: 256–68.
Listokin, Yair. 2008. Management always wins the close ones. American Law and Economics Review 10: 159–84.
Mayhew, David R. 1974. Congressional elections: The case of the vanishing marginals. Polity 6: 295317.
McCrary, Justin. 2008. Manipulation of the running variable in the regression discontinuity design: A density test. Journal of Econometrics 142: 698714.
Minnite, Lorraine C. 2010. The myth of voter fraud. Ithaca, NY: Cornell University Press.
Pettersson-Lidbom, Per. 2001. Do parties matter for fiscal policy choices? A regression-discontinuity approach. Working paper. http://courses.gov.harvard.edu/gov3009/fall01/Partyeffects.pdf.
Pettersson-Lidbom, Per. 2008. Do parties matter for economic outcomes? A regression-discontinuity approach. Journal of the European Economic Association 6: 1037–56.
Potholm, Christian P. 2003. This splendid game: Maine campaigns and elections, 1940-2002. Lanham, MD: Lexington Books.
Riker, William H. 1962. The theory of political coalitions. New Haven, CT: Yale University Press.
Riker, William H., and Ordeshook, Peter C. 1968. A theory of the calculus of voting. American Political Science Review 62: 2542.
Robinson, Gregory, McNulty, John E., and Krasno, Jonathan S. 2009. Observing the counterfactual? The search for political experiments in nature. Political Analysis 17: 341–57.
Rosenbaum, Paul R. 2002. Observational studies. 2nd ed. New York: Springer-Verlag.
Rosenstone, Steven J., and Hansen, John Mark. 2003. Mobilization, participation, and democracy in America. New York: Longman.
Rubin, Donald B. 1974. Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology 66: 688701.
Schickler, Eric, Pearson, Kathryn, and Feinstein, Brian D. 2010. Congressional parties and civil rights politics from 1933 to 1972. Journal of Politics 72: 672–89.
Shadish, William R., Galindo, Rodolfo, Wong, Vivian C., Steiner, Peter M., and Cook, Thomas D. 2011. A randomized experiment comparing random and cutoff-based assignment. Psychological Methods 16: 179–91.
Shapiro, Margaret, and Balz, Dan. 1985. House seats McCloskey. Washington Post, May 2, 1985, A1.
Snyder, Jason. 2005. Detecting manipulation in U. S. House elections. Working paper. Haas School of Business, UC Berkeley.
Snyder, James M. Jr., 1990. Campaign contributions as investments: The U. S. House of Representatives, 1980-1986. Journal of Political Economy 98: 1195–227.
Splawa-Neyman, Jerzy, Dabrowska, D. M., and Speed, T. P. 1923/1990. On the application of probability theory to agricultural experiments. Essay on principles. Section 9. Statistical Science 5: 465–72.
Thistlethwaite, Donald L., and Campbell, Donald T. 1960. Regression-discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational Psychology 51: 309–17.
Titiunik, Rocío. 2009. Incumbency advantage in Brazil: Evidence from municipal Mayor Elections. Working paper. http://www-personal.umich.edu/∼titiunik/papers/Titiunik_IABrazil.pdf.
Tokaji, Dan, and Stoller, Samuel. 2004. Election Law @ Moritz. Part 5: Voting procedures. Section 5.3—Recounts and ther remedies. http://moritzlaw.osu.edu/electionlaw/ebook/part5/procedures_recount04.html (accessed September 16, 2009).
Trounstine, Jessica. 2011. Evidence of a local incumbency advantage. Legislative Studies Quarterly 36: 255–80.
Uppal, Yogesh. 2009. The disadvantaged incumbents: Estimating incumbency effects in Indian state legislatures. Public Choice 138: 927.
Uppal, Yogesh. 2010. Estimating incumbency effects in U. S. State Legislatures: A quasi-experimental study. Economics and Politics 22: 180–99.
Wand, Jonathan. 2007. The allocation of campaign contributions by interest groups and the rise of elite polarization. Working paper. http://wand.stanford.edu/research/mixedmotives.pdf.
Weiner, Jay. 2010. This is not Florida: How Al Franken won the Minnesota Senate recount. Minneapolis, MN: University of Minnesota Press.
Zaller, John. 1998. Politicians as prize fighters: Electoral selection and incumbency advantage. In Party politics and politicians, ed. Geer, John. Baltimore, MD: Johns Hopkins University Press.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×
MathJax

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed