Hostname: page-component-8448b6f56d-wq2xx Total loading time: 0 Render date: 2024-04-16T18:59:56.971Z Has data issue: false hasContentIssue false
  • English
  • Français

Regression discontinuity designs: a hands-on guide for practice

Published online by Cambridge University Press:  27 July 2021

Vicente Valentim ,
Ana Ruipérez Núñez  and
Elias Dinas Open the ORCID record for Elias Dinas [Opens in a new window]
Vicente Valentim
Affiliation:
Department of Political and Social Sciences, European University Institute, Villa Sanfelice, San Domenico di Fiesole, I-50014, Italy
Ana Ruipérez Núñez
Affiliation:
Department of Political and Social Sciences, European University Institute, Villa Sanfelice, San Domenico di Fiesole, I-50014, Italy
Elias Dinas*
Affiliation:
Department of Political and Social Sciences, European University Institute, Villa Sanfelice, San Domenico di Fiesole, I-50014, Italy
*
*Corresponding author. Email: elias.dinas@eui.eu
Get access

Abstract

Regression discontinuity (RD) designs have become increasingly popular in political science, due to their ability to showcase causal effects under weak assumptions. This paper provides an intuition-based guide for the use of the RD in applied research. After an intuitive explanation of how the method works, we provide a checklist that can help researchers understand the main robustness checks they should run, and a quick introduction to software implementing the design. We also provide a list of classic designs and examples of their application in political science. We hope this article can constitute a stepping stone from which researchers interested in RD can jump to more advanced literature; and which makes researchers not interested in implementing RDs better consumers of research employing this design.

Keywords

Causal inferencefuzzy RDpolitical methodologysharp RDteaching statistics
Type
Research Article
Information
Italian Political Science Review / Rivista Italiana di Scienza Politica , Volume 51 , Special Issue 2: Capturing Causation: Issues of Research Design in Political Science , July 2021 , pp. 250 - 268
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press on behalf of the Società Italiana di Scienza Politica

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abadie, A (2005) Semiparametric difference-in-differences estimators. The Review of Economic Studies 72, 1–19.CrossRefGoogle Scholar
Abou-Chadi, T and Krause, W (2018) The causal effect of radical right success on mainstream parties’ policy positions: a regression discontinuity approach. British Journal of Political Science 50, 1–19.Google Scholar
Adena, M, Enikolopov, R, Petrova, M and Voth, H-J (2020) The sword and the word: how Allied bombing and propaganda undermined German morale during WWII.Google Scholar
Angrist, JD and Pischke, J-S (2015) Mastering ‘Metrics : The Path From Cause to Effect. New Jersey: Princeton University Press.Google Scholar
Angrist, JD and Rokkanen, M (2015) Wanna get away? Regression discontinuity estimation of exam school effects away from the cutoff. Journal of the American Statistical Association 110, 1331–1344.CrossRefGoogle Scholar
Barfort, S and Klemmensen, R (2017) The Effect of Political Office on Life Expectancy. SSRN Scholarly Paper ID 2991998. Rochester, NY: Social Science Research Network.CrossRefGoogle Scholar
Barreca, AI, Guldi, M, Lindo, JM and Waddell, GR (2011) Saving babies? Revisiting the effect of very low birth weight classification. The Quarterly Journal of Economics 126, 2117–2123.CrossRefGoogle ScholarPubMed
Barreca, AI, Lindo, JM and Waddell, GR (2016) Heaping-induced bias in regression-discontinuity designs. Economic Inquiry 54, 268–293.CrossRefGoogle Scholar
Benedictis-Kessner, JD and Warshaw, C (2016) Mayoral partisanship and municipal fiscal policy. The Journal of Politics 78, 1124–1138.CrossRefGoogle Scholar
Benedictis-Kessner, JD and Warshaw, C (2020) Politics in forgotten governments: the partisan composition of county legislatures and county fiscal policies. The Journal of Politics 82, 460–475.CrossRefGoogle Scholar
Bischof, D and Wagner, M (2019) Do voters polarize when radical parties enter parliament? American Journal of Political Science 63, 888–904.CrossRefGoogle Scholar
Bol, T, de Vaan, M and van de Rijt, A (2018) The Matthew effect in science funding. Proceedings of the National Academy of Sciences 115, 4887–4890.CrossRefGoogle Scholar
Brollo, F, Nannicini, T, Perotti, R and Tabellini, G (2013) The political resource curse. American Economic Review 103, 1759–96.CrossRefGoogle Scholar
Butler, DM (2009) A regression discontinuity design analysis of the incumbency advantage and tenure in the U.S. House. Electoral Studies 28, 123–128.CrossRefGoogle Scholar
Calonico, S, Cattaneo, MD and Titiunik, R (2014 a) Robust nonparametric confidence intervals for regression-discontinuity designs. Econometrica 82, 2295–2326.CrossRefGoogle Scholar
Calonico, S, Cattaneo, MD and Titiunik, R (2014 b) Robust data-driven inference in the regression-discontinuity design. Stata Journal 10, 1–36.Google Scholar
Calonico, S, Cattaneo, MD and Titiunik, R (2015) Optimal data-driven regression discontinuity plots. Journal of the American Statistical Association 110, 1753–1769.CrossRefGoogle Scholar
Calonico, S, Cattaneo, MD, Farrell, MH and Titiunik, R (2017) rdrobust: software for regression discontinuity designs. Stata Journal 17, 372–404.CrossRefGoogle Scholar
Calonico, S, Cattaneo, MD and Farrell, MH (2020) Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs. The Econometrics Journal 23, 192–210.CrossRefGoogle Scholar
Campa, P (2011) Gender quotas, female politicians and public expenditures: quasi-experimental evidence. Publisher: Econpubblica Working Paper.CrossRefGoogle Scholar
Card, D, Lee, DS, Pei, Z and Weber, A (2017) Regression kink design: Theory and practice. In Cattaneo, MD and Escanciano, JC (eds), Regression Discontinuity Designs, Advances in Econometrics, vol. 38. Bingley: Emerald Publishing Limited, pp. 341–382.CrossRefGoogle Scholar
Carril, A, Cazor, A, Paula Gerardino, M, Litschig, S and Pomeranz, D (2017) RDDSGA: Stata module to conduct subgroup analysis for regression discontinuity designs, Statistical Software Components S458429, Boston College Department of Economics.Google Scholar
Cattaneo, MD, Jansson, M and Ma, X (2018) Manipulation testing based on density discontinuity. The Stata Journal 18, 234–261.CrossRefGoogle Scholar
Cattaneo, MD, Idrobo, N and Titiunik, R (2019) A Practical Introduction to Regression Discontinuity Designs: Foundations, 1st Edn. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Cattaneo, MD, Idrobo, N and Titiunik, R (2020) A Practical introduction to Regression Discontinuity Designs: Foundations. Cambridge University Press.Google Scholar
Coppock, A and Green, DP (2016) Is voting habit forming? New evidence from experiments and regression discontinuities. American Journal of Political Science 60, 1044–1062.CrossRefGoogle Scholar
Cuesta, BDl and Imai, K (2016) Misunderstandings about the regression discontinuity design in the study of close elections. Annual Review of Political Science 19, 375–396.CrossRefGoogle Scholar
Dahlgaard, JO (2018) Trickle-up political socialization: the causal effect on turnout of parenting a newly enfranchised voter. American Political Science Review 112, 698–705.CrossRefGoogle Scholar
De Benedetto, MA and De Paola, M (2014) Candidates’ quality and electoral participation: evidence from Italian Municipal Elections. Publisher: IZA Discussion Paper.Google Scholar
De Magalhães, L, Hangartner, D, Hirvonen, S, Meriläinen, J, Ruiz, N and Tukiainen, J (2020) How much should we trust regression discontinuity design estimates? Evidence from experimental benchmarks of the incumbency advantage.CrossRefGoogle Scholar
Dinas, E and Foos, F (2017) The national effects of subnational representation: access to regional parliaments and national electoral performance. Quarterly Journal of Political Science 12, 1–35.CrossRefGoogle Scholar
Dinas, E, Riera, P and Roussias, N (2015) Staying in the first league: parliamentary representation and the electoral success of small parties. Political Science Research and Methods 3, 187–204.CrossRefGoogle Scholar
Dinas, E, Fouka, V and Schläpfer, A (2021) Family history and attitudes toward out-groups: evidence from the European refugee crisis. Journal of Politics 83, 647–661.CrossRefGoogle Scholar
Eggers, AC (2015) Proportionality and turnout: evidence from French municipalities. Comparative Political Studies 48, 135–167.CrossRefGoogle Scholar
Eggers, AC and Hainmueller, J (2009) MPS for sale? Returns to office in postwar British politics. American Political Science Review 103, 513–533.CrossRefGoogle Scholar
Eggers, AC, Fowler, A, Hainmueller, J, Hall, AB and Snyder, JM (2015) On the validity of the regression discontinuity design for estimating electoral effects: new evidence from over 40,000 close races. American Journal of Political Science 59, 259–274. Available at https://onlinelibrary.wiley.com/doi/pdf/10.1111/ajps.12127.CrossRefGoogle Scholar
Eggers, AC, Freier, R, Grembi, V and Nannicini, T (2018) Regression discontinuity designs based on population thresholds: pitfalls and solutions. American Journal of Political Science 62, 210–229.CrossRefGoogle Scholar
Fan, J (2018) Local Polynomial Modelling and its Applications: Monographs on Statistics and Applied Probability 66. London: Routledge.CrossRefGoogle Scholar
Ferwerda, J and Miller, NL (2014) Political devolution and resistance to foreign rule: a natural experiment. American Political Science Review 108, 642–660.CrossRefGoogle Scholar
Fontana, N, Nannicini, T and Tabellini, G (2018) Historical roots of political extremism: The effects of Nazi occupation of Italy. Available at SSRN 3091588.Google Scholar
Fujiwara, T (2011) A regression discontinuity test of strategic voting and Duverger's law. Quarterly Journal of Political Science 6, 197–233.CrossRefGoogle Scholar
Gagliarducci, S and Nannicini, T (2013) Do better paid politicians perform better? Disentangling incentives from selection. Journal of the European Economic Association 11, 369–398.CrossRefGoogle Scholar
Gelman, A and Imbens, G (2019) Why high-order polynomials should not be used in regression discontinuity designs. Journal of Business & Economic Statistics 37, 447–456.CrossRefGoogle Scholar
Gerardino, MP, Litschig, S and Pomeranz, D (2017) Can audits backfire? Evidence from public procurement in Chile. NBER Working Papers, no. 23978.Google Scholar
Gleason, P, Resch, A and Berk, J (2018) RD or not RD: using experimental studies to assess the performance of the regression discontinuity approach. Evaluation Review.CrossRefGoogle ScholarPubMed
Gonzalez, RM (2021) Cell phone access and election fraud: evidence from a spatial regression discontinuity design in Afghanistan. American Economic Journal: Applied Economics 13, 1–51.Google Scholar
Green, DP, Leong, TY, Kern, HL, Gerber, AS and Larimer, CW (2009) Testing the accuracy of regression discontinuity analysis using experimental benchmarks. Political Analysis 17, 400–417.CrossRefGoogle Scholar
Hainmueller, J and Kern, HL (2008) Incumbency as a source of spillover effects in mixed electoral systems: evidence from a regression-discontinuity design. Electoral Studies 27, 213–227.CrossRefGoogle Scholar
Holbein, JB, Schafer, JP and Dickinson, DL (2019) Insufficient sleep reduces voting and other prosocial behaviours. Nature Human Behaviour 3, 492–500.CrossRefGoogle ScholarPubMed
Holland, PW (1986) Statistics and causal inference. Journal of the American Statistical Association 81, 945–960.CrossRefGoogle Scholar
Hopkins, DJ (2011) Translating into votes: the electoral impacts of Spanish-language ballots. American Journal of Political Science 55, 814–830.CrossRefGoogle Scholar
Hsu, Y-C and Shen, S (2019) Testing treatment effect heterogeneity in regression discontinuity designs. Journal of Econometrics 208, 468–486.CrossRefGoogle Scholar
Huidobro, A and Falcó-Gimenez, A (2020) Women who win but do not lead. Quasi-experimental evidence on the effect of gender on government formation.CrossRefGoogle Scholar
Hyytinen, A, Meriläinen, J, Saarimaa, T, Toivanen, O and Tukiainen, J (2018) When does regression discontinuity design work? Evidence from random election outcomes. Quantitative Economics 9, 1019–1051. Available at https://onlinelibrary.wiley.com/doi/pdf/10.3982/QE864.CrossRefGoogle Scholar
Imbens, G and Kalyanaraman, K (2012) Optimal bandwidth choice for the regression discontinuity estimator. The Review of Economic Studies 79, 933–959.CrossRefGoogle Scholar
Imbens, GW and Lemieux, T (2008) Regression discontinuity designs: a guide to practice. Journal of Econometrics 142, 615–635.CrossRefGoogle Scholar
Kettlewell, N and Siminski, P (2020) Optimal model selection in RDD and related settings using placebo zones. SSRN Electronic Journal.CrossRefGoogle Scholar
Kolesár, M and Rothe, C (2018) Inference in regression discontinuity designs with a discrete running variable. American Economic Review 108, 2277–2304.CrossRefGoogle Scholar
Lee, DS (2001) The electoral advantage to incumbency and voters’ valuation of politicians’ experience: a regression discontinuity analysis of elections to the U.S… Working Paper 8441. Series: Working Paper Series. National Bureau of Economic Research.CrossRefGoogle Scholar
Lee, DS and Lemieux, T (2010) Regression discontinuity designs in economics. Journal of Economic Literature 48, 281–355.CrossRefGoogle Scholar
Lee, DS, Moretti, E and Butler, MJ (2004) Do voters affect or elect policies? Evidence from the U. S. House. The Quarterly Journal of Economics 119, 807–859.CrossRefGoogle Scholar
McCrary, J (2008) Manipulation of the running variable in the regression discontinuity design: a density test. Journal of Econometrics, The regression discontinuity design: Theory and applications, 142, 698–714.CrossRefGoogle Scholar
Meredith, M (2009) Persistence in political participation. Quarterly Journal of Political Science 4, 187–209.CrossRefGoogle Scholar
Nielsen, HS, Sørensen, T and Taber, C (2010) Estimating the effect of student aid on college enrollment: evidence from a government grant policy reform. American Economic Journal: Economic Policy 2, 185–215.Google Scholar
Pellicer, M and Wegner, E (2013) Electoral rules and clientelistic parties: a regression discontinuity approach. Quarterly Journal of Political Science 8, 339–371.CrossRefGoogle Scholar
Ruipérez Núñez, A and Dinas, E (2020) Mean streets: power, ideology, and the politics of public memory. Rochester: SSRN Scholarly Paper. Available at https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3862675.Google Scholar
Sanz, C (2019) Direct democracy and government size: evidence from Spain. Political Science Research and Methods 8, 1–16.Google Scholar
Schulte-Cloos, J (2019) The effect of European Parliament elections on political socialisation. Journal of European Public Policy 26: 1094–1111. Available at https://doi.org/10.1080/13501763.2019.1620841.CrossRefGoogle Scholar
Sekhon, JS and Titiunik, R (2017) On interpreting the regression discontinuity design as a local experiment. In Cattaneo MD and Escanciano JC (eds), Regression Discontinuity Designs. Bingley: Emerald Publishing Limited, pp. 1–28.Google Scholar
Thistlethwaite, DL and Campbell, DT (1960) Regression-discontinuity analysis: an alternative to the ex post facto experiment. Journal of Educational Psychology 51, 309.CrossRefGoogle Scholar
Thompson, DM (2020) How partisan is local law enforcement? Evidence from sheriff cooperation with immigration authorities. American Political Science Review 114, 222–236.CrossRefGoogle Scholar
Trounstine, J (2011) Evidence of a local incumbency advantage. Legislative Studies Quarterly 36, 255–280.CrossRefGoogle Scholar
Tur-Prats, A and Valencia Caicedo, F (2020) The Long Shadow of the Spanish Civil War. SSRN Scholarly Paper ID 3661435. Rochester, NY: Social Science Research Network.Google Scholar
Uppal, Y (2009) The disadvantaged incumbents: estimating incumbency effects in Indian state legislatures. Public Choice 138, 9–27.CrossRefGoogle Scholar
Valentim, V (2021) Parliamentary representation and the normalization of radical right support. Comparative Political Studies, Online First. doi: 10.1177/0010414021997159.CrossRefGoogle Scholar
Valentim, V and Dinas, E (2020) Does Party-System Fragmentation Affect the Quality of Democracy? SSRN Scholarly Paper ID 3533378. Rochester, NY: Social Science Research Network.CrossRefGoogle Scholar
Xu, K-L (2017) Regression discontinuity with categorical outcomes. Journal of Econometrics 201, 1–18.CrossRefGoogle Scholar