Hostname: page-component-8448b6f56d-wq2xx Total loading time: 0 Render date: 2024-04-19T12:16:20.369Z Has data issue: false hasContentIssue false

Estimating controlled direct effects through marginal structural models

Published online by Cambridge University Press:  13 February 2020

Michelle Torres*
Affiliation:
Department of Political Science, Rice University, 6100 Main Street, MS-24, Houston, TX77005, USA
*
*Corresponding author. Email: smtorres@rice.edu

Abstract

When working with panel data, many researchers wish to estimate the direct effects of time-varying factors on future outcomes. However, when a baseline treatment affects both the confounders of further stages of the treatment and the outcome, the estimation of controlled direct effects (CDEs) using traditional regression methods faces a bias trade-off between confounding bias and post-treatment control. Drawing on research from the field of epidemiology, in this article I present a marginal structural modeling (MSM) approach that allows scholars to generate unbiased estimates of CDEs. Further, I detail the characteristics and implementation of MSMs, compare the performance of this approach under different conditions, and discuss and assess practical challenges when conducting them. After presenting the method, I apply MSMs to estimate the effect of wealth in childhood on political participation, highlighting the improvement in terms of bias relative to traditional regression models. The analysis shows that MSMs improve our understanding of causal mechanisms especially when dealing with multi-categorical time-varying treatments and non-continuous outcomes.

Type
Original Articles
Copyright
Copyright © The European Political Science Association 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Acharya, A, Blackwell, M and Sen, M (2016) Explaining causal findings without bias: detecting and assessing direct effects. American Political Science Review 110, 512–29.CrossRefGoogle Scholar
Akee, R, Copeland, W, Costello, EJ, Holbein, JB and Simeonova, E (2018) Family income and the intergenerational transmission of voting behavior: evidence from an income intervention. NBER Working Paper 24770.CrossRefGoogle Scholar
Almond, G and Verba, S (1989) The Civic Culture: Political Attitudes and Democracy in Five Nations. Newbury Park, CA: Sage.Google Scholar
Beck, PA and Jennings, MK (1982) Pathways to participation. American Political Science Review 76, 94108.CrossRefGoogle Scholar
Blackwell, M (2013) A framework for dynamic causal inference in political science. American Journal of Political Science 57, 504520.CrossRefGoogle Scholar
Blackwell, M and Glynn, A (2014) How to Make Causal Inferences with Time-Series Cross-Sectional Data. Technical Report Working Paper. Harvard University.Google Scholar
Brady, HE, Verba, S and Schlozman, KL (1995) Beyond SES: a resource model of political participation. American Political Science Review 89, 271294.CrossRefGoogle Scholar
Córdova, A (2009) Methodological note: measuring relative wealth using household asset indicators. Americas Barometer Insights 6, 19.Google Scholar
Currie, J (2008) Healthy, Wealthy, and Wise: Socioeconomic Status, Poor Health in Childhood, and Human Capital Development. Technical Report. National Bureau of Economic Research.CrossRefGoogle Scholar
Elwert, F and Winship, C (2014) Endogenous selection bias: the problem of conditioning on a collider variable. Annual Review of Sociology 40, 3153.CrossRefGoogle ScholarPubMed
Glynn, AN and Quinn, KM (2010) An introduction to the augmented inverse propensity weighted estimator. Political Analysis 18, 3656.CrossRefGoogle Scholar
Hernán, , Brumback, B and Robins, JM (2000) Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men. Epidemiology 11, 561570.CrossRefGoogle ScholarPubMed
Hernán, , Brumback, B and Robins, JM (2001) Marginal structural models to estimate the joint causal effect of nonrandomized treatments. Journal of the American Statistical Association 96, 440448.CrossRefGoogle Scholar
Imai, K and Ratkovic, M (2014) Covariate balancing propensity score. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 76, 243263.CrossRefGoogle Scholar
Imai, K and Ratkovic, M (2015) Robust estimation of inverse probability weights for marginal structural models. Journal of the American Statistical Association 110, 10131023.CrossRefGoogle Scholar
Imai, K, Keele, L and Tingley, D (2010) A general approach to causal mediation analysis. Psychological Methods 15, 309334.CrossRefGoogle ScholarPubMed
Imai, K, Keele, L, Tingley, D and Yamamoto, T (2011) Unpacking the black box of causality: learning about causal mechanisms from experimental and observational studies. American Political Science Review 105, 765789.CrossRefGoogle Scholar
Jennings, MK, Markus, GB, Niemi, RG and Stoker, L (2005) Youth-parent socialization panel study, 1965–1997: four waves combined.CrossRefGoogle Scholar
Kang, JDY and Schafer, JL (2007) Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data. Statistical Science 22, 523539.CrossRefGoogle Scholar
Lipset, SM (1959) Some social requisites of democracy: economic development and political legitimacy. American Political Science Review 53, 69105.CrossRefGoogle Scholar
Miller, AH, Gurin, P, Gurin, G and Malanchuk, O (1981) Group consciousness and political participation. American Journal of Political Science 25, 494511.CrossRefGoogle Scholar
Miratrix, LW, Sekhon, JS and Yu, B (2013) Adjusting treatment effect estimates by post-stratification in randomized experiments. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 75, 369396.CrossRefGoogle Scholar
Montgomery, JM and Olivella, S (2018) Tree-based models for political science data. American Journal of political Science 62(3), 729744.CrossRefGoogle Scholar
Montgomery, JM, Nyhan, B and Torres, M (2018) How conditioning on posttreatment variables can ruin your experiment and what to do about it. American Journal of Political Science 62, 760775.CrossRefGoogle Scholar
Moore, JC and Welniak, EJ (2000) Income measurement error in surveys: a review. Journal of Official Statistics 16, 331.Google Scholar
Mutz, DC (2002) The consequences of cross-cutting networks for political participation. American Journal of Political Science 46, 838855.CrossRefGoogle Scholar
Nandi, A, Glymour, MM, Kawachi, I and VanderWeele, TJ (2012) Using marginal structural models to estimate the direct effect of adverse childhood social conditions on onset of heart disease, diabetes, and stroke. Epidemiology 23, 223232.CrossRefGoogle Scholar
Ojeda, C (2018) The two income-participation gaps. American Journal of Political Science 62, 813829.CrossRefGoogle Scholar
Pearl, J (2001) Direct and indirect effects. Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI '01). San Francisco, CA: Morgan Kaufmann Publishers Inc., pp. 411–420.Google Scholar
Pearl, J (2011) The Mediation Formula: A Guide to the Assessment of Causal Pathways in Nonlinear Models. Technical Report DTIC Document.CrossRefGoogle Scholar
Platt, RW, Delaney, JAC and Suissa, S (2012) The positivity assumption and marginal structural models: the example of warfarin use and risk of bleeding. European Journal of Epidemiology 27, 7783.CrossRefGoogle ScholarPubMed
Robins, JM (1997) Causal inference from complex longitudinal data. In Berkane, M. (eds) Latent Variable Modeling and Applications to Causality. New York, NY: Springer, pp. 69117.CrossRefGoogle Scholar
Robins, JM (1999) Association, causation, and marginal structural models. Synthese 121, 151179.CrossRefGoogle Scholar
Robins, JM, Hernán, and Brumback, B (2000) Marginal structural models and causal inference in epidemiology. Epidemiology 11, 550560.CrossRefGoogle ScholarPubMed
Rosenbaum, PR (1984) The consequences of adjustment for a concomitant variable that has been affected by the treatment. Journal of the Royal Statistical Society. Series A (General) 147, 656666.CrossRefGoogle Scholar
Rubin, DB (1977) Assignment to treatment group on the basis of a covariate. Journal of Educational and Behavioral Statistics 2, 126.CrossRefGoogle Scholar
Samii, C, Paler, L and Daly, S (2017) Retrospective causal inference with machine learning ensembles: an application to Anti-Recidivism Policies in Colombia. Political Analysis 24, 434456.CrossRefGoogle Scholar
VanderWeele, TJ (2009) Marginal structural models for the estimation of direct and indirect effects. Epidemiology 20, 1826.CrossRefGoogle ScholarPubMed
VanderWeele, TJ (2010) Bias formulas for sensitivity analysis for direct and indirect effects. Epidemiology 21, 540551.CrossRefGoogle ScholarPubMed
Verba, S and Nie, NH (1972) Participation in America: Political Democracy and Social Equality. Chicago, IL: University of Chicago Press.Google Scholar
Verba, S, Nie, NH and Kim, J (1978) Participation and Political Equality: A Seven-Nation Comparison. Chicago, IL: University of Chicago Press.Google Scholar
Watkins, S, Jonsson-Funk, M, Brookhart, MA, Rosenberg, SA, O'shea, TM and Daniels, J (2013) An empirical comparison of tree-based methods for propensity score estimation. Health Services Research 48, 17981817.Google ScholarPubMed
Westreich, D, Cole, SR, Schisterman, EF and Platt, RW (2012) A simulation study of finite-sample properties of marginal structural Cox proportional hazards models. Statistics in Medicine 31, 20982109.CrossRefGoogle ScholarPubMed
Supplementary material: Link

Torres Dataset

Link
Supplementary material: PDF

Torres Supplementary Materials

Torres Supplementary Materials
Download Torres Supplementary Materials(PDF)
PDF 224.5 KB