Skip to main content
×
Home
    • Aa
    • Aa

Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference

  • Daniel E. Ho (a1), Kosuke Imai (a2), Gary King (a3) and Elizabeth A. Stuart (a4)
Abstract

Although published works rarely include causal estimates from more than a few model specifications, authors usually choose the presented estimates from numerous trial runs readers never see. Given the often large variation in estimates across choices of control variables, functional forms, and other modeling assumptions, how can researchers ensure that the few estimates presented are accurate or representative? How do readers know that publications are not merely demonstrations that it is possible to find a specification that fits the author's favorite hypothesis? And how do we evaluate or even define statistical properties like unbiasedness or mean squared error when no unique model or estimator even exists? Matching methods, which offer the promise of causal inference with fewer assumptions, constitute one possible way forward, but crucial results in this fast-growing methodological literature are often grossly misinterpreted. We explain how to avoid these misinterpretations and propose a unified approach that makes it possible for researchers to preprocess data with matching (such as with the easy-to-use software we offer) and then to apply the best parametric techniques they would have used anyway. This procedure makes parametric models produce more accurate and considerably less model-dependent causal inferences.

Copyright
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

Alberto Abadie , and Guido Imbens . 2006b. Large sample properties of matching estimators for average treatment effects. Econometrica 74: 235–67.

Dan A. Black , and Jeffrey A. Smith 2004. How robust is the evidence on the effects of college quality? Evidence from matching. Journal of Econometrics 121: 99124.

Daniel P. Carpenter 2002. Groups, the media, agency waiting costs, and FDA drug approval. American Journal of Political Science 46 (July): 490505.

William G. Cochran 1968. The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics 24: 295313.

Rajeev H. Dehejia , and Sadek Wahba . 1999. Causal effects in nonexperimental studies: Re-evaluating the evaluation of training programs. Journal of the American Statistical Association 94 (December): 1053–62.

Markus Frölich . 2004. Finite sample properties of propensity score matching and weighting estimators. Review of Econometrics and Statistics 86: 7790.

Steve Glazerman , Dan M. Levy , and David Myers . 2003. Nonexperimental versus experimental estimates of earnings impacts. The Annals of the American Academy of Political and Social Science 589 (September): 6393.

Xing S. Gu , and Paul R. Rosenbaum 1993. Comparison of multivariate matching methods: Structures, distances, and algorithms. Journal of Computational and Graphical Statistics 2: 405–20.

Ben B. Hansen 2004. Full matching in an observational study of coaching for the SAT. Journal of the American Statistical Association 99: 609–18.

James J. Heckman , Hidehiko Ichimura , Jeffrey A. Smith , and Petra E. Todd 1998. Characterizing selection bias using experimental data. Econometrica 66: 1017–98.

James J. Heckman , Hidehiko Ichimura , and Petra E. Todd 1997. Matching as an econometric evaluation estimator: Evidence from evaluating a job training program. Review of Economic Studies 64: 605–54.

James J. Heckman , and Richard Robb . 1985. Alternative methods for evaluating the impacts of interventions. In Longitudinal analysis of labor market data, ed. J. Heckman and B. Singer ; Cambridge: Cambridge University Press.

Keisuke Hirano , Guido W. Imbens , and Geert Ridder . 2003. Efficient estimation of average treatment effects using the estimated propensity score. Econometrica 71 (July): 1161–89.

Paul W. Holland 1986. Statistics and causal inference. Journal of the American Statistical Association 81: 945–60.

Kosuke Imai , and Gary King . 2004. Did illegal overseas absentee ballots decide the 2000 U.S. presidential election? Perspectives on Politics 2 (September): 537–49.

Kosuke Imai , and David A. van Dyk 2004. Causal inference with general treatment regimes: Generalizing the propensity score. Journal of the American Statistical Association 99 (September): 854–66.

Guido W. Imbens 2004. Nonparametric estimation of average treatment effects under exogeneity: A review. Review of Economics and Statistics 86: 429.

Gary King , and Langche Zeng . 2006. The dangers of extreme counterfactuals. Political Analysis 14: 131–59. http://gking.harvard.edu/files/abs/counterft-abs.shtml (accessed September 1, 2006).

Gary King , and Langche Zeng . 2007. When can history be our guide? The pitfalls of counterfactual inference. International Studies Quarterly (March). http://gking.harvard.edu/files/abs/counterf-abs.shtml.

Jeffrey M. Koch 2002. Gender stereotypes and citizens' impressions of house candidates' ideological orientation. American Journal of Political Science 46: 453–62.

Richard Quandt . 1972. Methods of estimating switching regressions. Journal of the American Statistical Association 67: 306–10.

Paul R. Rosenbaum 1984. The consequences of adjusting for a concomitant variable that has been affected by the treatment. Journal of the Royal Statistical Society, Series A 147: 656–66.

Paul R. Rosenbaum 1986. Dropping out of high school in the United States: An observational study. Journal of Educational Statistics 11: 207–24.

Paul R. Rosenbaum 1989. Optimal matching for observational studies. Journal of the American Statistical Association 84: 1024–32.

Paul R. Rosenbaum 2002. Observational studies. 2nd ed. New York: Springer.

Paul R. Rosenbaum , and Donald B. Rubin 1983. The central role of the propensity score in observational studies for causal effects. Biometrika 70: 4155.

Paul R. Rosenbaum , and Donald B. Rubin 1984. Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association 79: 516–24.

Paul R. Rosenbaum , and Donald B. Rubin 1985. The bias due to incomplete matching. Biometrics 41: 103–16.

Paul R. Rosenbaum , and Jeffrey H. Silber 2001. Matching and thick description in an observational study of mortality after surgery. Biostatistics 2: 217–32.

A. D. Roy 1951. Some thoughts on the distribution of earnings. Oxford Economic Papers 3: 135–46.

Donald B. Rubin 1973. The use of matched sampling and regression adjustment to remove bias in observational studies. Biometrics 29: 185203.

Donald B. Rubin 1978. Bayesian inference for causal effects: The role of randomization. The Annals of Statistics 6: 3458.

Donald B. Rubin 1979. Using multivariate matched sampling and regression adjustment to control bias in observational studies. Journal of the American Statistical Association 74: 318–28.

Donald B. Rubin 1987. Multiple imputation for nonresponse in surveys. New York: John Wiley.

Donald B. Rubin 2001. Using propensity scores to help design observational studies: Application to the tobacco litigation. Health Services & Outcomes Research Methodology 2 (December): 169–88.

Donald B. Rubin , and Elizabeth A. Stuart 2006. Affinely invariant matching methods with discriminant mixtures of proportional ellipsoidally symmetric distributions. Annals of Statistics 34: 18141826.

Donald B. Rubin , and Neal Thomas . 1992. Characterizing the effect of matching using linear propensity score methods with normal distributions. Biometrika 79: 797809.

Donald B. Rubin , and Neal Thomas . 1996. Matching using estimated propensity scores, relating theory to practice. Biometrics 52: 249–64.

Donald B. Rubin , and Neal Thomas . 2000. Combining propensity score matching with additional adjustments for prognostic covariates. Journal of the American Statistical Association 95: 573–85.

Herbert L. Smith 1997. Matching with multiple controls to estimate treatment effects in observational studies. Sociological Methodology 27: 325–53.

Jeffrey A. Smith , and Petra E. Todd 2005. Does matching overcome LaLonde's critique of nonexperimental estimators? Journal of Econometrics 125 (March-April): 305–53.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×
MathJax

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 31 *
Loading metrics...

Abstract views

Total abstract views: 371 *
Loading metrics...

* Views captured on Cambridge Core between 4th January 2017 - 24th June 2017. This data will be updated every 24 hours.