Hostname: page-component-89b8bd64d-dvtzq Total loading time: 0 Render date: 2026-05-07T03:02:37.989Z Has data issue: false hasContentIssue false
  • English
  • Français

Methods for Mediation Analysis with Missing Data

Published online by Cambridge University Press:  01 January 2025

Zhiyong Zhang  and
Lijuan Wang
Zhiyong Zhang*
Affiliation:
University of Notre Dame
Lijuan Wang
Affiliation:
University of Notre Dame
*
Requests for reprints should be sent to Zhiyong Zhang, University of Notre Dame, Notre Dame, IN, USA. E-mail: zzhang4@nd.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Despite wide applications of both mediation models and missing data techniques, formal discussion of mediation analysis with missing data is still rare. We introduce and compare four approaches to dealing with missing data in mediation analysis including listwise deletion, pairwise deletion, multiple imputation (MI), and a two-stage maximum likelihood (TS-ML) method. An R package bmem is developed to implement the four methods for mediation analysis with missing data in the structural equation modeling framework, and two real examples are used to illustrate the application of the four methods. The four methods are evaluated and compared under MCAR, MAR, and MNAR missing data mechanisms through simulation studies. Both MI and TS-ML perform well for MCAR and MAR data regardless of the inclusion of auxiliary variables and for AV-MNAR data with auxiliary variables. Although listwise deletion and pairwise deletion have low power and large parameter estimation bias in many studied conditions, they may provide useful information for exploring missing mechanisms.

Keywords

mediation analysismissing dataMITS-MLbootstrapauxiliary variables

Information

Type
Original Paper
Information
Psychometrika , Volume 78 , Issue 1 , January 2013 , pp. 154 - 184
Copyright
Copyright © The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Azen, S., & Van Guilder, M. (1981). Conclusions regarding algorithms for handling incomplete data. Proceedings of the survey research methods section, 5356Google Scholar
Bauer, D.J., Preacher, K.J., & Gil, K.M. (2006). Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: new procedures and recommendations. Psychological Methods, 11(2), 14216310.1037/1082-989X.11.2.142CrossRefGoogle ScholarPubMed
Bentler, P.M., & Weeks, D.G. (1980). Linear structural equations with latent variables. Psychometrika, 45, 289–30810.1007/BF02293905CrossRefGoogle Scholar
Best, N.G., Spiegelhalter, D.J., Thomas, A., & Brayne, C.E. (1996). Bayesian analysis of realistically complex models. Journal of the Royal Statistical Society. Series A, 159, 323–34210.2307/2983178CrossRefGoogle Scholar
Bollen, K.A., & Stine, R.A. (1990). Direct and indirect effects: classical and bootstrap estimates of variability. Sociological Methodology, 20, 115–14010.2307/271084CrossRefGoogle Scholar
Brandt, J. (1991). The Hopkins verbal learning test: development of a new memory test with six equivalent forms. Clinical Neuropsychology, 5, 125–14210.1080/13854049108403297CrossRefGoogle Scholar
Chen, Z.X., Aryee, S., & Lee, C. (2005). Test of a mediation model of perceived organizational support. Journal of Vocational Behavior, 66(3), 45747010.1016/j.jvb.2004.01.001CrossRefGoogle Scholar
Center for Human Resource Research (2006). NLSY79 child & young adult data users guide: a guide to the 1986–2004 child data (Computer software manual). Columbus. Google Scholar
Cladwell, B.M., & Bradley, R.H. (1979). Home observation for measurement of the environment, Little Rock: University of ArkansasGoogle Scholar
Cole, D.A., & Maxwell, S.E. (2003). Testing mediational models with longitudinal data: questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 558–57710.1037/0021-843X.112.4.558CrossRefGoogle ScholarPubMed
Davis-Kean, P.E. (2005). The influence of parent education and family income on child achievement: the indirect role of parental expectations and the home environment. Journal of Family Psychology, 19, 294–30410.1037/0893-3200.19.2.294CrossRefGoogle ScholarPubMed
Efron, B. (1979). Bootstrap methods: another look at the jackknife. The Annals of Statistics, 7(1), 12610.1214/aos/1176344552CrossRefGoogle Scholar
Efron, B. (1987). Better bootstrap confidence intervals. Journal of the American Statistical Association, 82(397), 17118510.1080/01621459.1987.10478410CrossRefGoogle Scholar
Efron, B. (1994). Missing data, imputation, and the bootstrap. Journal of the American Statistical Association, 89(426), 46347810.1080/01621459.1994.10476768CrossRefGoogle Scholar
Efron, B., & Tibshirani, R. (1993). An introduction to the bootstrap, New York: CRC Press 10.1007/978-1-4899-4541-9CrossRefGoogle Scholar
Ekstrom, R.B., French, J.W., Harman, H.H., & Derman, D. (1976). Kit of factor-referenced cognitive tests, Princeton: Educational Testing ServiceGoogle Scholar
Enders, C.K. (2003). Using the expectation maximization algorithm to estimate coefficient alpha for scales with item-level missing data. Psychological Methods, 8, 322–33710.1037/1082-989X.8.3.322CrossRefGoogle ScholarPubMed
Fox, J. (2006). Structural equation modeling with the sem package in r. Structural Equation Modeling, 13, 465–48610.1207/s15328007sem1303_7CrossRefGoogle Scholar
Gonda, J., & Schaie, K.W. (1985). Schaie-Thurstone mental abilities test: word series test, Palo Alto: Consulting Psychologists PressGoogle Scholar
Grimm, K.J. (2008). Longitudinal associations between reading and mathematics. Developmental Neuropsychology, 33, 410–42610.1080/87565640801982486CrossRefGoogle ScholarPubMed
Jelicic, H., Phelps, E., & Lerner, R.M. (2009). Use of missing data methods in longitudinal studies: the persistence of bad practices in developmental psychology. Developmental Neuropsychology, 45, 1195–1199Google ScholarPubMed
Jobe, J.B., Smith, D.M., Ball, K., Tennstedt, S.L., Marsiske, M., Willis, S.L., & Kleinman, K. (2001). Active: a cognitive intervention trial to promote independence in older adults. Controlled Clinical Trials, 22(4), 45347910.1016/S0197-2456(01)00139-8CrossRefGoogle ScholarPubMed
Leppard, P., & Tallis, G.M. (1989). Evaluation of the mean and covariance of the truncated multinormal. Applied Statistics, 38, 543–55310.2307/2347752CrossRefGoogle Scholar
Little, R.J.A., & Rubin, D.B. (2002). Statistical analysis with missing data, (2nd ed.). New York: Wiley-Interscience 10.1002/9781119013563CrossRefGoogle Scholar
Lu, Z., Zhang, Z., & Lubke, G. (2011). Bayesian inference for growth mixture models with non-ignorable missing data. Multivariate Behavioral Research, 46, 567–59710.1080/00273171.2011.589261CrossRefGoogle Scholar
MacKinnon, D.P. (2008). Introduction to statistical mediation analysis, London: Taylor & FrancisGoogle Scholar
MacKinnon, D.P., Lockwood, C.M., Hoffman, J.M., West, S.G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7, 83–10410.1037/1082-989X.7.1.83CrossRefGoogle ScholarPubMed
MacKinnon, D.P., Lockwood, C.M., & Williams, J. (2004). Confidence limits for the indirect effect: distribution of the product and resampling methods. Multivariate Behavioral Research, 39(1), 9912810.1207/s15327906mbr3901_4CrossRefGoogle ScholarPubMed
McArdle, J.J., & Boker, S.M. (1990). Rampath, Hillsdale: Lawrence ErlbaumGoogle Scholar
Preacher, K.J., & Hayes, A.F. (2004). SPSS and sas procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers, 36, 717–73110.3758/BF03206553CrossRefGoogle ScholarPubMed
Preacher, K.J., & Hayes, A.F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40, 879–89110.3758/BRM.40.3.879CrossRefGoogle ScholarPubMed
Rubin, D.B. (1976). Inference and missing data. Biometrika, 63(3), 58159210.1093/biomet/63.3.581CrossRefGoogle Scholar
Rubin, D.B. (1996). Multiple imputation after 18+ years. Journal of the American Statistical Association, 91, 473–48910.1080/01621459.1996.10476908CrossRefGoogle Scholar
Savalei, V., & Bentler, P.M. (2009). A two-stage approach to missing data: theory and application to auxiliary variables. Structural Equation Modeling, 16, 477–49710.1080/10705510903008238CrossRefGoogle Scholar
Savalei, V., & Falk, C. (in press). Robust two-stage approach outperforms robust FIML with incomplete nonnormal data. Structural Equation Modeling. Google Scholar
Schafer, J.L. (1997). Analysis of incomplete multivariate data, London: Chapman & Hall/CRC 10.1201/9781439821862CrossRefGoogle Scholar
Shrout, P.E., & Bolger, N. (2002). Mediation in experimental and nonexperimental studies: new procedures and recommendations. Psychological Methods, 7, 422–44510.1037/1082-989X.7.4.422CrossRefGoogle ScholarPubMed
Sobel, M.E. (1982). Asymptotic confidence intervals for indirect effects in structural equation models. In Leinhardt, S. (Eds.), Sociological methodology, San Francisco: Jossey-Bass 290312Google Scholar
Tallis, G.M. (1961). The moment generating function of the truncated multinormal distribution. Journal of the Royal Statistical Society. Series B, 23, 223–22910.1111/j.2517-6161.1961.tb00408.xCrossRefGoogle Scholar
Tang, M.-L., & Bentler, P.M. (1997). Maximum likelihood estimation in covariance structure analysis with truncated data. British Journal of Mathematical & Statistical Psychology, 50(2), 339349 Available from http://dx.doi.org/10.1111/j.2044-8317.1997.tb01149.xCrossRefGoogle ScholarPubMed
Thurstone, L.L., & Thurstone, T.G. (1949). Examiner manual for the SRA primary mental abilities test (form 10–14), Chicago: Science Research AssociatesGoogle Scholar
Wilhelm, S., & Manjunath, B.G. (2010). tmvtnorm: truncated multivariate normal and Student t distribution [Computer software manual]. Available from http://CRAN.R-project.org/package=tmvtnorm (R package version 1.2-3). Google Scholar
Willis, S.L., & Marsiske, M. (1993). Manual for the everyday problems test, University Park: Pennsylvania State UniversityGoogle Scholar
Yuan, K.-H. (2009). Identifying variables responsible for data not missing at random. Psychometrika, 74, 233–25610.1007/s11336-008-9088-6CrossRefGoogle Scholar
Yuan, K.-H., & Bentler, P.M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30, 165–20010.1111/0081-1750.00078CrossRefGoogle Scholar
Yung, Y.-F. (1996). Bootstrapping techniques in analysis of mean and covariance structures. In Marcoulides, G.A., & Schumacker, R.E. (Eds.), Advanced structural equation modeling: issues and techniques, Mahwah: Erlbaum 195226Google Scholar
Zhang, Z., & Yuan, K.-H. (2012). WebSEM manual [Computer software manual]. Available from https://websem.psychstat.org. Google Scholar