Hostname: page-component-76d6cb85b7-8p85h Total loading time: 0 Render date: 2026-07-14T08:27:42.740Z Has data issue: false hasContentIssue false
  • English
  • Français

Testing for Measurement Invariance with Respect to an Ordinal Variable

Published online by Cambridge University Press:  01 January 2025

Edgar C. Merkle ,
Jinyan Fan  and
Achim Zeileis
Edgar C. Merkle*
Affiliation:
University of Missouri
Jinyan Fan
Affiliation:
Auburn University
Achim Zeileis
Affiliation:
Universität Innsbruck
*
Requests for reprints should be sent to Edgar C. Merkle, Department of Psychological Sciences, University of Missouri, Columbia, MO 65211, USA. E-mail: merklee@missouri.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Researchers are often interested in testing for measurement invariance with respect to an ordinal auxiliary variable such as age group, income class, or school grade. In a factor-analytic context, these tests are traditionally carried out via a likelihood ratio test statistic comparing a model where parameters differ across groups to a model where parameters are equal across groups. This test neglects the fact that the auxiliary variable is ordinal, and it is also known to be overly sensitive at large sample sizes. In this paper, we propose test statistics that explicitly account for the ordinality of the auxiliary variable, resulting in higher power against “monotonic” violations of measurement invariance and lower power against “non-monotonic” ones. The statistics are derived from a family of tests based on stochastic processes that have recently received attention in the psychometric literature. The statistics are illustrated via an application involving real data, and their performance is studied via simulation.

Keywords

measurement invariancestochastic processfactor analysisordinal data

Information

Type
Original Paper
Information
Psychometrika , Volume 79 , Issue 4 , October 2014 , pp. 569 - 584
Copyright
Copyright © 2013 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723. Available from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1100705.CrossRefGoogle Scholar
Bauer, D.J., & Hussong, A.M. (2009). Psychometric approaches for developing commensurate measures across independent studies: traditional and new models. Psychological Methods, 14, 101–125.CrossRefGoogle ScholarPubMed
Bentler, P.M., & Bonett, D.G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606.CrossRefGoogle Scholar
Browne, M.W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In Bollen, K.A., & Long, J.S. (Eds.), Testing structural equation models (pp. 136–162). Newbury Park: Sage.Google Scholar
Dolan, C.V., & van der Maas, H.L.J. (1998). Fitting multivariate normal finite mixtures subject to structural equation modeling. Psychometrika, 63, 227–253.CrossRefGoogle Scholar
Emmons, R.A., & McCullough, M.E. (Eds.), (2004). The psychology of gratitude. New York: Oxford University Press.CrossRefGoogle Scholar
Ferguson, T.S. (1996). A course in large sample theory. London: Chapman & Hall.CrossRefGoogle Scholar
Froh, J.J., Fan, J., Emmons, R.A., Bono, G., Huebner, E.S., & Watkins, P. (2011). Measuring gratitude in youth: assessing the psychometric properties of adult gratitude scales in children and adolescents. Psychological Assessment, 23, 311–324.CrossRefGoogle ScholarPubMed
Genz, A., Bretz, F., Miwa, T., Mi, X., Leisch, F., Scheipl, F., et al. (2012). mvtnorm: multivariate normal and t distributions [Computer software manual]. Available from http://CRAN.R-project.org/package=mvtnorm (R package version 0.9-9992).Google Scholar
Hjort, N.L., & Koning, A. (2002). Tests for constancy of model parameters over time. Nonparametric Statistics, 14, 113–132.CrossRefGoogle Scholar
Hothorn, T., & Zeileis, A. (2008). Generalized maximally selected statistics. Biometrics, 64(4), 1263–1269.CrossRefGoogle ScholarPubMed
Huber, P.J. (1967). The behavior of maximum likelihood estimation under nonstandard conditions. In LeCam, L.M., & Neyman, J. (Eds.), Proceedings of the fifth Berkeley symposium on mathematical statistics and probability. Berkeley: University of California Press.Google Scholar
Lubke, G.H., & Muthén, B. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10, 21–39.CrossRefGoogle ScholarPubMed
McCullough, M.E., Emmons, R.A., & Tsang, J.-A. (2002). The grateful disposition: a conceptual and empirical topography. Journal of Personality and Social Psychology, 82, 112–127.CrossRefGoogle ScholarPubMed
Mellenbergh, G.J. (1989). Item bias and item response theory. International Journal of Educational Research, 13, 127–143.CrossRefGoogle Scholar
Merkle, E.C., & Zeileis, A. (2013). Tests of measurement invariance without subgroups: a generalization of classical methods. Psychometrika, 78, 59–82.CrossRefGoogle ScholarPubMed
Millsap, R.E. (2011). Statistical approaches to measurement invariance. New York: Routledge.Google Scholar
Molenaar, D., Dolan, C.V., Wicherts, J.M., & van der Mass, H.L.J. (2010). Modeling differentiation of cognitive abilities within the higher-order factor model using moderated factor analysis. Intelligence, 38, 611–624.CrossRefGoogle Scholar
Purcell, S. (2002). Variance components models for gene-environment interaction in twin analysis. Twin Research, 5, 554–571.CrossRefGoogle ScholarPubMed
R Development Core Team. (2012). R: a language and environment for statistical computing [Computer software manual]. URL http://www.R-project.org/. Vienna, Austria. (ISBN 3-900051-07-0) .Google Scholar
Rosseel, Y. (2012). lavaan: an R package for structural equation modeling. Journal of Statistical Software, 48(2), 136. Available from http://www.jstatsoft.org/v48/i02/.CrossRefGoogle Scholar
Satorra, A. (1989). Alternative test criteria in covariance structure analysis: a unified approach. Psychometrika, 54, 131–151.CrossRefGoogle Scholar
Satorra, A., & Bentler, P.M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514.CrossRefGoogle Scholar
Sörbom, D. (1989). Model modification. Psychometrika, 54, 371–384.CrossRefGoogle Scholar
Strobl, C., Kopf, J., & Zeileis, A. (2013). A new method for detecting differential item functioning in the Rasch model. Psychometrika, .Google ScholarPubMed
Thomas, M., & Watkins, P. (2003). Measuring the grateful trait: development of the revised GRAT. Poster presented at the Annual Convention of the Western Psychological Association, Vancouver, BC.Google Scholar
Vandenberg, R.J., & Lance, C.E. (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70.CrossRefGoogle Scholar
Yuan, K.-H., & Bentler, P.M. (1997). Mean and covariance structure analysis: theoretical and practical improvements. Journal of the American Statistical Association, 92, 767–774.CrossRefGoogle Scholar
Zeileis, A. (2006a). Implementing a class of structural change tests: an econometric computing approach. Computational Statistics & Data Analysis, 50(11), 2987–3008.CrossRefGoogle Scholar
Zeileis, A. (2006b). Object-oriented computation of sandwich estimators. Journal of Statistical Software, 16(9), 1–16. Available from http://www.jstatsoft.org/v16/i09/.CrossRefGoogle Scholar
Zeileis, A., & Hornik, K. (2007). Generalized M-fluctuation tests for parameter instability. Statistica Neerlandica, 61, 488–508.CrossRefGoogle Scholar
Zeileis, A., Leisch, F., Hornik, K., & Kleiber, C. (2002). strucchange: an R package for testing structural change in linear regression models. Journal of Statistical Software, 7, 1–38. Available from http://www.jstatsoft.org/v07/i02/.CrossRefGoogle Scholar