Hostname: page-component-754f97d4cd-l2v4j Total loading time: 0 Render date: 2026-07-20T17:41:03.891Z Has data issue: false hasContentIssue false
  • English
  • Français

The Greatest Lower Bound to the Reliability of a Test and the Hypothesis of Unidimensionality

Published online by Cambridge University Press:  01 January 2025

Jos M. F. Ten Berge  and
Gregor Sočan
Jos M. F. Ten Berge*
Affiliation:
University of Groningen
Gregor Sočan
Affiliation:
University of Groningen
*
Request for reprints should be sent to Jos Ten Berge, Department of Psychology, University of Groningen, Grote Kruisstraat 2/1, 9712 TS Groningen, Netherlands. E-mail: tberge@ppsw.rug.nl.
Get access Rights & Permissions [Opens in a new window]

Abstract

To assess the reliability of congeneric tests, specifically designed reliability measures have been proposed. This paper emphasizes that such measures rely on a unidimensionality hypothesis, which can neither be confirmed nor rejected when there are only three test parts, and will invariably be rejected when there are more than three test parts. Jackson and Agunwamba's (1977) greatest lower bound to reliability is proposed instead. Although this bound has a reputation for overestimating the population value when the sample size is small, this is no reason to prefer the unidimensionality-based reliability. Firstly, the sampling bias problem of the glb does not play a role when the number of test parts is small, as is often the case with congeneric measures. Secondly, glb and unidimensionality based reliability are often equal when there are three test parts, and when there are more test parts, their numerical values are still very similar. To the extent that the bias problem of the greatest lower bound does play a role, unidimensionality-based reliability is equally affected. Although unidimensionality and reliability are often thought of as unrelated, this paper shows that, from at least two perspectives, they act as antagonistic concepts. A measure, based on the same framework that led to the greatest lower bound, is discussed for assessing how close is a set of variables to unidimensionality. It is the percentage of common variance that can be explained by a single factor. An empirical example is given to demonstrate the main points of the paper.

Keywords

Reliabilitycongeneric testunidimensionality of a test

Information

Type
Theory And Methods
Information
Psychometrika , Volume 69 , Issue 4 , December 2004 , pp. 613 - 625
Copyright
Copyright © 2004 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

The authors are obliged to Henk Kiers for commenting on a previous version. Gregor Sočan is now at the University of Ljubljana.

References

Bekker, P.A., De Leeuw, J. (1987). The rank of reduced dispersion matrices. Psychometrika, 52, 125–135CrossRefGoogle Scholar
Bentler, P.M. (1972). A lower-bound method for the dimension-free measurement of reliability. Social Science Research, 1, 343–35710.1016/0049-089X(72)90082-8CrossRefGoogle Scholar
Bentler, P.M., Woodward, J.A. (1980). Inequalities among lower bounds to reliability: With applications to test construction and factor analysis. Psychometrika, 45, 249–26710.1007/BF02294079CrossRefGoogle Scholar
Cortina, J.M. (2003). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98–10410.1037/0021-9010.78.1.98CrossRefGoogle Scholar
Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–33410.1007/BF02310555CrossRefGoogle Scholar
Cronbach, L.J. (1988). Internal consistency of tests. Psychometrika, 53, 63–7010.1007/BF02294194CrossRefGoogle Scholar
De Leeuw, J. (1983). Models and methods for the analysis of correlation coefficients. Journal of Econometrics, 22, 113–137CrossRefGoogle Scholar
Feldt, L.S., Woodruff, D.J., Salih, F.A. (1987). Statistical inference for coefficient alpha. Applied Psychological Measurement, 11, 93–10310.1177/014662168701100107CrossRefGoogle Scholar
Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10, 255–282CrossRefGoogle ScholarPubMed
Guttman, L. (1958). To what extent can communalities reduce rank. Psychometrika, 23, 297–308CrossRefGoogle Scholar
Jackson, P.H., Agunwamba, C.C. (1977). Lower bounds for the reliability of the total score on a test composed of nonhomogeneous items: I. Algebraic lower bounds. Psychometrika, 42, 567–57810.1007/BF02295979CrossRefGoogle Scholar
Kristof, W. (1974). Estimation of reliability and true score variance from a split of the test into three arbitrary parts. Psychometrika, 39, 245–24910.1007/BF02291670CrossRefGoogle Scholar
Ledermann, W. (1937). On the rank of reduced correlation matrices in multiple factor analysis. Psychometrika, 2, 85–9310.1007/BF02288062CrossRefGoogle Scholar
McDonald, R.P. (1970). The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23, 1–2110.1111/j.2044-8317.1970.tb00432.xCrossRefGoogle Scholar
Nicewander, W.A. (1990). A latent-trait based reliability estimate and upper bound. Psychometrika, 55, 65–7410.1007/BF02294744CrossRefGoogle Scholar
Novick, M.R., Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1–1310.1007/BF02289400CrossRefGoogle ScholarPubMed
Osburn, H.G. (2000). Coefficient alpha and related internal consistency reliability coefficients. Psychological Methods, 5, 343–355CrossRefGoogle ScholarPubMed
Schmitt, N. (2004). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350–35310.1037/1040-3590.8.4.350CrossRefGoogle Scholar
Shapiro, A. (1982). Rank reducibility of a symmetric matrix and sampling theory of minimum trace factor analysis. Psychometrika, 47, 187–19910.1007/BF02296274CrossRefGoogle Scholar
Shapiro, A. (1982). Weighted minimum trace factor analysis. Psychometrika, 47, 243–26410.1007/BF02294158CrossRefGoogle Scholar
Shapiro, A., Ten Berge, J.M.F. (2000). The asymptotic bias of Minimum Trace Factor Analysis, with applications to the greatest lower bound to reliability. Psychometrika, 65, 413–42510.1007/BF02296154CrossRefGoogle Scholar
Shapiro, A., Ten Berge, J.M.F. (2002). Statistical inference of minimum rank factor analysis. Psychometrika, 67, 79–9410.1007/BF02294710CrossRefGoogle Scholar
Spearman, C.E. (1927). The abilities of man, London: McMillanGoogle Scholar
Ten Berge, J.M.F. (1998). Some recent developments in factor analysis and the search for proper communalities. In Rizzi, A., Vichi, M., Bock, H.-H. (Eds.), Advances in data science and classification (pp. 325–334). Berlin: Springer 10.1007/978-3-642-72253-0_44CrossRefGoogle Scholar
Ten Berge, J.M.F., Kiers, H.A.L. (2001). A numerical approach to the exact and the approximate minimum rank of a covariance matrix. Psychometrika, 56, 309–31510.1007/BF02294464CrossRefGoogle Scholar
Ten Berge, J.M.F., Snijders, T.A.B., Zegers, F.E. (1981). Computational aspects of the greatest lower bound to reliability and constrained minimum trace factor analysis. Psychometrika, 46, 357–36610.1007/BF02293900CrossRefGoogle Scholar
Van Zijl, J.M., Neudecker, H., Nel, D.G. (2000). On the distribution of the maximum likelihood estimator of Cronbach's alpha. Psychometrika, 65, 271–280CrossRefGoogle Scholar
Verhelst, N.D. (1998). Estimating the reliability of a test from a single test administration, Arnhem: CITOGoogle Scholar
Wilson, E.B., Worcester, J. (1939). The resolution of six tests into three general factors. Proceedings of the National Academy of Sciences, 25, 73–79CrossRefGoogle ScholarPubMed
Woodhouse, B., Jackson, P.H. (1977). Lower bounds for the reliability of a test composed of nonhomogeneous items II: A search procedure to locate the greatest lower bound. Psychometrika, 42, 579–59110.1007/BF02295980CrossRefGoogle Scholar
Yuan, K.-H., Bentler, P.M. (2002). On robustness of the normal-theory based asymptotic distributions of three reliability coefficient estimates. Psychometrika, 67, 251–259CrossRefGoogle Scholar