Hostname: page-component-cb9f654ff-mnl9s Total loading time: 0 Render date: 2025-08-19T21:48:35.191Z Has data issue: false hasContentIssue false
  • English
  • Français

A New Algorithm for the Least-Squares Solution in Factor Analysis

Published online by Cambridge University Press:  01 January 2025

Masashi Okamoto  and
Masamori Ihara
Masashi Okamoto*
Affiliation:
Osaka University
Masamori Ihara
Affiliation:
Osaka University
*
Requests for reprints should be sent to Masashi Okamoto, Department of Applied Mathematics, Faculty of Engineering Science, Osaka University, Toyonaka, Osaka 560, Japan.
Get access Rights & Permissions [Opens in a new window]

Abstract

A new algorithm to obtain the least-squares or MINRES solution in common factor analysis is presented. It is based on the up-and-down Marquardt algorithm developed by the present authors for a general nonlinear least-squares problem. Experiments with some numerical models and some empirical data sets showed that the algorithm worked nicely and that SMC (Squared Multiple Correlation) performed best among four sets of initial values for common variances but that the solution might sometimes be very sensitive to fluctuations in the sample covariance matrix.

Keywords

factor analysisleast-squaresMINRESsquared multiple correlation (SMC)up-and-down Marquardt algorithm

Information

Type
Original Paper
Information
Psychometrika , Volume 48 , Issue 4 , December 1983 , pp. 597 - 605
Copyright
Copyright © 1983 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

Numerical computation was made on a NEAC S-1000 computer in the Computer Center, Osaka University.

References

Reference Note

Mattsson, A., Olsson, U. & Rosen, M. The maximum likelihood method in factor analysis with special consideration to the problem of improper solutions. Research Report, Institute of Statistics, University of Uppsala, 1966.Google Scholar

References

Anderson, T. W. & Rubin, H. Statistical inference in factor analysis. Proceedings of the Third Berkeley Symposium, 1956, 5, 111–150.Google Scholar
Bechtoldt, H. P. An empirical study of the factor analysis stability hypothesis. Psychometrika, 1961, 26, 405–432.CrossRefGoogle Scholar
Derflinger, G. Efficient methods for obtaining minres and maximum likelihood solutions in factor analysis. Metrika, 1969, 14, 214–231.CrossRefGoogle Scholar
Derflinger, G. A general computing algorithm for factor analysis. Biometrical Journal, 1979, 21, 25–38.CrossRefGoogle Scholar
van Driel, O. P. On various causes of improper solutions in maximum likelihood factor analysis. Psychometrika, 1978, 43, 225–243.CrossRefGoogle Scholar
Emmett, W. G. Factor analysis by Lawley's method of maximum likelihood. British Journal of Psychology and Statistics, 1949, 2, 90–97.CrossRefGoogle Scholar
Fukutomi, K. On the adequacy of factor extractions. TRU Mathematics, 1972, 7, 119–136.Google Scholar
Guttman, L. “Best possible” systematic estimates of communalities. Psychometrika, 1956, 21, 273–285.CrossRefGoogle Scholar
Harman, H. H. Modern factor analysis 3rd ed., Chicago: Univ. of Chicago Press, 1976.Google Scholar
Harman, H. H. & Jones, W. H. Factor analysis by minimizing residuals (minres). Psychometrika, 1966, 31, 351–368.CrossRefGoogle ScholarPubMed
Jöreskog, K. G. Some contributions to maximum likelihood factor analysis. Psychometrika, 1967, 32, 443–482.CrossRefGoogle Scholar
Levenberg, K. A method for the solution of certain non-linear problems in least squares. Quarterly of Applied Mathematics, 1944, 2, 164–168.CrossRefGoogle Scholar
Marquardt, D. W. An algorithm for least-squares estimation of non-linear parameters. SIAM Journal, 1963, 11, 431–441.Google Scholar
Nosal, M. A note on the MINRES method. Psychometrika, 1977, 42, 149–151.CrossRefGoogle Scholar
Okamoto, M. & Ihara, M. A simple Marquardt algorithm for the nonlinear least-squares problem. Statistics and Probability Letters, 1983 (in press).CrossRefGoogle Scholar
Rao, C. R. Estimation and tests of significance in factor analysis. Psychometrika, 1955, 20, 93–111.CrossRefGoogle Scholar
Tumura, Y. & Fukutomi, K. On the improper solutions in factor analysis. TRU mathematics, 1970, 6, 63–71.Google Scholar