Hostname: page-component-7dd5485656-2pp2p Total loading time: 0 Render date: 2025-10-30T20:36:59.714Z Has data issue: false hasContentIssue false
  • English
  • Français

Estimation of the Reliability of Ratings

Published online by Cambridge University Press:  01 January 2025

Robert L. Ebel
Robert L. Ebel*
Affiliation:
The State University of Iowa
Get access Rights & Permissions [Opens in a new window]

Abstract

A procedure for estimating the reliability of sets of ratings, test scores, or other measures is described and illustrated. This procedure, based upon analysis of variance, may be applied both in the special case where a complete set of ratings from each of k sources is available for each of n subjects, and in the general case where k1, k2, ..., kn ratings are available for each of the n subjects. It may be used to obtain either a unique estimate or a confidence interval for the reliability of either the component ratings or their averages. The relations of this procedure to others intended to serve the same purpose are considered algebraically and illustrated numerically.

Information

Type
Original Paper
Information
Psychometrika , Volume 16 , Issue 4 , December 1951 , pp. 407 - 424
Copyright
Copyright © 1951 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

*

The writer wishes to acknowledge the helpful comments and suggestions of Professors E. E. Cureton, Harold Gulliksen, and E. F. Lindquist.

References

Clark, Edward L.Reliability of college grades. Unpublished paper presented to American Psychological Association in September, 1950.Google Scholar
Cureton, Edward E.Reliability of a set of averages of unequal numbers of scores. Unpublished paper read at the March, 1951, meeting of the Southern Society for Philosophy and Psychology.Google Scholar
Fisher, R. A. Statistical methods for research workers 10th Ed.,, Edinburgh: Oliver and Boyd, 1946.Google Scholar
Gulliksen, Harol. Theory of mental tests, New York: John Wiley and Sons, 1950.CrossRefGoogle Scholar
Horst, Pau. A generalized expression for the reliability of measures. Psychometrika, 1949, 14, 21–31.CrossRefGoogle ScholarPubMed
Jackson, R. W. B. Ferguson, George A. Studies on the reliability of tests, Toronto: Univ. of Toronto Press, 1941.Google Scholar
Lindquist, E. F. Statistical analysis in educational research, Boston: Houghton Mifflin Company, 1940.Google Scholar
Peters, Charles C. Van Voorhis, Walter R. Statistical procedures and their mathematical bases, New York: McGraw Hill Book Company, 1940.CrossRefGoogle Scholar
Snedecor, George W. Statistical methods 4th Ed.,, Ames, Iowa: Iowa State Coll. Press, 1946.Google ScholarPubMed