Skip to main content Accessibility help

Comparing the Classification of Subjects by Two Independent Judges

  • A. E. Maxwell (a1)

In a typical classification problem each subject in a sample of N subjects is allocated to one or other of k exhaustive and mutually exclusive categories. For example, a sample of families may be classified into social-class groupings in accordance with the Registrar General's classification based on the occupation of the father or father substitute. Or a sample of psychiatric patients may be classified into one or other of the diagnostic categories recommended by the W.H.O. Now it occasionally happens that the same sample of subjects is classified, for a given set of categories, independently by two different agents. For example in the Plowden Reports, Appendix 3 Table 29, a sample of children is classified into types of secondary school, Grammar, Comprehensive, Technical, etc., on the one hand according to the parent's ambition for their children and on the other hand according to the type of school in which the children were eventually placed. In situations such as the latter a k k classification table evolves in which, when the categories are arranged in the same order, the matches between the two separate classifications appear in the cells of the main diagonal of the table and the mismatches appear in the off-diagonal cells (see Table I below). The question then arises as to how to compare the two separate classifications and to measure in quantitative terms the degree of agreement between them.

Hide All
Anderson, T. W. (1962). Introduction to Multivariate Statistical Analysis. New York & London: Wiley & Sons, Inc.
Everitt, B. S. (1968). ‘Moments of the statistics kappa and weighted kappa.’ Brit. J. math & stat. Psychol., 21, 97103.
McNemar, Q. (1962). Psychological Statistics, 3rd Ed. New York & London: Wiley & Sons, Inc.
Plowdbn Report (1967). A Report of the Central Advisory Council for Education (England). Vol. II., London: H.M.S.O.
Spitzer, R. L., Cohen, J., Fleiss, J. L., and Endicott, J. (1967). ‘Quantification of agreement in psychiatric diagnosis.’ Arch. gen. Psychiat., 17, 83–7.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

The British Journal of Psychiatry
  • ISSN: 0007-1250
  • EISSN: 1472-1465
  • URL: /core/journals/the-british-journal-of-psychiatry
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed

Comparing the Classification of Subjects by Two Independent Judges

  • A. E. Maxwell (a1)
Submit a response


No eLetters have been published for this article.


Reply to: Submit a response

Your details

Conflicting interests

Do you have any conflicting interests? *