Skip to main content
    • Aa
    • Aa

A multicentre inter-rater reliability study using the OPCRIT computerized diagnostic system

  • J. Williams (a1), A. E. Farmer (a1), M. Ackenheil (a1), C. A. Kaufmann (a1), P. McGuffin (a1) and The OPCRIT Reliability Research Group...

We examined the reliability of the OPCRIT system from ratings produced by 30 USA and European clinicians involved in molecular genetic research. The OPCRIT system facilitates a polydiagnostic approach to research on severe psychiatric disorders. OPCRIT comprises a 90-item checklist of signs and symptoms and a suite of computer programs, which together generate diagnoses according to the operational criteria of 12 major classificatory systems (e.g. DSM-III, DSM-III-R, RDC, ICD-10). Thirty summaries of actual cases ranging in signs and symptoms, taken from independent sources, were rated by participants from research centres across Europe and the USA using the OPCRIT system. Each rating was then compared to a standard rating using a kappa statistic. Good levels of reliability were observed within all classifications (e.g. DSM-III-R, kappa = 0·73, RDC, kappa = 0·71; ICD-10, kappa = 0·70) and a similar pattern of ratings was found in both the European and USA samples. We conclude that the OPCRIT system, is both flexible and practicable retaining the ‘top-down’ advantage of operational definitions as well as the ‘bottom-up’ potential offered by well defined signs, symptoms and other component items. Within the limitations of an international, multicentre design this study shows that the OPCRIT system affords good reliability with raters from a variety of geographical and theoretical backgrounds.

Corresponding author
1Address for correspondence: Dr J. Williams, Department of Psychological Medicine, University of Wales College of Medicine, Heath Park, Cardiff CF4 4XN.
Hide All
W. T. Carpenter , J. J. Bartko , C. L. Carpenter & J. S. Strauss (1976). Another view of schizophrenia subtypes. A report from the International Pilot Study of Schizophrenia. Archives of General Psychiatry 33, 508516.

D. Castle , S. Wessely , G. Der & R. M. Murray (1991). The incidence of operationally defined schizophrenia in Camberwell. British Journal of Psychiatry 159, 790794.

J. J. Crow (1980). The molecular pathology of schizophrenia: more than one disease process? British Medical Journal 280, 6668.

A. E. Farmer , P. McGuffin & L. Spitznagel (1983). Heterogeneity in schizophrenia: a cluster analytic approach. Psychiatry Research 8, 112.

A. E. Farmer , I. Jones , J. Williams & P. McGuffin (1993 a). Defining schizophrenia: operational criteria. Journal of Mental Health 2, 209222.

A. E. Farmer , P. Cosyns , M. Leboyer , W. Maier , O. Mors , M. Sargeant , P. Bebbington & P. McGuffin (1993 b). A SCAN-SADS comparison study of psychotic subjects and their first-degree relatives. European Archives of Psychiatry and Clinical Neurosciences 242, 352356.

J. P. Feighner , E. Robins , S. B. Guze , R. A. Woodruffe , G. Winokur & R. Munoz (1972). Diagnostic criteria for use in psychiatric research. Archives of General Psychiatry 26, 5767.

R. E. Kendell , D. E. Malcolm & W. Adams (1993). The problem of detecting changes in the incidence of schizophrenia. British Journal of Psychiatry 162, 212218.

M. Leboyer & P. McGuffin (1991). Collaborative strategies in the molecular genetics of the major psychoses. British Journal of Psychiatry 158, 605610.

P. McGuffin , A. E. Farmer & I. Harvey (1991). A polydiagnostic application of operational criteria in studies of psychotic illness. Development and reliability of the OPCRIT system. Archives of General Psychiatry 48, 764770.

J. I. Nurnberger , M. C. Blehar , C. A. Kaufmann , C. York-Cooler , S. G. Simpson , J. Harkavy-Friedman , J. B. Severe , D. Malaspina & T. Reich (1994). Diagnostic interview for genetic studies. Archives of General Psychiatry 51, 849859.

M. Owen & P. McGuffin (1993). Association and linkage: complementary strategies for complex disorder. Journal of Medical Genetics 30, 638639.

E. L. Spitznagel & J. E. Helzer (1985). A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry 42, 725728.

M. T. Tsuang & G. Winokur (1974). Criteria for subtyping schizophrenia. Archives of General Psychiatry 31, 4347.

J. Williams , A. E. Farmer , S. Wessely , D. J. Castle & P. McGuffin (1993). Heterogeneity in schizophrenia: an extended replication of the hebephrenic-like and paranoid-like subtypes. Psychiatric Research 49, 199210.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Psychological Medicine
  • ISSN: 0033-2917
  • EISSN: 1469-8978
  • URL: /core/journals/psychological-medicine
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Full text views

Total number of HTML views: 0
Total number of PDF views: 13 *
Loading metrics...

Abstract views

Total abstract views: 115 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 17th October 2017. This data will be updated every 24 hours.