Skip to main content
    • Aa
    • Aa
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 58
  • Cited by
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Lehrer, Douglas S. Pato, Michele T. Nahhas, Ramzi W. Miller, Brian R. Malaspina, Dolores Buckley, Peter F. Sobell, Janet L. Walsh-Messinger, Julie Cohort Consortium, Genomic Psychiatry and Pato, Carlos N. 2016. Paternal age effect: Replication in schizophrenia with intriguing dissociation between bipolar with and without psychosis. American Journal of Medical Genetics Part B: Neuropsychiatric Genetics, Vol. 171, Issue. 4, p. 495.

    Tang, Vivian K. Pato, Michele T. Sobell, Janet L. Hammond, Terese C. Valdez, Mark M. Lane, Christianne J. and Pato, Carlos N. 2016. Substance use associated with short sleep duration in patients with schizophrenia or schizoaffective disorder. American Journal of Medical Genetics Part B: Neuropsychiatric Genetics, Vol. 171, Issue. 4, p. 525.

    Kirkbride, J. B. Stochl, J. Zimbrón, J. Crane, C. M. Metastasio, A. Aguilar, E. Webster, R. Theegala, S. Kabacs, N. Jones, P. B. and Perez, J. 2015. Social and spatial heterogeneity in psychosis proneness in a multilevel case-prodrome-control study. Acta Psychiatrica Scandinavica, Vol. 132, Issue. 4, p. 283.

    Bergen, Sarah E. O'Dushlaine, Colm T. Lee, Phil H. Fanous, Ayman H. Ruderfer, Douglas M. Ripke, Stephan Sullivan, Patrick F. Smoller, Jordan W. Purcell, Shaun M. and Corvin, Aiden 2014. Genetic modifiers and subtypes in schizophrenia: Investigations of age at onset, severity, sex and family history. Schizophrenia Research, Vol. 154, Issue. 1-3, p. 48.

    Bergman, Hanna Khodabakhsh, Atoosa Maayan, Nicola Kirkham, Amanda J Adams, Clive E Soares-Weiser, Karla and Soares-Weiser, Karla 2014. Cochrane Database of Systematic Reviews.

    Misiak, Blazej Frydecka, Dorota Slezak, Ryszard Piotrowski, Patryk and Kiejna, Andrzej 2014. Elevated homocysteine level in first-episode schizophrenia patients—the relevance of family history of schizophrenia and lifetime diagnosis of cannabis abuse. Metabolic Brain Disease, Vol. 29, Issue. 3, p. 661.

    Pereira, A.T. Marques, M. Soares, M.J. Maia, B.R. Bos, S. Valente, J. Nogueira, V. Roque, C. Madeira, N. and Macedo, A. 2014. Profile of depressive symptoms in women in the perinatal and outside the perinatal period: similar or not?. Journal of Affective Disorders, Vol. 166, p. 71.

    Sankaranarayanan, Anoop Mancuso, Serafino and Castle, David 2014. Smoking and suicidality in patients with a psychotic disorder. Psychiatry Research, Vol. 215, Issue. 3, p. 634.

    Birchwood, M. Connor, C. Lester, H. Patterson, P. Freemantle, N. Marshall, M. Fowler, D. Lewis, S. Jones, P. Amos, T. Everard, L. and Singh, S. P. 2013. Reducing duration of untreated psychosis: care pathways to early intervention in psychosis services. The British Journal of Psychiatry, Vol. 203, Issue. 1, p. 58.

    Brittain, Philip J. Stahl, Daniel Rucker, James Kawadler, Jamie and Schumann, Gunter 2013. A review of the reliability and validity of OPCRIT in relation to its use for the routine clinical assessment of mental health patients. International Journal of Methods in Psychiatric Research, Vol. 22, Issue. 2, p. 110.

    Hazari, Hiral Christmas, David and Matthews, Keith 2013. The clinical utility of different quantitative methods for measuring treatment resistance in major depression. Journal of Affective Disorders, Vol. 150, Issue. 2, p. 231.

    Pato, Michele T. Sobell, Janet L. Medeiros, Helena Abbott, Colony Sklar, Brooke M. Buckley, Peter F. Bromet, Evelyn J. Escamilla, Michael A. Fanous, Ayman H. Lehrer, Douglas S. Macciardi, Fabio Malaspina, Dolores McCarroll, Steve A. Marder, Stephen R. Moran, Jennifer Morley, Christopher P. Nicolini, Humberto Perkins, Diana O. Purcell, Shaun M. Rapaport, Mark H. Sklar, Pamela Smoller, Jordan W. Knowles, James A. and Pato, Carlos N. 2013. The genomic psychiatry cohort: Partners in discovery. American Journal of Medical Genetics Part B: Neuropsychiatric Genetics, Vol. 162, Issue. 4, p. 306.

    Pereira, Ana Telma Bos, Sandra Marques, Mariana Maia, Berta Soares, Maria João Valente, José Nogueira, Vasco de Azevedo, Maria Helena Pinto and Macedo, António 2013. Short forms of the Postpartum Depression Screening Scale: as accurate as the original form. Archives of Women's Mental Health, Vol. 16, Issue. 1, p. 67.

    Harvey, Philip D. Heaton, Robert K. Carpenter, William T. Green, Michael F. Gold, James M. and Schoenbaum, Michael 2012. Diagnosis of schizophrenia: Consistency across information sources and stability of the condition. Schizophrenia Research, Vol. 140, Issue. 1-3, p. 9.

    Saetre, Peter Grove, Jakob Børglum, Anders D. Mors, Ole Werge, Thomas Andreassen, Ole A. Vares, Maria Agartz, Ingrid Terenius, Lars and Jönsson, Erik G. 2012. Methylenetetrahydrofolate reductase (MTHFR) C677T polymorphism and age at onset of schizophrenia: No consistent evidence for an association in the nordic population. American Journal of Medical Genetics Part B: Neuropsychiatric Genetics, Vol. 159B, Issue. 8, p. 981.

    Anwar, S. Langstrom, N. Grann, M. and Fazel, S. 2011. Is Arson the Crime Most Strongly Associated With Psychosis?--A National Case-Control Study of Arson Risk in Schizophrenia and Other Psychoses. Schizophrenia Bulletin, Vol. 37, Issue. 3, p. 580.

    Möller, H.J. Jäger, M. Riedel, M. Obermeier, M. Strauss, A. and Bottlender, R. 2011. The Munich 15-year follow-up study (MUFUSSAD) on first-hospitalized patients with schizophrenic or affective disorders: Assessing courses, types and time stability of diagnostic classification. European Psychiatry, Vol. 26, Issue. 4, p. 231.

    Pereira, Ana Telma Bos, Sandra C. Marques, Mariana Maia, Berta R. Soares, Maria João Valente, José Gomes, Ana Allen Macedo, António and de Azevedo, Maria Helena Pinto 2011. The postpartum depression screening scale: is it valid to screen for antenatal depression?. Archives of Women's Mental Health, Vol. 14, Issue. 3, p. 227.

    Rucker, J. Newman, S. Gray, J. Gunasinghe, C. Broadbent, M. Brittain, P. Baggaley, M. Denis, M. Turp, J. Stewart, R. Lovestone, S. Schumann, G. Farmer, A. and McGuffin, P. 2011. OPCRIT+: an electronic system for psychiatric diagnosis and data collection in clinical and research settings. The British Journal of Psychiatry, Vol. 199, Issue. 2, p. 151.

    Schmidt, Lasse M. Hesse, Moten and Lykke, Jørn 2011. The impact of substance use disorders on the course of schizophrenia—A 15-year follow-up study. Schizophrenia Research, Vol. 130, Issue. 1-3, p. 228.


A multicentre inter-rater reliability study using the OPCRIT computerized diagnostic system

  • J. Williams (a1), A. E. Farmer (a1), M. Ackenheil (a1), C. A. Kaufmann (a1) and P. McGuffin (a1)
  • DOI:
  • Published online: 01 July 2009

We examined the reliability of the OPCRIT system from ratings produced by 30 USA and European clinicians involved in molecular genetic research. The OPCRIT system facilitates a polydiagnostic approach to research on severe psychiatric disorders. OPCRIT comprises a 90-item checklist of signs and symptoms and a suite of computer programs, which together generate diagnoses according to the operational criteria of 12 major classificatory systems (e.g. DSM-III, DSM-III-R, RDC, ICD-10). Thirty summaries of actual cases ranging in signs and symptoms, taken from independent sources, were rated by participants from research centres across Europe and the USA using the OPCRIT system. Each rating was then compared to a standard rating using a kappa statistic. Good levels of reliability were observed within all classifications (e.g. DSM-III-R, kappa = 0·73, RDC, kappa = 0·71; ICD-10, kappa = 0·70) and a similar pattern of ratings was found in both the European and USA samples. We conclude that the OPCRIT system, is both flexible and practicable retaining the ‘top-down’ advantage of operational definitions as well as the ‘bottom-up’ potential offered by well defined signs, symptoms and other component items. Within the limitations of an international, multicentre design this study shows that the OPCRIT system affords good reliability with raters from a variety of geographical and theoretical backgrounds.

Corresponding author
1Address for correspondence: Dr J. Williams, Department of Psychological Medicine, University of Wales College of Medicine, Heath Park, Cardiff CF4 4XN.
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

W. T. Carpenter , J. J. Bartko , C. L. Carpenter & J. S. Strauss (1976). Another view of schizophrenia subtypes. A report from the International Pilot Study of Schizophrenia. Archives of General Psychiatry 33, 508516.

D. Castle , S. Wessely , G. Der & R. M. Murray (1991). The incidence of operationally defined schizophrenia in Camberwell. British Journal of Psychiatry 159, 790794.

J. J. Crow (1980). The molecular pathology of schizophrenia: more than one disease process? British Medical Journal 280, 6668.

A. E. Farmer , P. McGuffin & L. Spitznagel (1983). Heterogeneity in schizophrenia: a cluster analytic approach. Psychiatry Research 8, 112.

A. E. Farmer , I. Jones , J. Williams & P. McGuffin (1993 a). Defining schizophrenia: operational criteria. Journal of Mental Health 2, 209222.

A. E. Farmer , P. Cosyns , M. Leboyer , W. Maier , O. Mors , M. Sargeant , P. Bebbington & P. McGuffin (1993 b). A SCAN-SADS comparison study of psychotic subjects and their first-degree relatives. European Archives of Psychiatry and Clinical Neurosciences 242, 352356.

J. P. Feighner , E. Robins , S. B. Guze , R. A. Woodruffe , G. Winokur & R. Munoz (1972). Diagnostic criteria for use in psychiatric research. Archives of General Psychiatry 26, 5767.

R. E. Kendell , D. E. Malcolm & W. Adams (1993). The problem of detecting changes in the incidence of schizophrenia. British Journal of Psychiatry 162, 212218.

M. Leboyer & P. McGuffin (1991). Collaborative strategies in the molecular genetics of the major psychoses. British Journal of Psychiatry 158, 605610.

P. McGuffin , A. E. Farmer & I. Harvey (1991). A polydiagnostic application of operational criteria in studies of psychotic illness. Development and reliability of the OPCRIT system. Archives of General Psychiatry 48, 764770.

J. I. Nurnberger , M. C. Blehar , C. A. Kaufmann , C. York-Cooler , S. G. Simpson , J. Harkavy-Friedman , J. B. Severe , D. Malaspina & T. Reich (1994). Diagnostic interview for genetic studies. Archives of General Psychiatry 51, 849859.

M. Owen & P. McGuffin (1993). Association and linkage: complementary strategies for complex disorder. Journal of Medical Genetics 30, 638639.

E. L. Spitznagel & J. E. Helzer (1985). A proposed solution to the base rate problem in the kappa statistic. Archives of General Psychiatry 42, 725728.

M. T. Tsuang & G. Winokur (1974). Criteria for subtyping schizophrenia. Archives of General Psychiatry 31, 4347.

J. Williams , A. E. Farmer , S. Wessely , D. J. Castle & P. McGuffin (1993). Heterogeneity in schizophrenia: an extended replication of the hebephrenic-like and paranoid-like subtypes. Psychiatric Research 49, 199210.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Psychological Medicine
  • ISSN: 0033-2917
  • EISSN: 1469-8978
  • URL: /core/journals/psychological-medicine
Please enter your name
Please enter a valid email address
Who would you like to send this to? *