Skip to main content Accessibility help
×
Home

Measuring patient-reported outcomes in psychosis: conceptual and methodological review

  • Ulrich Reininghaus (a1) and Stefan Priebe (a2)

Abstract

Background

There are calls to use patient-reported outcomes (PROs) routinely across mental health services. However, the use of PROs in patients with psychosis has been questioned.

Aims

To examine the concepts and measures of four widely used PROs: treatment satisfaction, subjective quality of life, needs for care and the quality of the therapeutic relationship.

Method

We conducted a literature search of academic databases on concepts, characteristics and psychometric properties of the four PROs in patients with psychosis.

Results

Although numerous concepts and measures have been published, evidence on the methodological quality of existing PROs is limited. Measures designed to assess distinct PROs showed a considerable conceptual, operational and empirical overlap, and some of them also included specific aspects. The impact of symptoms and cognitive deficits appears unlikely to be of clinical significance.

Conclusions

The popularity of PROs has not been matched with progress in their conceptualisation and measurement. Based on current evidence, some recommendations can be made. Distinct and short measures with clinical relevance and sufficient psychometric properties should be preferred. Future research should optimise the validity and measurement precision of PROs, while reducing assessment burden.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Measuring patient-reported outcomes in psychosis: conceptual and methodological review
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Measuring patient-reported outcomes in psychosis: conceptual and methodological review
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Measuring patient-reported outcomes in psychosis: conceptual and methodological review
      Available formats
      ×

Copyright

Corresponding author

Dr Ulrich Reininghaus, Section of Social Psychiatry, PO Box 33, Health Service and Population Research Department, Institute of Psychiatry, De Crespigny Park, London SE5 8AF, UK. Email: ulrich.reininghaus@kcl.ac.uk

Footnotes

Hide All

Declaration of interest

None.

Footnotes

References

Hide All
1 Priebe, S, Gruyters, T, Heinze, M, Hoffmann, C, Jakel, A. Subjective evaluation criteria in psychiatric care – methods of assessment for research and general practice [in German]. Psych Prax 1995; 22: 140–4.
2 Hansson, L, Bjorkman, T, Priebe, S. Are important patient-rated outcomes in community mental health care explained by only one factor? Acta Psychiatr Scand 2007; 116: 113–8.
3 Department of Health. Equity and Excellence: Liberating the NHS. Department of Health, 2010.
4 US Food & Drug Administration. Guidance for Industry. Patient-reported Outcome Measures: Use in Medical Product Development to Support Labeling Claim. FDA, 2009.
5 McCabe, R, Saidi, M, Priebe, S. Patient-reported outcomes in schizophrenia. Br J Psychiatry 2007; 191 (suppl 50): s218.
6 Kilian, R, Angermeyer, M. Quality of life in psychiatry as an ethical duty: from the clinical to the societal perspective. Psychopathology 1999; 32: 127–34.
7 Slade, M, McCrone, P, Kuipers, E, Leese, M, Cahill, S, Parabiaghi, A, et al. Use of standardised outcome measures in adult mental health services. Randomised controlled trial. Br J Psychiatry 2006; 189: 330–6.
8 Priebe, S, McCabe, R, Bullenkamp, J, Hansson, L, Lauber, C, Martinez-Leal, R, et al. Structured patient–clinician communication and 1-year outcome in community mental healthcare. Cluster randomised controlled trial. Br J Psychiatry 2007; 191: 420–6.
9 Atkinson, M, Zibin, S, Chuang, H. Characterizing quality of life among patients with chronic mental illness: a critical examination of the self-report methodology. Am J Psychiatry 1997; 154: 99105.
10 Epstein, A, Hall, J, Tognetti, J, Son, L, Conant, L. Using proxies to evaluate quality of life: can they provide valid information about patients' health status and satisfaction with medical care? Med Care 1989; 27 (suppl 3): s918.
11 Lilford, R, Richardson, A, Stevens, A, Fitzpatrick, R, Edwards, S, Rock, F, et al. Issues in methodological research: perspectives from researchers and commissioners. Health Technol Assess 2001; 5: 157.
12 Morgan, C, Burns, T, Fitzpatrick, R, Pinfold, V, Priebe, S. Social exclusion and mental health. Conceptual and methodological review. Br J Psychiatry 2007; 191: 477–83.
13 Fitzpatrick, R, Davey, C, Buxton, M, Jones, D. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess 1998; 2.
14 Mokkink, L, Terwee, C, Patrick, D, Alonso, J, Stratford, P, Knol, D, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 2010; 63: 737–45.
15 Ware, J, Snyder, M, Wright, W, Davies, A. Defining and measuring patient satisfaction with medical care. Eval Progr Plan 1983; 6: 247–63.
16 Ruggeri, M, Dall'Agnola, R, Agostini, C, Bisoffi, G. Acceptability, sensitivity and content validity of the VECS and VSSS in measuring expectations and satisfaction in psychiatric patients and their relatives. Soc Psychiatry Psychiatr Epidemiol 1994; 29: 265–76.
17 Phelan, M, Slade, M, Thornicroft, G, Dunn, G, Holloway, F, Wykes, T, et al. The Camberwell Assessment of Need: the validity and reliability of an instrument to assess the needs of people with severe mental illness. Br J Psychiatry 1995; 167: 589–95.
18 Bordin, E. The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy 1976; 16: 252–60.
19 Priebe, S, Gruyters, T. The role of the helping alliance in psychiatric community care. A prospective study. J Nerv Ment Dis 1993; 181: 552–7.
20 Pinsof, W, Catherall, D. The integrative psychotherapy alliance: family, couple and individual therapy scales. J Marital Fam Therapy 1986; 12: 137–51.
21 Freud, S. On beginning the treatment. Reprinted (1953–1974) in the Standard Edition of the Complete Psychological Works of Sigmund Freud (trans & ed Strachey, J), vol 12. Hogarth Press.
22 Sterba, R. The fate of the ego in analytic therapy. Int J Psychoanalysis 1934; 115: 117–26.
23 Lauer, G. Concepts of quality of life in mental health care. In Quality of Life in Mental Health Care (eds Priebe, S, Oliver, J, Kaiser, W): 1934. Wrightson, 1999.
24 Stevens, A, Gabbay, J. Needs assessment needs assessment. Health Trends 1991; 23: 20–3.
25 Catty, J. ‘The vehicle of success’: theoretical and empirical perspectives on the therapeutic alliance in psychotherapy and psychiatry. Psychol Psychother 2004; 77: 255–72.
26 Catty, J, Winfield, H, Clement, S. The therapeutic relationship in secondary mental health care: a conceptual review of measures. Acta Psychiatr Scand 2007; 116: 238–52.
27 Zautra, A, Goodhard, D. Quality of life indicators: a review of the literature. Commun Ment Health Rev 1979; 4: 310.
28 Clare, A, Corney, R, Cairns, V. Social adjustment: the design and use of an instrument for social work and social work research. Br J Soc Work 1984; 14: 323–36.
29 Department of Health Social Services Inspectorate. Care Management and Assessment: Summary of Practice Guidance. HMSO, 1991.
30 Gibbons, R, Bock, D, Hedeker, D, Weiss, D, Segawa, E, Bhaumik, D, et al. Full-information bifactor analysis for graded response data. Appl Psychol Meas 2007; 31: 419.
31 Lehman, A. A quality of life interview for the chronically mentally ill. Eval Progr Plan 1988; 11: 5162.
32 Lehman, A, Ward, N, Linn, L. Chronic mental patients: the quality of life issue. Am J Psychiatry 1982; 139: 1271–6.
33 Brooks, R. EuroQol: the current state of play. Health Policy 1996; 37: 5372.
34 EuroQol Group. EuroQol – a new facility for the measurement of health-related quality of life. Health Policy 1990; 16: 199206.
35 Prieto, L, Novick, D, Sacristan, J, Edgell, G. A Rasch model analysis to test the cross-cultural validity of the EuroQoL-5D in the Schizophrenia Outpatient Health Outcomes study. Acta Psychiatr Scand 2003; 107: 24–9.
36 Uttaro, T, Lehman, A. Graded response modeling of the Quality of Life Interview. Eval Progr Plan 1999; 22: 4152.
37 De Weert-van Oene, G, Havenaar, J, Schrijvers, A. Self-assessment of need for help in patients undergoing psychiatric treatment. Psychiatry Res 2009; 167: 221–30.
38 Lasalvia, A, Bonetto, C, Tansella, M, Stefani, B, Ruggeri, M. Does staff–patient agreement on needs for care predict a better mental health outcome? A 4-year follow-up in a community service. Psychol Med 2008; 38: 123–33.
39 McCabe, R, Roder-Wanner, U, Hoffmann, K, Priebe, S. Therapeutic relationships and quality of life: association of two subjective constructs in schizophrenia patients. Int J Soc Psychiatry 1999; 45: 276–83.
40 Priebe, S, McCabe, R. The therapeutic relationship in psychiatric settings. Acta Psychiatr Scand Suppl 2006; 429: 6972.
41 Slade, M, Leese, M, Cahill, S, Thornicroft, G, Kuipers, E. Patient-rated mental health needs and quality of life improvement. Br J Psychiatry 2005; 187: 256–61.
42 Priebe, S, Kaiser, W, Huxley, P, Roder-Wanner, U, Rudolf, H. Do different subjective evaluation criteria reflect distinct constructs? J Nerv Ment Dis 1998; 186: 385–92.
43 Fakhoury, W, Kaiser, W, Roeder-Wanner, U, Priebe, S. Subjective evaluation: is there more than one criterion? Schizophr Bull 2002; 28: 319–27.
44 Reininghaus, U, McCabe, R, Burns, T, Croudace, T, Priebe, S. Measuring patients' views: a bi-factor model of distinct patient-reported outcomes in psychosis. Psychol Med 2011; 41: 277–89.
45 Norholm, V, Bech, P. Quality of life in schizophrenic patients: association with depressive symptoms. Nord J Psychiatry 2006; 60: 32–7.
46 Oersel, S, Akdemir, A, Dag, I. The sensitivity of quality-of-life scale WHOQOL-100 to psychopathological measures in schizophrenia. Compr Psychiatry 2004; 45: 5761.
47 Wilkinson, G, Hesdon, B, Wild, D, Cookson, R, Farina, C, Sharma, V, et al. Self-report quality of life measure for people with schizophrenia: the SQLS. Br J Psychiatry 2000; 177: 42–6.
48 Endicott, J, Nee, J, Harrison, W, Blumenthal, R. Quality of Life Enjoyment and Satisfaction Questionnaire: a new measure. Psychopharmacol Bull 1993; 29: 321–6.
49 Ritsner, M, Kurs, R, Ratner, Y, Gibel, A. Condensed version of the Quality of Life Scale for schizophrenia for use in outcome studies. Psychiatry Res 2005; 135: 6575.
50 Corrigan, P, Buican, B. The construct validity of subjective quality of life for the severely mentally ill. J Nerv Ment Dis 1995; 183: 281–5.
51 Eack, S, Newhill, C. Psychiatric symptoms and quality of life in schizophrenia. Schizophr Bull 2007; 33: 1225–37.
52 Mechanic, D, McAlpine, D, Rosenfield, S, Davis, D. Effects of illness attribution and depression on the quality of life among persons with serious mental illness. Soc Sci Med 1994; 39: 155–64.
53 Pukrop, R, Schlaak, V, Moller-Leimkuhler, A, Albus, M, Czernik, A, Klosterkotter, J, et al. Reliability and validity of quality of life assessed by the Short-Form 36 and the Modular System for Quality of Life in patients with schizophrenia and patients with depression. Psychiatry Res 2003; 119: 6379.
54 Price, M, Hill, C, Williams, V, Morlock, R, Leeuwenkamp, O, Patterson, T. Measures of functional status and quality-of-life in schizophrenia. Curr Psychiatry Rev 2008; 4: 2838.
55 Sim, K, Mahendran, R, Siris, S, Heckers, S, Chong, S. Subjective quality of life in first episode schizophrenia spectrum disorders with comorbid depression. Psychiatry Res 2004; 129: 141–7.
56 Vatne, S, Bjorkly, S. Empirical evidence for using subjective quality of life as an outcome variable in clinical studies: a meta-analysis of correlates and predictors in persons with a major mental disorder living in the community. Clin Psychology Rev 2008; 28: 869–89.
57 Katsakou, C, Priebe, S. Outcomes of involuntary hospital admission – a review. Acta Psychiatr Scand 2006; 114: 232–41.
58 Katsakou, C, Bowers, L, Amos, T, Morriss, R, Rose, D, Wykes, T, et al. Coercion and treatment satisfaction among involuntary patients. Psychiatr Serv 2010; 61: 286–92.
59 Grinshpoon, A, Ponizovsky, A. The relationships between need profiles, clinical symptoms, functioning and the well-being of inpatients with severe mental disorders. J Eval Clin Pract 2008; 14: 218–25.
60 Mojtabai, R, Fochtmann, L, Chang, S, Kotov, R, Craig, T, Bromet, E. Unmet need for mental health care in schizophrenia: an overview of literature and new data from a first-admission study. Schizophr Bull 2009; 35: 679–95.
61 Ochoa, S, Haro, J, Autonell, J, Pendas, A, Teba, F, Marquez, M. Met and unmet needs of schizophrenia patients in a Spanish sample. Schizophr Bull 2003; 29: 201–10.
62 Priebe, S, Reininghaus, U, McCabe, R, Burns, T, Eklund, M, Hansson, L, et al. Factors influencing subjective quality of life in patients with schizophrenia and other mental disorders: a pooled analysis. Schizophr Res 2010; 121: 251–8.
63 Priebe, S, McCabe, R, Junghan, U, Kallert, T, Ruggeri, M, Slade, M, et al. Association between symptoms and quality of life in patients with schizophrenia: a pooled analysis of changes over time. Schizophr Res 2011; 133: 1721.
64 Fujii, D, Wylie, A, Nathan, J. Neurocognition and long-term prediction of quality of life in outpatients with severe and persistent mental illness. Schizophr Res 2004; 69: 6773.
65 Addington, J, Addington, D. Neurocognitive and social functioning in schizophrenia: a 2.5 year follow-up study. Schizophr Res 2000; 44: 4756.
66 Brekke, J, Kohrt, B, Green, M. Neuropsychological functioning as a moderator of the relationship between psychosocial functioning and the subjective experience of self and life in schizophrenia. Schizophr Bull 2001; 27: 697708.
67 Green, M, Kern, R, Heaton, R. Longitudinal studies of cognition and functional outcome in schizophrenia: implications for MATRICS. Schizophr Res 2004; 72: 4151.
68 Skantze, K, Malm, U, Dencker, SJ, May, PR, Corrigan, P. Comparison of quality of life with standard of living in schizophrenic out-patients. Br J Psychiatry 1992; 161: 797801.
69 Smith, D, Mar, C, Turoff, B. The structure of schizophrenic symptoms: a meta-analytic confirmatory factor analysis. Schizophr Res 1998; 31: 5770.
70 Wegener, S, Redoblado-Hodge, M, Lucas, S, Fitzgerald, D, Harris, A, Brennan, J. Relative contributions of psychiatric symptoms and neuropsychological functioning to quality of life in first-episode psychosis. Aust N Z J Psychiatry 2005; 39: 487–92.
71 Galletly, C, Clark, C, McFarlane, A, Weber, D. Relationships between changes in symptom ratings, neurophysiological test performance and quality of life in schizophrenic patients treated with clozapine. Psychiatry Res 1997; 72: 161–6.
72 Ritsner, M. Comparison of instruments for measuring the quality of life impairment syndrome in severe mental disorders. In Quality of Life Impairment in Schizophrenia, Mood and Anxiety Disorders: New Perspectives on Research and Treatment (eds Ritsner, M, Awad, A): 133–42. Springer, 2007.
73 Sota, T. Outcome in schizophrenia: are cognitive variables predictors of rehospitalization and quality of life? Diss Abstr Int 2000; 60: 4253.
74 Reininghaus, U, McCabe, R, Burns, T, Croudace, T, Priebe, S. The validity of subjective quality of life measures in psychotic patients with severe psychopathology and cognitive deficits: an item response model analysis. Qual Life Res 2012; 21: 237–46.
75 Cramer, J, Rosenheck, R, Xu, W, Thomas, J, Henderson, W, Charney, D. Quality of life in schizophrenia: a comparison of instruments. Schizophr Bull 2000; 26: 659–66.
76 Lehman, A. Measures of quality of life among persons with severe and persistent mental disorders. Soc Psychiatry Psychiatr Epidemiol 1996; 31: 7888.
77 Van Nieuwenhuizen, C, Schene, A, Boevink, W, Wolf, J. Measuring the quality of life of clients with severe mental illness. Psychiatr Rehab J 1997; 20: 3341.
78 Uher, R, Farmer, A, Maier, W, Rietschel, M, Hauser, J, Marusic, A, et al. Measuring depression: comparison and integration of three scales in the GENDEP study. Psychol Med 2008; 38: 289300.
79 Cella, D, Riley, W, Stone, A, Rothrock, N, Reeve, B, Yount, S, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. J Clin Epidemiol 2010; 63: 1179–94.
80 Flora, D, Curran, P. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods 2004; 9: 466–91.
81 Embretson, S, Reise, S. Item Response Theory for Psychologists. Erlbaum, 2000.
82 Brown, T. Confirmatory Factor Analysis for Applied Research. Guilford, 2006.
83 Campbell, D, Fiske, D. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull 1959; 56: 81105.
84 Rose, M, Bjorner, J, Becker, J, Fries, J, Ware, J. Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS). J Clin Epidemiol 2008; 61: 1733.
Type Description Title
PDF
Supplementary materials

Reininghaus and Priebe supplementary material
Supplementary Material

 PDF (405 KB)
405 KB

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed

Measuring patient-reported outcomes in psychosis: conceptual and methodological review

  • Ulrich Reininghaus (a1) and Stefan Priebe (a2)
Submit a response

eLetters

No eLetters have been published for this article.

×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *