Hostname: page-component-5db6c4db9b-k8dct Total loading time: 0 Render date: 2023-03-23T12:53:30.396Z Has data issue: true Feature Flags: { "useRatesEcommerce": false } hasContentIssue true

Cognitive–behavioural therapy for persistent and recurrent psychosis in people with schizophrenia-spectrum disorder: cost-effectiveness analysis

Published online by Cambridge University Press:  02 January 2018

Mark van der Gaag*
VU University and EMGO Institute, Department of Clinical Psychology, Amsterdam and Parnassia Psychiatric Institute, Department of Psychosis Research, The Hague
A. Dennis Stant
University Medical Center Groningen, Department of Epidemiology, University of Groningen, Groningen
Kerstin J. K. Wolters
University Medical Center Groningen, Department of Psychiatry, University of Groningen
Erik Buskens
University Medical Center Groningen, Department of Epidemiology, University of Groningen, Groningen and Julius Center, University Medical Center Utrecht, Department of Medical Technology Assessment, Utrecht
Durk Wiersma
University Medical Center Groningen, Department of Psychiatry, University of Groningen, The Netherlands
Mark van der Gaag, PhD, Professor of Clinical Psychology, VU University and EMGO Institute, Van der Boechorststraat 1, 1081 BT Amsterdam, The Netherlands. Email:
Rights & Permissions[Opens in a new window]



Evidence on cost-effectiveness is important to make well-informed decisions regarding care delivery.


To determine the balance between costs and health outcomes of cognitive–behavioural therapy (CBT) compared with treatment as usual (TAU) in people with schizophrenia who have persistent and recurrent symptoms of psychosis. Trial number: ISRCTN57292778.


A total of 216 people were randomised and followed up for 18 months. The primary clinical outcome measure was time functioning within the normal range. Normal functioning was defined as social functioning within the 95% range of the general population and no or minimal suffering and/or no or minimal affect on daily life of persistent psychotic symptoms. The difference in number of days was estimated. Using a societal perspective, cost differences were estimated and combined with clinical outcome to yield an incremental cost-effectiveness ratio (ICER). Uncertainty was accessed using bootstrapping and displayed by means of a cost-effectiveness acceptability curve.


In the CBT group, participants experienced 183 days of normal social functioning, whereas the TAU group experienced 106 days. The ICER was e47 per day of normal functioning gained. Cognitive–behavioural therapy implies higher costs, yet results in better health outcomes. Sensitivity analyses showed that targeting individuals who have not been hospitalised before receiving CBT results in an ICER of e14 per day normal functioning gained.


Days of normal functioning improved in the CBT condition compared with TAU, but this gain in health was associated with additional societal costs.

Copyright © Royal College of Psychiatrists, 2011 

Schizophrenia and related psychotic disorders are among the most disabling illnesses worldwide 1 and pose a considerable economic burden to current healthcare systems. Reference Mangalore and Knapp2,Reference Stant, TenVergert, Wunderink, Nienhuis and Wiersma3 Information on the cost-effectiveness of alternative treatment approaches for psychosis is therefore highly relevant for decision makers in the field of healthcare. Cognitive–behavioural therapy (CBT) can help to psychologically overcome persistent symptoms and improve the degree of normal functioning in everyday life. Reference Jones and Cormac4Reference Wykes, Steel, Everitt and Tarrier10 Surprisingly, until now only a few studies have focused on economic aspects of CBT in psychosis. Several studies have found that CBT was not more expensive than care as usual and sometimes found lower societal costs. Reference Drury, Birchwood, Cochrane and Macmillan11Reference Startup, Jackson, Evans and Bendix15 Although these results suggest that CBT may be a cost-effective intervention for psychosis, the evidence is limited. The current study aims to determine the balance between costs and health outcomes for CBT compared with treatment as usual (TAU) in people with schizophrenia-spectrum disorder with persistent and recurrent symptoms of psychosis.


Study design and randomisation procedure

The study was designed as a multisite randomised controlled trial (ISRCTN57292778) with a CBT and a TAU condition. The Central Committee for Research involving Human Subjects approved the study. When the inclusion criteria were met, written informed consent was requested. The randomisation was stratified over six regions in The Netherlands and performed independently by University Medical Center Groningen.

Study population

The study population comprised people with schizophrenia or schizoaffective disorder with persistent symptoms despite adequate antipsychotic medication. Two university hospitals and seven mental health centres in The Netherlands participated in the study.

The inclusion criteria were:

  1. (a) age 18–64;

  2. (b) diagnosis of schizophrenia or schizoaffective disorder (DSM–IV–TR, 295.xx) 16

  3. (c) Positive and Negative Syndrome Scale (PANSS) Reference Kay, Fiszbein and Opler17 scores of delusions ≥4 OR hallucinations ≥4 OR suspiciousness ≥4) AND Psychotic Symptoms Rating Scale (PSYRATS) Reference Haddock, McCarron, Tarrier and Faragher18 scores delusions-suffering ≥2 AND delusions-impact ≥2 OR hallucinations-suffering ≥2 AND hallucinations-impact ≥2;

  4. (d) treatment resistance defined as failure of two or more antipsychotic treatments of at least 6 weeks over the past 2 years.

The exclusion criteria were: intellectual disabilities with IQ<80; severe addiction; no competence in the Dutch language; and previous exposure to CBT.

Outcome measures, power analysis and measurements

The primary outcome measure in this study was the number of days that participants functioned within the normal range. In order to function within the normal range they had to fulfil three criteria: the level of social functioning had to be in the 95% range of the normal population (assessed by the Social Functioning Scale (SFS)); Reference Birchwood, Smith, Cochrane, Wetton and Copestake19 there had to be no or minimal suffering from residual symptoms; and there had to be no or minimal affect on daily living of residual symptoms on the PSYRATS.

The secondary outcome measures included symptoms based on the PSYRATS and the PANSS and quality of life assessed with the scale of the World Health Organization (WHO–QoL). 20

A power analysis was conducted. In order to show medium effect sizes (0.50) with an alpha of 0.05 and a power of 0.80, at least 70 participants were required in each condition at the end of the study. As a conservative estimate, we anticipated about a 30% drop-out rate during 18 months and 230 participants were planned to enrol.

All participants had assessments at months 0, 3, 6, 9, 12, 15 and 18. The number of days of normal functioning was estimated at 91 if two consecutive measurements were within the range of normal functioning. The number of days that a participant functioned within the normal range was estimated at 45.5 if the individual moved from below normal functioning to normal functioning or the other way around. The number of days of normal functioning was estimated at zero if the measurements before and after both indicated below normal functioning. The research assistants were trained and had a consensus meeting every 3 months. They were masked to the treatment arm of participants.


A CBT therapist (psychologist) and a CBT assistant (nurse) delivered CBT in the experimental condition. The first four sessions were carried out by the CBT assistant and consisted of a pre-therapy training of the concepts ‘antecedents’, ‘thoughts’, ‘feelings’ and ‘behavioural responses’. The goal was to teach participants that people can have different thoughts about an identical incident and consequently experience different emotions and act differently.

The CBT therapist made an individual case formulation and a list of goals with the participant and disputed alternative interpretations of incidents and designed behavioural experiments to test hypotheses. The CBT assistant could help with several therapeutic procedures such as exposure to ‘dangerous’ places, improving activity levels, exercises to improve self-esteem and challenging ongoing dysfunctional thoughts.

The therapy was manualised in six steps: pre-therapy training in the concepts: antecedent, thought, feeling and behaviour; consumer information and mutual roles and demands; assessment; shared case formulation and goal setting; changing dysfunctional cognitions into more functional thoughts; and consolidation. Therapy was provided in weekly sessions for 26 weeks but could end earlier when the participant attained the goals set. The therapists met every 6 weeks for supervision and mutual consultation. All sessions with the participants were recorded on audiotape and a random selection of the tapes was scored on treatment validity using the cognitive therapy scale. Reference Young and Beck21,Reference Haddock, Devane, Bradshaw, McGovern, Tarrier and Kinderman22

The TAU condition was routine care within each site and typically consisted of pharmacotherapy and contacts with a community psychiatric nurse. Some participants followed educational programmes in managing medication, persistent symptoms, addiction and work.

Costs and unit prices

The economic evaluation was conducted from a societal perspective; costs in and outside the healthcare sector were assessed. Medical costs of participants included medication, in-patient care, community care and general healthcare. Costs of the CBT intervention were registered in detail such as training and supervision of psychologists and nurses during the study, the number of sessions per participant, the wages of therapists and additional aspects, such as the costs of therapy office and accommodation. Both antipsychotic medication and non-prescribed medication were included in medication costs.

In addition, various types of costs outside the healthcare sector were included in the analyses. Time costs (related to the CBT intervention) were based on the number of attended training and therapy sessions, combined with information on the net income of participants (shadow prices were used for participants who did not have paid work). Costs of informal care were based on the monetary valuation of the time invested by relatives or acquaintances in helping or assisting the participant (household work, accompanying individuals to healthcare professionals, discussing problems related to the psychiatric condition, etc). Out-of-pocket costs were additional costs generated by the participants, such as the costs of cancelling holidays or other planned activities. The cost of productivity losses due to illness-related absence from work were estimated by means of the friction cost method. Reference Koopmanschap, Rutten, van Ineveld and van Roijen23 Compensation mechanisms were taken into account when estimating these productivity costs. Reference Jakob-Tacken, Koopmanschap, Meerding and Severens24 Furthermore, the costs related to changes in the amount of voluntary (unpaid) work conducted by participants were taken into account.

Information on healthcare consumption was collected by means of a detailed questionnaire that was filled in during an interview covering the previous 3 months. If there was uncertainty the research assistants checked the data using case histories. Information on the use of antipsychotics was collected through the healthcare professionals concerned. In order to facilitate comparisons with other economic evaluations, unit prices (i.e. the price of one unit of each included cost type) were mainly based on Dutch standard prices for the year 2007. Reference Oostenbrink, Bouwmans, Koopmanschap and Rutten25 True costs of used resources were estimated when standard prices were not available.

Design of the economic evaluation

The economic evaluation was designed as a cost-effectiveness analysis. In this type of analysis, costs and the primary health outcome associated with an intervention are used to calculate the incremental cost-effectiveness ratio (ICER) relative to one or more alternatives. Reference Drummond, Sculpher, Torrance, O'Brien and Stoddart26 The formula used for calculating the ICER is:

\batchmode \documentclass[fleqn,10pt,legalpaper]{article} \usepackage{amssymb} \usepackage{amsfonts} \usepackage{amsmath} \pagestyle{empty} \begin{document} \[\ ICER=\frac{(C_{\mathrm{CBT}}-C_{\mathrm{TAU}})}{(DNF_{\mathrm{CBT}}-DNF_{\mathrm{TAU}})}\ \] \end{document}

where C CBT is mean costs in the CBT group; C TAU is mean costs in the TAU group; DNF CBT is the mean days of normal functioning in the CBT group; and DNF TAU is the mean days of normal functioning in the TAU group.

Both costs and health outcomes were discounted in accordance with current guidelines. The bootstrap method was applied to provide information on the uncertainty of the results of the economic evaluation. Reference Efron and Tibshirani27 The ICERs were calculated for each of the 2000 bootstrap iterations; simulated values of the mean estimates for the cost and outcome differences were added to the cost-effectiveness plane. Reference Black28 Finally, cost-effectiveness acceptability curves Reference Fenwick, O'Brien and Briggs29 were calculated. Cost-effectiveness acceptability curves inform decision makers on the probability that an intervention will be cost-effective, which depends on the willingness to pay per additional unit of health outcome.

Statistical procedures

Kolmogorov–Smirnov tests were done to check the normal distribution of variables. To examine successful randomisation and compare those who dropped out of the study with completers, logistic regression and independent t-tests were used. The EM algorithm with a bootstrap approach Reference Oostenbrink and Al30 was applied to deal with participants for whom not all the data were available at the various time points. The analyses were conducted using SPSS version 14 and R version 2.10.1 on Windows (R Foundation, Vienna, Austria; 31


Baseline characteristics and participant flow

The participant flow can be seen in Fig. 1. Participants were recruited between 1 April 2005 and 30 September 2006. Participants were treated for 6 months and followed-up with assessments at 3-month intervals for 18 months. The 12 participants who stopped therapy prematurely did so after one or two sessions. The eight clerical errors are participants that ought to have been referred to one of the therapists by the coordinating therapist concerned, but who failed to do so. Nine individuals, who with-drew consent, did so after they heard that they were randomised to the TAU condition. The median number of sessions was 3 by nurse therapists during pre-treatment training and 13 by psychologists (intention-to-treat). Only 21 participants were co-treated by a nurse therapist and psychologist; the median number of session by the nurse therapist was 5.

Fig. 1 The flow of the participants in the study. CBT, cognitive–behavioural therapy; TAU, treatment as usual.

The randomisation appeared to be successful. There were no significant differences between the groups in the demographics (Table 1). Logistic regression aimed at possible confounders found no significant effects at baseline and end of treatment. A random sample of four audiotaped sessions for each therapist were rated for therapy fidelity: 97.8% of the recorded interviews were above the fidelity score. The research assistants were asked to guess in which condition the participants were at each assessment and apparently grew more and more unmasked: 70% of the guesses were actually correct.

Table 1 Demographic characteristics of cognitive–behavioural therapy (CBT) and treatment as usual (TAU) groups

Characteristic CBT group (n = 109) TAU group (n = 97)
Age, years: mean (s.d.) 36.52 (11.18) 37.45 (10.61)
Duration of illness, years: mean (s.d.) 10.14 (7.59) 11.02 (8.37)
Male, % 69 73
Education,b mean (s.d.) 4.20 (1.80) 4.32 (1.93)
Social Functioning Scale, total score: mean (s.d.) 112.17 (21.27) 109.59 (21.85)
Positive and Negative Syndrome Scale, total score: mean (s.d.) 67.71 (13.21) 70.21 (12.81)
Participants with delusions, % 81 86
Participants with hallucinations, % 61 65

Health outcome

The primary outcome measure in this study was the number of days that participants functioned within the normal range. The CBT group was functioning significantly better than the TAU group at most of the time points when assessments were made, except for the 9- and the 18-month assessment. A breakdown of the composite dichotomous normal functioning outcome measure showed that the gain in social functioning (SFS) was comparable in both groups, but the CBT group experienced less suffering and impact of symptoms (PSYRATS) on daily living than the TAU group did. The number needed to treat varied from 5 to 10 on the intention-to-treat analysis (Table 2).

Table 2 Number of participants with normal functioning at different time points for the cognitive–behavioural therapy (CBT) and treatment as usual (TAU) groups: intention-to-treat

Normal functioning at assessment CBT (n = 109) TAU (n = 97) Fisher's exact test Number needed to treat (95% CI)
3 months 34 10 0.000 5 (3.2–9.7)
6 months 31 14 0.018 8 (4.0–33.1)
9 months 33 20 0.150 10 (ns)
12 months 40 20 0.014 7 (3.5–25.2)
15 months 42 24 0.037 8 (3.8–79.9)
18 months 39 25 0.134 10 (ns)

In the CBT group, the participants had on average 183 days of normal functioning and the TAU group 106 days. The mean difference of 77 days of normal functioning between groups was significant (95% CI 29.7–124.0). The results of the secondary outcome measures are shown inTable 3. The differences between groups on the PANSS and the WHO–QoL were not statistically significant. The subjective rating of symptoms on the PSYRATS was statistically significant.

Table 3 Differential effects of cognitive–behavioural therapy (CBT) and treatment as usual (TAU) on symptoms and quality of life over the study period

CBT, mean (s.e.) TAU, mean (s.e.) Interaction group × time point P a
Baseline End of treatment Baseline End of treatment F
Positive and Negative Syndrome Scale, total 67.9 (1.3) 61.2 (1.5) 70.7 (1.3) 62.7 (1.6) 0.51 0.48
Psychotic Symptoms Rating Scale, total 29.9 (1.3) 19.9 (1.6) 32.8 (1.4) 27.8 (1.8) 4.40 0.04
World Health Organization – Quality of Life, total 71.9 (1.0) 75.1 (1.0) 73.5 (1.0) 75.4 (1.3) 0.76 0.39
World Health Organization – Quality of Life, psychological well-being 17.7 (0.3) 18.4 (0.3) 18.1 (0.3) 17.9 (0.4) 3.70 0.06

Costs and healthcare utilisation

The various medical and non-medical costs generated by both groups are presented in online Table DS1. The mean total costs of training therapists in CBT, supervising therapists during the study, and providing pre-therapy to participants was €426. The costs of the CBT sessions during the first 6 months of the study were included in the costs of contacts with psychologists, which were therefore higher in the CBT condition (approximately €550 of these costs were related to CBT sessions). Although the percentage of participants who were admitted during the study was comparable between groups, a small number of participants in the CBT group was admitted during most of the study period, leading to considerably higher costs. An overview of the total costs incurred over the duration of the study, broken down by time period, is provided in Table 4. The differences between the mean costs of both groups were not statistically significant. This should be interpreted with some caution, since the study was powered (as most economic evaluations) to demonstrate differences in health outcomes and not costs.

Table 4 Mean total costs (Euro, price level of 2007) during the study

Cognitive–behavioural therapy Treatment as usual
Time period n Total costs, mean n Total costs, mean Difference in costs, mean (95% Cl)a
0–3 months 97 7158 77 5084 2074 (–29 to 4275)
3–6 months 94 5824 69 4888 936 (–931 to 2902)
6–9 months 88 5141 75 4840 300 (–1805 to 2282)
9–12 months 89 5222 75 3873 1350 (–314 to 2968)
12–15 months 96 4617 85 4963 – 346 (–2272 to 1521)
15–18 months 99 4301 87 3777 524 (–873 to 1969)
0–18 monthsb 109 33 130 97 29 578 3552 (–5162 to 12 184)

Cost-effectiveness analysis

The calculated value of the ICER was €47 per day with normal functioning gained. The point estimate of the ICER and the results of the bootstrap analyses are presented in the cost-effectiveness plane inFig. 2.

About 21% of the bootstrapped mean ICERs were located in the southeast quadrant, indicating that CBT dominated TAU in 21% of the bootstrapped mean ICERs. The other bootstrap simulations (79%) were located in the northeast quadrant indicating that both costs were higher and health outcomes were better in the CBT group. Interpretation of outcomes in the northeast (and southwest) quadrant depends on how much decision makers are willing to pay for an additional unit of health outcome. InFig. 3, the graph for the standard analysis shows the probability that CBT (compared with TAU) will be cost-effective for increasing willingness to pay per additional unit of health outcome. For instance, a willingness to pay approximately €84 per additional day of normal functioning is associated with a 70% probability that CBT is the optimal intervention.

Sensitivity analyses

In the first sensitivity analysis, participants in one of the six participating centres were left out of the analyses (n = 11; 5%). Outcomes of individuals in this centre were very distinct from the other centres: with considerably more hospitalisations and less experienced therapists. Excluding these participants led to lower average costs in the CBT group (€30 652) and the TAU group (€28 789), and a smaller mean difference of €1863 (CI –6918 to 10 647) between CBT and TAU.

In the second sensitivity analysis, we adjusted the way the number of days of normal functioning was calculated. A more liberal threshold for normal functioning was chosen, allowing one 2-score (moderate severe) on either suffering or the impact of symptoms. The mean difference in days of normal functioning between groups was now 58 days in favour of CBT.

In the third sensitivity analysis, participants who had been admitted to a hospital during the 3 months before the start of the study were excluded from the analysis. Results showed that mean total costs in both groups were much lower (CBT group (n = 81) €24 885, TAU group (n = 73) € 23 585), and the difference between the groups (€1300, CI – 7450 to 9949) was much smaller than in the previous analyses. For this analysis, the incremental costs were €14 per additional day of normal functioning gained. Fig. 3 presents the cost-effectiveness acceptability curves assessed for each of the described sensitivity analyses.

Fig. 2 Results of the cost-effectiveness analysis and bootstrap method.

CCBT, mean costs in the cognitive–behavioural therapy (CBT) group; CTAU, mean costs in the treatment as usual (TAU) group; DNFCBT, mean days of normal functioning in the CBT group; DNFTAU, mean days of normal functioning in the TAU group. The white circle is the point estimate of the incremental cost-effectiveness ratio.


Normal functioning and costs

This study shows that implementing CBT in routine care can alleviate the suffering of people with persistent psychosis and brings some of them into the range of normal functioning, with low levels of distress and minimal impact of the symptoms on their daily life. However, the additional health gains for participants in the CBT condition were accompanied by higher costs. Decisions on the further implementation of CBT are dependent on what decision makers are willing to pay for the incremental health gains. In this study, CBT was more likely to be cost-effective than TAU when the willingness to pay for an additional day of normal functioning gained would be higher than €47.

The overall mean total cost estimates per participant appeared to be in line with a recent economic study aimed at first-episode psychosis, Reference Stant, TenVergert, Wunderink, Nienhuis and Wiersma3 and were generally higher than other cost results published in the last decade. Reference Wykes, Steel, Everitt and Tarrier10Reference Stant, TenVergert, Groen, Jenner, Nienhuis and van de Willige14 This may at least be partially because of the widening scope of costs included in economic studies, differences in costing methods applied, and increased use of more expensive antipsychotics in recent years. Furthermore, this study confirmed the widely acknowledged influence of hospital admissions Reference Stant, TenVergert, Wunderink, Nienhuis and Wiersma3,Reference Knapp, Chisholm, Leese, Amaddeo, Tansella and Schene32 on the total costs in patient populations with psychosis.

Fig. 3 Cost-effectiveness acceptability curves based on the standard analysis and the additionally conducted sensitivity analyses. CBT, cognitive–behavioural therapy.

Hospital admissions and CBT

Although the experimental group was more likely to experience normal functioning, they also had double the in-patient costs. We have looked into the distribution of the days spent in hospital. These are skewed and the CBT group had 21 participants and the TAU group 15 participants with more than 60 in-patient days. The top seven outliers in the CBT group consumed 60% of all in-patient days. Five of these people were already long-stay in-patients when they were included in the study. It seems to us that CBT did neither cause admission nor lengthened the hospital stay. Six of the participants had almost no exposure to CBT and stopped after an average of 2.5 sessions with zero days of normal functioning. The one person that did have 19 sessions of CBT also improved to normal functioning for a period of 182 days.


Important strengths of this study are the naturalistic study design and the relatively large number of participants. The study can be generalised to people with schizophrenia-spectrum disorders with persistent psychosis, because the number of exclusions is quite small. Medication was not kept fixed during the trial. Many medication regimes were switched during the study or dosages were calibrated to optimum levels. Only 54 people (12.6%) were excluded because of primary addiction, low IQ or no competence in the Dutch language; and 38 potential participants (8.8%) because they had undergone CBT in the past. A total of 120 people (28%) refused to take part in the study, which is comparable with previous findings in such studies. Of the 110 individuals who were randomised to the CBT group, only 12 individuals (11.0%) stopped treatment prematurely, which indicates that the intervention was very well tolerated. Furthermore, the participating therapists all worked in routine care services all over the country. All participants fulfilled broad inclusion criteria. Contrary to efficacy trials, individuals with disorganised and undifferentiated symptoms were not excluded, although communication, memory, learning potential and acting on plans are all compromised in these participants. Individuals in these subgroups had higher symptom scores than the paranoid and schizoaffective subgroups, and although they improved over time, they were still more symptomatic. In this real-life environment the CBT group attained normal functioning more often than the TAU group.

Another strength of the study is the long follow-up period. Importantly, the effects of CBT may wane over time, while the costs are stable after the intervention period. If individuals benefit from CBT after 18 months, making no additional therapy costs, the costs per day of normal functioning would reduce further. Long follow-up periods are more realistic in a relapsing condition such as schizophrenia. There will always be more moderate results on the outcome measures, but the mean accumulating costs will reduce after therapy termination.


This study also had several limitations from both a clinical and economic point of view. First, CBT in psychosis is a complex intervention that requires expertise in psychopathology and treatment techniques. Some of the therapists were novices and trained and supervised during the study, but for optimum performance several years of experience are required. Reference Wykes, Hayward, Thomas, Surguladze, Fannon and Landau33 This might explain site differences that resulted from different admission policies and differences in the expertise of the therapists. Also the commitment to supervision varied between centres.

Second, the primary outcome measure applied in this study is of concern. In the field of health technology assessment, there have been debates on the topic of adequate outcome measures for economic evaluations. Currently, most guidelines recommend the use of quality-adjusted life-years (QALYs). The primary outcome measure used in this study, days of normal functioning, does also seem to be relevant for policy decisions. However, the outcome cannot directly be compared with QALY analysis used in other studies. Moreover, there is no consensus on acceptable (cost) benchmarks per additional day of normal functioning gained. For the moment, policy makers will have to decide whether the presented willingness to pay values, and the associated probability outcomes, justify the (further) implementation of CBT in the healthcare system.

The final limitation concerns the generalisability of current findings to other healthcare systems. Directly transferring current results may be troublesome, not only because of substantial differences in healthcare systems but also to (international) variations in the costing methods applied.

When we consider the findings of this study, we must state that effects on symptoms as measured with the PANSS were absent, but that CBT did succeed in reducing the suffering from persistent psychotic symptoms and their impact on daily life and improved social functioning. Cognitive–behavioural therapy is not a quasi-antipsychotic. Psychotic symptoms can persevere, but the individual's appraisal of psychosis can be changed with CBT. Reductions in mood symptoms more than reductions in psychotic symptoms probably facilitate emotional well-being and social functioning in these individuals. This was also found in a recent trial to prevent relapse with CBT. Reference Garety, Fowler, Freeman, Bebbington, Dunn and Kuipers34


This study was supported by grant of the Netherlands Organization for Health Research and Development (ZonMW) and the contributions of the Universities of Groningen and Utrecht and the mental healthcare organisations Lentis, GGZ Drenthe, Mediant, Dimence, Altrecht, Parnassia and the Grote Rivieren.


We thank all the patients, therapists, research assistants and researchers who participated in this study.


This study was supported by grant 945-04-406 of the Netherlands Organization for Health Research and Development (ZonMW) and the contributions of the Universities of Groningen and Utrecht and the mental healthcare organisations Lentis, GGZ Drenthe, Mediant, Dimence, Altrecht, Parnassia and the Grote Rivieren.

Declaration of interest



1 World Health Organization. Mental health: New Understanding, New Hope. WHO, 2001.Google Scholar
2 Mangalore, R, Knapp, M. Cost of schizophrenia in England. J Ment Health Policy Econ 2007; 10: 2341.Google ScholarPubMed
3 Stant, AD, TenVergert, EM, Wunderink, A, Nienhuis, FJ, Wiersma, D. Economic consequences of alternative medication strategies in first episode non-affective psychosis. Eur Psychiatry 2007; 22: 347–53.CrossRefGoogle ScholarPubMed
4 Jones, C, Cormac, I, Silveira da Mota Neto JI, Campbell C. Cognitive behaviour therapy for schizophrenia. Cochrane Database Syst Rev 2004; 4: CD000524.Google Scholar
5 Pilling, S, Bebbington, P, Kuipers, E, Garety, P, Geddes, J, Orbach, G, et al. Psychological treatments in schizophrenia: I. Meta-analysis of family intervention and cognitive behaviour therapy. Psychol Med 2002; 32: 763–82.CrossRefGoogle ScholarPubMed
6 National Collaborating Centre for Mental Health. Core Interventions in the Treatment and Management of Schizophrenia in the Primary and Secondairy Care (Update). National Institute for Health and Clinical Excellence, 2009.Google Scholar
7 Tarrier, N, Wykes, T. Is there evidence that cognitive behaviour therapy is an effective treatment for schizophrenia? A cautious or cautionary tale? Behav Res Ther 2004; 42: 1377–401.CrossRefGoogle ScholarPubMed
8 Zimmermann, G, Favrod, J, Trieu, VH, Pomini, V. The effect of cognitive behavioral treatment on the positive symptoms of schizophrenia spectrum disorders: a meta-analysis. Schizophr Res 2005; 77: 19.CrossRefGoogle ScholarPubMed
9 Pfammatter, M, Junghan, UM, Brenner, HD. Efficacy of psychological therapy in schizophrenia: conclusions from meta-analyses. Schizophr Bull 2006; 32 (suppl 1): S6480.CrossRefGoogle ScholarPubMed
10 Wykes, T, Steel, C, Everitt, B, Tarrier, N. Cognitive behavior therapy for schizophrenia: effect sizes, clinical models, and methodological rigor. Schizophr Bull 2008; 34: 523–37.Google ScholarPubMed
11 Drury, V, Birchwood, M, Cochrane, R, Macmillan, F. Cognitive therapy and recovery from acute psychosis: a controlled trial. II. Impact on recovery time. Br J Psychiatry 1996; 169: 602–7.Google ScholarPubMed
12 Tarrier, N, Yusupoff, L, Kinney, C, McCarthy, E, Gledhill, A, Haddock, G, et al. Randomised controlled trial of intensive cognitive behaviour therapy for patients with chronic schizophrenia. BMJ 1998; 317: 303–7.CrossRefGoogle ScholarPubMed
13 Kuipers, E, Fowler, D, Garety, P, Chisholm, D, Freeman, D, Dunn, G, et al. London–east Anglia randomised controlled trial of cognitive–behavioural therapy for psychosis. III: Follow-up and economic evaluation at 18 months. Br J Psychiatry 1998; 173: 61–8.CrossRefGoogle ScholarPubMed
14 Stant, AD, TenVergert, EM, Groen, H, Jenner, JA, Nienhuis, FJ, van de Willige, G, et al. Cost-effectiveness of the HIT programme in patients with schizophrenia and persistent auditory hallucinations. Acta Psychiatr Scand 2003; 107: 361–8.CrossRefGoogle ScholarPubMed
15 Startup, M, Jackson, MC, Evans, KE, Bendix, S. North Wales randomized controlled trial of cognitive behaviour therapy for acute schizophrenia spectrum disorders: two-year follow-up and economic evaluation. Psychol Med 2005; 35: 1307–16.CrossRefGoogle ScholarPubMed
16 American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (4th edn, revised) (DSM–IV–TR). APA, 2000.Google Scholar
17 Kay, SR, Fiszbein, A, Opler, LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr Bull 1987; 13: 261–76.CrossRefGoogle Scholar
18 Haddock, G, McCarron, J, Tarrier, N, Faragher, EB. Scales to measure dimensions of hallucinations and delusions: the psychotic symptom rating scales (PSYRATS). Psychol Med 1999; 29: 879–89.CrossRefGoogle Scholar
19 Birchwood, M, Smith, J, Cochrane, R, Wetton, S, Copestake, S. The Social Functioning Scale. The development and validation of a new scale of social adjustment for use in family intervention programmes with schizophrenic patients. Br J Psychiatry 1990; 157: 853–9.CrossRefGoogle ScholarPubMed
20 World Health Organization. Quality of Life (WHO-QoL). WHO, 2004.Google Scholar
21 Young, JE, Beck, AT. Cognitive Therapy Scale Rating Manual. University of Pennsylvania Center for Psychotherapy Research, 1980.Google Scholar
22 Haddock, G, Devane, S, Bradshaw, T, McGovern, J, Tarrier, N, Kinderman, P, et al. An investigation into the psychometric properties of the cognitive therapy scale for psychosis (CTS-Psy). Behav Cogn Psychother 2001; 29: 221–33.CrossRefGoogle Scholar
23 Koopmanschap, MA, Rutten, FF, van Ineveld, BM, van Roijen, L. The friction cost method for measuring indirect costs of disease. J Health Econ 1995; 14: 171–89.CrossRefGoogle ScholarPubMed
24 Jakob-Tacken, KHM, Koopmanschap, MA, Meerding, WK, Severens, JL. Correcting for compensating mechanisms related to productivity costs in economic evaluations of healthcare programmes. Health Economics 2005;14: 435–43.Google Scholar
25 Oostenbrink, JB, Bouwmans, CAM, Koopmanschap, MA, Rutten, FFH. Handleiding voor Kostenonderzoek. Methoden en Standaardprijzen voor Economische Evaluaties in de Gezondheidszorg. Geactualiseerde Versie 2004. [Manual for Cost Analyses, Methods and Standard Prices for Economic Evaluation in Health Care.] College voor zorgverzekeringen, 2004.Google Scholar
26 Drummond, MF, Sculpher, MJ, Torrance, GW, O'Brien, BJ, Stoddart, GL. Methods for the Economic Evaluation of Health Care Programmes. Oxford University Press, 2005.Google Scholar
27 Efron, B, Tibshirani, RJ. An Introduction to the Bootstrap. Chapman & Hall, 1993.CrossRefGoogle Scholar
28 Black, WC. The CE plane: a graphic representation of cost-effectiveness. Med Decis Making 1990; 10: 212–4.CrossRefGoogle ScholarPubMed
29 Fenwick, E, O'Brien, BJ, Briggs, A. Cost-effectiveness acceptability curves – facts, fallacies and frequently asked questions. Health Econ 2004; 13: 405–15.CrossRefGoogle ScholarPubMed
30 Oostenbrink, JB, Al, MJ. The analysis of incomplete cost data due to dropout. Health Econ 2005; 14: 763–76.CrossRefGoogle ScholarPubMed
31 R Development Core team. A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, 2005.Google Scholar
32 Knapp, M, Chisholm, D, Leese, M, Amaddeo, F, Tansella, M, Schene, A, et al. Comparing patterns and costs of schizophrenia care in five European countries: the EPSILON study. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Acta Psychiatr Scand 2002; 105: 4254.CrossRefGoogle ScholarPubMed
33 Wykes, T, Hayward, P, Thomas, N, Surguladze, S, Fannon, D, Landau, S. What are the effects of group cognitive behaviour therapy for voices? A randomized control trial. Schizophr Res 2005; 77: 201310.CrossRefGoogle Scholar
34 Garety, PA, Fowler, DG, Freeman, D, Bebbington, P, Dunn, G, Kuipers, E. Cognitive–behavioural therapy and family intervention for relapse prevention and symptom reduction in psychosis: randomised controlled trial. Br J Psychiatry 2008; 192: 412–23.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1 The flow of the participants in the study. CBT, cognitive–behavioural therapy; TAU, treatment as usual.

Figure 1

Table 1 Demographic characteristics of cognitive–behavioural therapy (CBT) and treatment as usual (TAU) groups

Figure 2

Table 2 Number of participants with normal functioning at different time points for the cognitive–behavioural therapy (CBT) and treatment as usual (TAU) groups: intention-to-treat

Figure 3

Table 3 Differential effects of cognitive–behavioural therapy (CBT) and treatment as usual (TAU) on symptoms and quality of life over the study period

Figure 4

Table 4 Mean total costs (Euro, price level of 2007) during the study

Figure 5

Fig. 2 Results of the cost-effectiveness analysis and bootstrap method.CCBT, mean costs in the cognitive–behavioural therapy (CBT) group; CTAU, mean costs in the treatment as usual (TAU) group; DNFCBT, mean days of normal functioning in the CBT group; DNFTAU, mean days of normal functioning in the TAU group. The white circle is the point estimate of the incremental cost-effectiveness ratio.

Figure 6

Fig. 3 Cost-effectiveness acceptability curves based on the standard analysis and the additionally conducted sensitivity analyses. CBT, cognitive–behavioural therapy.

Supplementary material: PDF

van der Gaag et al. supplementary material

Supplementary Table S1

Download van der Gaag et al. supplementary material(PDF)
Submit a response


No eLetters have been published for this article.