Hostname: page-component-cd4964975-8cclj Total loading time: 0 Render date: 2023-03-29T18:02:28.785Z Has data issue: true Feature Flags: { "useRatesEcommerce": false } hasContentIssue true

Authors' reply

Published online by Cambridge University Press:  02 January 2018

P. J. McKenna
Fidmag Germanes Hospitalàries Research Foundation and CIBERSAM, Spain. Email:
J. Radua
Fidmag Germanes Hospitalàries Research Foundation and CIBERSAM, Spain. Email:
K. R. Laws
School of Life and Medical Sciences, University of Hertfordshire, UK
S. Jauhar
Department of Psychosis Studies, Institute of Psychiatry, London, UK
Rights & Permissions[Opens in a new window]


Copyright © Royal College of Psychiatrists, 2014 

One of the founding principles of meta-analysis is to pool data from as many studies as possible. Reference Hunt1 Among other benefits this prevents studies being preselected for consideration on arbitrary grounds. It is difficult to imagine anything more arbitrary than restricting a meta-analysis of CBT for schizophrenia to studies that conform to some notional interpretation of the NICE guideline, as Peters seems to be suggesting, not to mention excluding any that were in Chinese.

Similarly, it would be wrong to exclude studies that used group CBT a priori. Here, though, it is entirely legitimate to examine this issue post hoc; that is, to ask whether use of group v. individual CBT significantly moderates effect size. Carrying out this analysis on our data reveals that the pooled effect sizes for both types of intervention were very similar in the meta-analysis of overall symptoms (effect size in 7 group studies –0.24 v. –0.23 in 24 individual studies; Q = 0.006; P = 0.94); for positive symptoms, group CBT had a non-significantly smaller effect size than individual CBT (effect size in 8 group studies –0.08 v. –0.25 in 23 individual studies; Q = 1.73; P = 0.19) (across both analyses, one study employed both group and individual CBT and three were rated as ‘unclear’). This might or might not be considered evidence that group CBT is less effective than individual CBT, but what it does not mean is that inclusion of group studies in our original meta-analyses somehow acted to dilute the pooled estimate - the effect sizes for studies using individual CBT are similar or lower to those we reported for all studies combined (effect sizes were –0.33 for overall symptoms and –0.25 for positive symptoms).

With regard to some of the other points raised by Peters, our diagnostic criteria were broad and similar to those used by NICE, Wykes et al and the Cochrane Collaboration. We recognised the possibility that Acceptance and Commitment Therapy might be different from regular CBT and presented an analysis in the article excluding two studies using this Reference White, Gumley, McTaggart, Rattrie, McConville and Cleare2,Reference Gaudiano and Herbert3 and another where CBT took the form predominantly of coping skills enhancement; Reference Leclerc, Lesage, Ricard, Lecomte and Cyr4 this did not materially affect the results. Peters expresses surprise over our decision to exclude studies that specifically targeted hallucinations from the meta-analysis of positive symptoms. As it happens, only three studies of hallucination-directed CBT also reported outcomes for positive symptoms. Adding the data from two of them Reference Penn, Meyer, Evans, Wirth, Cai and Burchinal5,Reference Shawyer, Farhall, Mackinnon, Trauer, Simms and Ratcliff6 (data cannot be extracted from one study Reference Trower, Birchwood, Meaden, Byrne, Nelson and Ross7 ) to the positive symptoms dataset makes no difference to the pooled effect size (–0.25; CI –0.36/–0.13).

Peters argues that there was too much heterogeneity among the results to obtain meaningful pooled estimates. In fact, the Cochrane Collaboration article she cites 8 recommends (a) not pooling data using meta-analysis, (b) investigating heterogeneity using subgroup analysis or meta-regression or (c) using a random-effects model for meta-analysis, as this includes consideration of heterogeneity in the effect-size estimate. The authors also note that ‘even though a random-effects model helps to consider heterogeneity, it does not remove it - heterogeneity still needs to be considered in interpreting the results’. We used a random-effects model and examined heterogeneity.

We would like to reiterate that for those who wish to examine for themselves other points of the type raised by Peters, a detailed database of the studies we included is available online (


1 Hunt, N. How Science Takes Stock: The Story of Meta-Analysis. Sage, 1997.Google Scholar
2 White, R, Gumley, A, McTaggart, J, Rattrie, L, McConville, D, Cleare, S, et al. A feasibility study of Acceptance and Commitment Therapy for emotional dysfunction following psychosis. Behav Res Ther 2011; 49: 90–7.CrossRefGoogle ScholarPubMed
3 Gaudiano, BA, Herbert, JD. Acute treatment of inpatients with psychotic symptoms using Acceptance and Commitment Therapy: pilot results. Behav Res Ther 2006; 44: 415–37.CrossRefGoogle ScholarPubMed
4 Leclerc, C, Lesage, AD, Ricard, N, Lecomte, T, Cyr, M. Assessment of a new rehabilitative coping skills module for persons with schizophrenia. Am J Orthopsychiatry 2000; 70: 380–8.CrossRefGoogle ScholarPubMed
5 Penn, DL, Meyer, PS, Evans, E, Wirth, RJ, Cai, K, Burchinal, M. A randomized controlled trial of group cognitive-behavioral therapy v. enhanced supportive therapy for auditory hallucinations. Schizophr Res 2009; 109: 522–9.CrossRefGoogle Scholar
6 Shawyer, F, Farhall, J, Mackinnon, A, Trauer, T, Simms, E, Ratcliff, K, et al. A randomised controlled trial of acceptance-based cognitive behavioural therapy for command hallucinations in psychotic disorders. Behav Res Ther 2012; 50: 110–21.CrossRefGoogle ScholarPubMed
7 Trower, P, Birchwood, M, Meaden, A, Byrne, S, Nelson, A, Ross, K. Cognitive therapy for command hallucinations: randomised controlled trial. Br J Psychiatry 2004; 184: 312–20.CrossRefGoogle ScholarPubMed
8 Cochrane Consumers and Communication Review Group; Ryan R. Heterogeneity and Subgroup Analyses in Cochrane Consumers and Communication Review Group Reviews: Planning the Analysis at Protocol Stage. February 2014 ( Scholar
Submit a response


No eLetters have been published for this article.