Skip to main content Accessibility help
×
×
Home

Was Eysenck right after all? A reassessment of the effects of psychotherapy for adult depression

  • P. Cuijpers (a1), E. Karyotaki (a1), M. Reijnders (a1) and D. D. Ebert (a2)

Abstract

Aims.

In the 1950s, Eysenck suggested that psychotherapies may not be effective at all. Twenty-five years later, the first meta-analysis of randomised controlled trials showed that the effects of psychotherapies were considerable and that Eysenck was wrong. However, since that time methods have become available to assess biases in meta-analyses.

Methods.

We examined the influence of these biases on the effects of psychotherapies for adult depression, including risk of bias, publication bias and the exclusion of waiting list control groups.

Results.

The unadjusted effect size of psychotherapies compared with control groups was g = 0.70 (limited to Western countries: g = 0.63), which corresponds to a number-needed-to-treat of 4.18. Only 23% of the studies could be considered as a low risk of bias. When adjusting for several sources of bias, the effect size across all types of therapies dropped to g = 0.31.

Conclusions.

These results suggest that the effects of psychotherapy for depression are small, above the threshold that has been suggested as the minimal important difference in the treatment of depression, and Eysenck was probably wrong. However, this is still not certain because we could not adjust for all types of bias. Unadjusted meta-analyses of psychotherapies overestimate the effects considerably, and for several types of psychotherapy for adult depression, insufficient evidence is available that they are effective because too few low-risk studies were available, including problem-solving therapy, interpersonal psychotherapy and behavioural activation.

Copyright

Corresponding author

*Address for correspondence: Pim Cuijpers, Department of Clinical, Neuro and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Van der Boechorststraat 1, 1081 BT Amsterdam, The Netherlands. (E-mail: p.cuijpers@vu.nl)

References

Hide All
Barth, J, Munder, T, Gerger, H, Nuesch, E, Trelle, S, Znoj, H, Juni, P, Cuijpers, P (2013). Comparative efficacy of seven psychotherapeutic interventions for patients with depression: a network meta-analysis. PLoS Medicine 10, e1001454.
Bergin, AE, Lambert, MJ (1971). The evaluation of therapeutic outcomes. In Handbook of Psychotherapy and Behavior Change (ed. Garfield, SL and Bergin, AE), pp. 139189. Wiley: New York.
Borenstein, M, Hedges, LV, Higgins, JPT, Rothstein, HR (2009). Introduction to Meta-Analysis. Wiley: Chichester, UK.
Cuijpers, P (2016 a). Are all psychotherapies equally effective in the treatment of adult depression? The lack of statistical power of comparative outcome studies. Evidence Based Mental Health, ebmental–2016.
Cuijpers, P (2016 b). Meta-Analyses in Mental Health Research; A Practical Guide. Vrije Universiteit: Amsterdam, NL. Available at: https://indd.adobe.com/view/5fc8f9a0-bf1e-49d3-bf5f-a40bfe5409e0
Cuijpers, P, van Straten, A, Warmerdam, L, Andersson, G (2008 a). Psychological treatment of depression: a meta-analytic database of randomized studies. BMC Psychiatry 8, 36.
Cuijpers, P, van Straten, A, Andersson, G, van Oppen, P (2008 b). Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. Journal of Consulting and Clinical Psychology 76, 909922.
Cuijpers, P, Driessen, E, Hollon, SD, van Oppen, P, Barth, J, Andersson, G (2012). The efficacy of non-directive supportive therapy for adult depression: a meta-analysis. Clinical Psychology Review 32, 280291.
Cuijpers, P, Turner, EH, Koole, SL, van Dijke, A, Smit, F (2014). What is the threshold for a clinically relevant effect? The case of major depressive disorders. Depression and Anxiety 31, 374378.
Cuijpers, P, Karyotaki, E, Andersson, G, Li, J, Mergl, R, Hegerl, U (2015). The effects of blinding on the outcomes of psychotherapy and pharmacotherapy for adult depression: a meta-analysis. European Psychiatry 30, 685693.
Cuijpers, P, Cristea, IA, Karyotaki, E, Reijnders, M, Huibers, MJ (2016 a). How effective are cognitive behavior therapies for major depression and anxiety disorders? A meta-analytic update of the evidence. World Psychiatry 15, 245258.
Cuijpers, P, Donker, T, Weissman, MM, Ravitz, P, Cristea, IA (2016 b). Interpersonal psychotherapy for mental health problems: a comprehensive meta-analysis. American Journal of Psychiatry 173, 680687.
Driessen, E, Hegelmaier, LM, Abbass, AA, Barber, JP, Dekker, JJM, Van, HL, Jansma, EP, Cuijpers, P (2015 a). The efficacy of short-term psychodynamic psychotherapy for depression: a meta-analysis update. Clinical Psychology Review 42, 115.
Driessen, E, Hollon, SD, Bockting, CLH, Cuijpers, P, Turner, EH (2015 b). Does publication bias inflate the apparent efficacy of psychological treatment for major depressive disorder? A systematic review and meta-analysis of us national institutes of health-funded trials. PLoS ONE 10, e0137864.
Duval, S, Tweedie, R (2000). Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56, 455463.
Eysenck, HJ (1952). The effects of psychotherapy: an evaluation. Journal of Consulting Psychology 16, 319324.
Furukawa, TA (1999). From effect size into number needed to treat. The Lancet 353, 1680.
Furukawa, TA, Noma, H, Caldwell, DM, Honyashiki, M, Shinohara, K, Imai, H, Chen, P, Hunot, V, Churchill, R (2014). Waiting list may be a nocebo condition in psychotherapy trials: a contribution from network meta-analysis. Acta Psychiatrica Scandinavica 130, 181192.
Glass, GV. (1977). 9: Integrating findings: the meta-analysis of research. Review of Research in Education 5, 351379.
Gold, SM, Enck, P, Hasselmann, H, Friede, T, Hegerl, U, Mohr, DC, Otte, C (2017). Control conditions for randomised trials of behavioural interventions in psychiatry: a decision framework. The Lancet Psychiatry 4, 725732.
Higgins, JPT, Green, S (2011). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration.
Higgins, JPT, Altman, DG, Gøtzsche, PC, Jüni, P, Moher, D, Oxman, AD, Savović, J, Schulz, KF, Weeks, L, Sterne, JAC (2011). The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 343, d5928.
Hunt, M. (1997). How Science Takes Stock: The Story of Meta-Analysis. Russell Sage Foundation: New York.
Jakobsen, JC, Katakam, KK, Schou, A, Hellmuth, SG, Stallknecht, SE, Leth-Møller, K, Iversen, M, Banke, MB, Petersen, IJ, Klingenberg, SL, Krogh, J, Ebert, SE, Timm, A, Lindschou, J, Gluud, C (2017). Selective serotonin reuptake inhibitors versus placebo in patients with major depressive disorder. A systematic review with meta-analysis and Trial Sequential Analysis. BMC Psychiatry 17, 58.
Karyotaki, E, Kleiboer, A, Smit, F, Turner, DT, Pastor, AM, Andersson, G, Berger, T, Botella, C, Breton, JM, Carlbring, P, Christensen, H, de Graaf, E, Griffiths, K, Donker, T, Farrer, L, Huibers, MJH, Lenndin, J, Mackinnon, A, Meyer, B, Moritz, S, Riper, H, Spek, V, Vernmark, K, Cuijpers, P (2015). Predictors of treatment dropout in self-guided web-based interventions for depression: an ‘individual patient data’ meta-analysis. Psychological Medicine 45, 27172726.
Laupacis, A, Sackett, DL, Roberts, RS (1988). An assessment of clinically useful measures of the consequences of treatment. The New England Journal of Medicine 318, 17281733.
Levkovitz, Y, Tedeschini, E, Papakostas, GI (2011). Efficacy of antidepressants for dysthymia: a meta-analysis of placebo-controlled randomized trials. The Journal of Clinical Psychiatry 72, 509514.
Luborsky, L, Singer, B, Luborsky, L (1975). Comparative studies of psychotherapies: is it true that everyone has won and all must have prizes? Archives of General Psychiatry 32, 9951008.
Mohr, DC, Spring, B, Freedland, KE, Beckner, V, Arean, P, Hollon, SD, Ockene, J, Kaplan, R (2009). The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychotherapy and Psychosomatics 78, 275284.
Moncrieff, J, Kirsch, I (2015). Empirically derived criteria cast doubt on the clinical significance of antidepressant-placebo differences. Contemporary Clinical Trials 43, 6062.
Moncrieff, J, Wessely, S, Hardy, R (1998). Meta-analysis of trials comparing antidepressants with active placebos. The British Journal of Psychiatry 172, 227231.
Smith, ML, Glass, GV (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist 32, 752760.
Smith, ML, Glass, GV, Miller, TI (1980). The Benefits of Psychotherapy. Johns Hopkins University Press: Baltimore, Maryland.
Turner, EH, Matthews, AM, Linardatos, E, Tell, RA, Rosenthal, R (2008). Selective publication of antidepressant trials and its influence on apparent efficacy. The New England Journal of Medicine 358, 252260.
van Assen, MA, van Aert, R, Wicherts, JM (2015). Meta-analysis using effect size distributions of only statistically significant studies. Psychological Methods 20, 293309.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Epidemiology and Psychiatric Sciences
  • ISSN: 2045-7960
  • EISSN: 2045-7979
  • URL: /core/journals/epidemiology-and-psychiatric-sciences
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Type Description Title
WORD
Supplementary materials

Cuijpers et al. supplementary material 1
Cuijpers et al. supplementary material

 Word (283 KB)
283 KB

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed