Skip to main content Accessibility help
×
×
Home

Is psychotherapy effective? A re-analysis of treatments for depression

  • T. Munder (a1), C. Flückiger (a2), F. Leichsenring (a3), A. A. Abbass (a4), M. J. Hilsenroth (a5), P. Luyten (a6) (a7), S. Rabung (a8), C. Steinert (a3) (a9) and B. E. Wampold (a10) (a11)...

Abstract

Aims

The aim of this study was to reanalyse the data from Cuijpers et al.'s (2018) meta-analysis, to examine Eysenck's claim that psychotherapy is not effective. Cuijpers et al., after correcting for bias, concluded that the effect of psychotherapy for depression was small (standardised mean difference, SMD, between 0.20 and 0.30), providing evidence that psychotherapy is not as effective as generally accepted.

Methods

The data for this study were the effect sizes included in Cuijpers et al. (2018). We removed outliers from the data set of effects, corrected for publication bias and segregated psychotherapy from other interventions. In our study, we considered wait-list (WL) controls as the most appropriate estimate of the natural history of depression without intervention.

Results

The SMD for all interventions and for psychotherapy compared to WL controls was approximately 0.70, a value consistent with past estimates of the effectiveness of psychotherapy. Psychotherapy was also more effective than care-as-usual (SMD = 0.31) and other control groups (SMD = 0.43).

Conclusions

The re-analysis reveals that psychotherapy for adult patients diagnosed with depression is effective.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Is psychotherapy effective? A re-analysis of treatments for depression
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Is psychotherapy effective? A re-analysis of treatments for depression
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Is psychotherapy effective? A re-analysis of treatments for depression
      Available formats
      ×

Copyright

Corresponding author

Author for correspondence: Bruce E. Wampold, E-mail: wampold@education.wisc.edu

References

Hide All
Ahola, P, Joensuu, M, Knekt, P, Lindfors, O, Saarinen, P, Tolmunen, T, Valkonen-Korhonen, M, Jääskeläinen, T, Virtala, E, Tiihonen, J and Lehtonen, J (2017) Effects of scheduled waiting for psychotherapy in patients with major depression. Journal of Nervous and Mental Disease 205, 611617.
Armento, ME (2012) Behavioral activation of religious behaviors: treating depressed college students with a randomized controlled trial (Doctoral Dissertation). University of Tennessee, Knoxville.
Armijo-Olivo, S, Ospina, M, da Costa, BR, Egger, M, Saltaji, H, Fuentes, J and Cummings, GG (2014) Poor reliability between cochrane reviewers and blinded external reviewers when applying the Cochrane risk of bias tool in physical therapy trials. PLoS One 9, e96920.
Baskin, TW, Tierney, SC, Minami, T and Wampold, BE (2003) Establishing specificity in psychotherapy: a meta-analysis of structural equivalence of placebo controls. Journal of Consulting and Clinical Psychology 71, 973979.
Benedetti, F (2014) Placebo effects: Understanding the mechanisms in health and disease, 2nd Edn. New York, NY, US: Oxford University Press.
Burns, A, Banerjee, S, Morris, J, Woodward, Y, Baldwin, R, Proctor, R, Tarrier, N, Pendleton, N, Sutherland, D and Andrew, G (2007) Treatment and prevention of depression after surgery for hip fracture in older people: randomized, controlled trials. Journal of the American Geriatric Society 55, 7580.
Cristea, IA, Gentili, C, Cotet, CD, Palomba, D, Barbui, C and Cuijpers, P (2017) Efficacy of psychotherapies for borderline personality disorder: a systematic review and meta-analysis. JAMA Psychiatry 74, 319328.
Cuijpers, P, Karyotaki, E, Reijnders, M and Ebert, DD (2018) Was Eysenck right after all? A reassessment of the effects of psychotherapy for adult depression. Epidemiology and Psychiatric Sciences, 110. doi: 10.1017/S2045796018000057.
Del Re, AC, Spielmans, GI, Flückiger, C and Wampold, BE (2013) Efficacy of new generation antidepressants: differences seem illusory. PLoS ONE 8, e63509.
Dimidjian, S, Hollon, SD, Dobson, KS, Schmaling, KB, Kohlenberg, RJ, Addis, ME, Gallop, R, McGlinchey, JB, Markley, DK, Gollan, JK, Atkins, DC, Dunner, DL and Jacobson, NS (2006) Randomized trial of behavioral activation, cognitive therapy, and antidepressant medication in the acute treatment of adults with major depression. Journal of Consulting and Clinical Psychology 74, 658670.
Dowrick, C, Dunn, G, Ayuso-Mateos, JL, Dalgard, OS, Page, H, Lehtinen, V, Casey, P, Wilkinson, C, Vazquez-Barquero, JL and Wilkinson, G (2000) Problem solving treatment and group psychoeducation for depression: multicentre randomised controlled trial. BMJ 321, 1450.
Elkin, I, Shea, MT, Watkins, JT, Imber, SD, Sotsky, SM, Collins, JF, Glass, DR, Pilkonis, PA, Leber, WR, Docherty, JP, Fiester, SJ and Parloff, MB (1989) National Institute of Mental Health Treatment of Depression Collaborative Research Program. General effectiveness of treatments. Archives of General Psychiatry 46, 971982.
Eysenck, HJ (1952) The effects of psychotherapy: an evaluation. Journal of Consulting Psychology 16, 319324.
Eysenck, HJ (1961) The effects of psychotherapy. In Eysenck, HJ (ed.) Handbook of Abnormal Psychology. New York: Basic Books, pp. 697725.
Eysenck, HJ (1966) The effects of psychotherapy. New York: International Science Press.
Eysenck, HJ (1978) An exercise in meta-silliness. American Psychologist 33, 517.
Eysenck, HJ (1984) Meta-analysis: an abuse of research integration. The Journal of Special Education 18, 4159.
Eysenck, HJ (1995) Meta-analysis squared—does it make sense? American Psychologist 50, 110111.
Floyd, M, Scogin, F, McKendree-Smith, NL, Floyd, DL and Rokke, PD (2004) Cognitive therapy for depression: a comparison of individual psychotherapy and bibliotherapy for depressed older adults. Behavior Modification 28, 297318.
Frank, JD and Frank, JB (1991) Persuasion and healing: A comparative study of psychotherapy, 3rd Edn. Baltimore: Johns Hopkins University Press.
Furukawa, TA, Noma, H, Caldwell, DM, Honyashiki, M, Shinohara, K, Imai, H, Chen, P, Hunot, V and Churchill, R (2014) Waiting list may be a nocebo condition in psychotherapy trials: a contribution from network meta-analysis. Acta Psychiatrica Scandinavica 130, 181192.
Glass, GV (2015) Meta-analysis at middle age: a personal history. Research Synthesis Methods 6, 221231.
Glass, GV and Kliegl, RM (1983) An apology for research integration in the study of psychotherapy. Journal of Consulting and Clinical Psychology 51, 2841.
Hartling, L, Hamm, M, Milne, A, Vandermeer, B, Santaguida, PL, Ansari, M, Tsertsvadze, A, Hempel, S, Shekelle, P and Dryden, DM (2012) Validity and inter-rater reliability testing of quality assessment instruments. Rockville, MD: AHRQ Publication, No. 12-EHC039-EF.
Hegerl, U, Hautzinger, M, Mergl, R, Kohnen, R, Schütze, M, Scheunemann, W, Altgaier, A, Coyne, J and Henkel, V (2010) Effects of pharmacotherapy and psychotherapy in depressed primary-care patients: a randomized, controlled trial including a patients’ choice arm. International Journal of Neuropsychopharmacology 13, 3144.
Higgins, JPT and Green, S (2011) Cochrane handbook for systematic reviews of interventions (Version 5.1.0). Available at http://handbook-5-1.cochrane.org/.
Honyashiki, M, Furukawa, TA, Noma, H, Tanaka, S, Chen, P, Ichikawa, K, Ono, M, Churchill, R, Hunot, V and Caldwell, DM (2014) Specificity of CBT for depression: a contribution from multiple treatments meta-analyses. Cognitive Therapy and Research 38, 249260.
Jansen, JP and Naci, H (2013) Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers. BMC Medicine 11, 159159.
Kirsch, I (2002) Yes, there is a placebo effect, but is there a powerful antidepressant drug effect? Prevention & Treatment 5. doi: 10.1037/1522-3736.5.1.522i.
Kirsch, I (2009) Antidepressants and the placebo response. Epidemiology and Psychiatric Sciences 18, 318322.
Kirsch, I (2010) The emperor's new drugs: Exploding the antidepressant myth. New York: Basic Books.
Kirsch, I, Deacon, BJ, Huedo-Medina, TB, Scoboria, A, Moore, TJ and Johnson, BT (2008) Initial severity and antidepressant benefits: a meta-analysis of data submitted to the food and drug administration. PLoS Medicine 5, 260268.
Laird, KT, Tanner-Smith, EE, Russell, AC, Hollon, SD and Walker, LS (2017) Comparative efficacy of psychological therapies for improving mental health and daily functioning in irritable bowel syndrome: a systematic review and meta- analysis. Clinical Psychology Review 51, 142152.
Lamers, F, Jonkers, CC, Bosma, H, Kempen, GI, Meijer, JA, Penninx, BW, Knottnerus, JA and van Eijk, JT (2010) A minimal psychological intervention in chronically ill elderly patients with depression: a randomized trial. Psychotherapy and Psychosomatics 79, 217226.
Lilienfeld, SO (2007) Psychological treatments that cause harm. Perspectives on Psychological Science 2, 5370.
Losada, A, Márquez-González, M, Romero-Moreno, R, Mausbach, BT, López, J, Fernández-Fernández, V and Nogales-González, C (2015) Cognitive–behavioral therapy (CBT) versus acceptance and commitment therapy (ACT) for dementia family caregivers with significant depressive symptoms: results of a randomized clinical trial. Journal of Consulting and Clinical Psychology 83, 760772.
Milgrom, J, Negri, LM, Gemmill, AW, McNeil, M and Martin, PR (2005) A randomized controlled trial of psychological interventions for postnatal depression. British Journal of Clinical Psychology 44, 529542.
Miller, FG, Colloca, L and Kaptchuk, TJ (2009) The placebo effect: illness and interpersonal healing. Perspectives in Biology and Medicine 52, 518539.
Minami, T, Wampold, BE, Serlin, RC, Kircher, JC and Brown, GSJ (2007) Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology 75, 232243.
Munder, T and Barth, J (2018) Cochrane's risk of bias tool in the context of psychotherapy outcome research. Psychotherapy Research 28, 347355.
Munder, T, Gerger, H, Trelle, S and Barth, J (2011) Testing the allegiance bias hypothesis: a meta-analysis. Psychotherapy Research 21, 670684.
Munder, T, Flückiger, C, Gerger, H, Wampold, BE and Barth, J (2012) Is the allegiance effect an epiphenomenon of true efficacy differences between treatments? A meta-analysis. Journal of Counseling Psychology 59, 631637.
Munder, T, Brütsch, O, Leonhart, R, Gerger, H and Barth, J (2013) Researcher allegiance in psychotherapy outcome research: an overview of reviews. Clinical Psychology Review 33, 501511.
Posternack, MA and Miller, I (2001) Untreated short-term course of major depression: a meta-analysis of outcomes from studies using wait-list control groups. Journal of Affective Disorders 66, 139146.
Power, MJ and Freeman, C (2012) A randomized controlled trial of IPT versus CBT in primary care: with some cautionary notes about handling missing values in clinical trials. Clinical Psychology and Psychotherapy 19, 159169.
Price, DP, Finniss, DG and Benedetti, F (2008) A comprehensive review of the placebo effect: recent advances and current thought. Annual Review of Psychology 59, 565590.
Saloheimo, HP, Markowitz, J, Saloheimo, TH, Laitinen, JJ, Sundell, J, Huttunen, MO, Aro, TA, Mikkonen, TN and Katila, HO (2016) Psychotherapy effectiveness for major depression: a randomized trial in a Finnish community. BMC Psychiatry 16, 131.
Shadish, WR, Cook, TD and Campbell, DT (2002) Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
Smith, ML and Glass, GV (1977) Meta-analysis of psychotherapy outcome studies. American Psychologist 32, 752760.
Smith, ML, Glass, GV and Miller, TI (1980) The benefits of psychotherapy. Baltimore: The Johns Hopkins University Press.
Smits, JAJ and Hofmann, SG (2009) A meta-analytic review of the effects of psychotherapy control conditions for anxiety disorders. Psychological Medicine 39, 229239.
Spielmans, GI, Gatlin, ET and McFall, JP (2010) The efficacy of evidence-based psychotherapies versus usual care for youths: controlling confounds in a meta-reanalysis. Psychotherapy Research 20, 234246.
Spinelli, MG and Endicott, J (2003) Controlled clinical trial of interpersonal psychotherapy versus parenting education program for depressed pregnant women. American Journal of Psychiatry 160, 555562.
Stegenga, BT, Kamphuis, MH, King, M, Nazareth, I and Geerlings, MI (2012) The natural course and outcome of major depressive disorder in primary care: the PREDICT-NL study. Social Psychiatry and Psychiatric Epidemiology 47, 8795.
Tukey, JW (1962) The future of data analysis. The Annals of Mathematical Statistics 33, 167.
van Bastelaar, KM, Cuijpers, P, Pouwer, F, Riper, H and Snoek, FJ (2011) Development and reach of a web-based cognitive behavioural therapy programme to reduce symptoms of depression and diabetes-specific distress. Patient Education and Counseling 84, 4955.
Viechtbauer, W (2010) Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 36, 148.
Viechtbauer, W and Cheung, MW-L (2010) Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods 1, 112125.
Wampold, BE (2013) The good, the bad, and the ugly: a 50-year perspective on the outcome problem. Psychotherapy 50, 1624.
Wampold, BE, Budge, SL, Laska, KM, Del Re, AC, Baardseth, TP, Flückiger, C, Minami, T, Kivlighan, DM II and Gunn, W (2011) Evidence-based treatments for depression and anxiety versus treatment-as-usual: a meta-analysis of direct comparisons. Clinical Psychology Review 31, 13041312.
Wampold, BE, Flückiger, C, Del Re, AC, Yulish, NE, Frost, ND, Pace, BT, Goldberg, SB, Miller, SD, Baardseth, TP, Laska, KM and Hilsenroth, MJ (2017) In pursuit of truth: a critical examination of meta-analyses of cognitive behavior therapy. Psychotherapy Research 27, 1432.
Wampold, BE and Imel, ZE (2015) The great psychotherapy debate: The research evidence for what works in psychotherapy, 2nd Edn. New York: Routledge.
Wampold, BE, Minami, T, Tierney, SC, Baskin, TW and Bhati, KS (2005) The placebo is powerful: estimating placebo effects in medicine and psychotherapy from clinical trials. Journal of Clinical Psychology 61, 835854.
Wampold, BE and Serlin, RC (2014) Meta-analytic methods to test relative efficacy. Quality and Quantity 48, 755765.
Watt, LM and Cappeliez, P (2000) Integrative and instrumental reminiscence therapies for depression in older adults: intervention strategies and treatment effectiveness. Aging and Mental Health 4, 166177.
Wartolowska, K, Judge, A, Hopewell, S, Collins, GS, Dean, BJF, Rombach, I, Brindley, D, Uehiro, S, Beard, DJ and Carr, AJ (2014) Use of placebo controls in the evaluation of surgery: systematic review. British Medical Journal 348, 11.
Wiersma, JE, Van Schaik, DJ, Hoogendorn, AW, Dekker, JJ, Van, HL, Schoevers, RA, Blom, MBJ, Maas, K, Smit, JH, McCullough, JP Jr., Beekman, ATF, and Beekman, AT (2014) The effectiveness of the cognitive behavioral analysis system of psychotherapy for chronic depression: a randomized controlled trial. Psychotherapy and Psychosomatics 83, 263269.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Epidemiology and Psychiatric Sciences
  • ISSN: 2045-7960
  • EISSN: 2045-7979
  • URL: /core/journals/epidemiology-and-psychiatric-sciences
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed