1
Kopta, SM, Howard, KI, Lowry, JL, Beutler, LE. Patterns of symptomatic recovery in
psychotherapy. J Consult Clin Psychol
1994; 62: 1009–16.
2
Gabbard, GO. Long-term Psychodynamic Psychotherapy: A Basic
Text. American Psychiatric
Publishing, 2004.
3
Perry, J, Banon, E, Floriana, I. Effectiveness of psychotherapy for personality
disorders. Am J Psychiatry
1999; 156: 1312–21.
4
Grant, BF, Hasin, DS, Stinson, FS, Dawson, DA, Chou, SP, Ruan, WJ, et al. Prevalence correlates and disability of
personality disorders in the United States. Results from the
International Epidemiologic Survey on Alcohol and Related
Conditions. J Clin Psychiatry
2004; 65: 948–58.
5
Kantojärvi, L, Veijola, J, Laksy, K, Jokelainen, J, Herva, A, Karvonen, JT, et al. Co-occurrence of personality disorders with
mood, anxiety, and substance abuse disorders in a young adult
population. J Pers Disord
2006; 20: 102–12.
6
Lenzenweger, MF, Lane, MC, Loranger, AW, Kessler, RC. Personality disorders in the National Comorbidity
Survey Replication. Biol Psychiatry
2007; 62: 553–64.
7
Gunderson, JG, Morey, LC, Stout, RL, Skodol, AE, Shea, MT, McGlashan, TH, et al. Major depressive disorder and borderline
personality disorder revisited: longitudinal
interactions. J Clin Psychiatry
2004; 65: 1049–56.
8
Elkin, I, Shea, MT, Watkins, JT, Imber, SD, Sotsky, SM, Collins, JF, et al. National Institute of Mental Health Treatment
of Depression Collaborative Research Program. General effectiveness of
treatments. Arch Gen Psychiatry
1989; 46: 971–83.
9
Olfson, M, Fireman, B, Weissman, MM, Leon, AC, Sheehan, DV, Kathol, RG, et al. Mental disorders and disability among
patients in a primary care group practice. Am J
Psychiatry
1997; 154: 1734–40.
10
Ormel, J, VonKorff, M, Ustun, TB, Pini, S, Korten, A, Oldehinkel, T. Common mental disorders and disability across
cultures. Results from the WHO Collaborative Study on Psychological
Problems in General Health Care. JAMA
1994; 272: 1741–8.
11
Bateman, A, Fonagy, P. The effectiveness of partial hospitalization in the
treatment of borderline personality disorder, a randomized controlled
trial. Am J Psychiatry
1999; 156: 1563–9.
12
Bateman, A, Fonagy, P. Treatment of borderline personality disorder with
psychoanalytically oriented partial hospitalization: an 18-month
follow-up. Am J Psychiatry
2001; 158:
36–42.
13
Clarkin, JF, Levy, KN, Lenzenweger, MF, Kernberg, OF. Evaluating three treatments for borderline
personality disorder: a multiwave study. Am J
Psychiatry
2007; 164: 922–8.
14
Linehan, MM, Comtois, KA, Murray, AM, Brown, MZ, Gallop, RJ, Heard, HL, et al. Two-year randomized controlled trial and
follow-up of dialectical behavior therapy vs. therapy by experts for
suicidal behaviors and borderline personality disorder.
Arch Gen Psychiatry
2006; 63: 757–66.
15
Giesen-Bloo, J, van Dyck, R, Spinhoven, P, van Tilburg, W, Dirksen, C, van Asselt, T, et al. Outpatient psychotherapy for borderline
personality disorder: randomized trial of schema-focused therapy vs
transference-focused psychotherapy. Arch Gen
Psychiatry
2006; 63: 649–58.
16
Leichsenring, F, Rabung, S. The effectiveness of long-term psychodynamic
psychotherapy: a meta-analysis. JAMA
2008; 300: 1551–64.
17
Kriston, L, Hölzel, L, Härter, M. Analyzing effectiveness of long-term psychodynamic
psychotherapy [letter]. JAMA
2009; 301: 930–1.
18
Leichsenring, F, Rabung, S. Analyzing effectiveness of long-term psychodynamic
psychotherapy [reply]. JAMA
2009; 301: 932–3.
19
Gotzsche, PC. Why we need a broad perspective on
meta-analysis. BMJ
2000; 21: 585–6.
20
Moher, D, Liberati, A, Tetzlaff, J, Altman, D. Preferred reporting items for systematic reviews and
meta-analyses: the PRISMA statement. BMJ
2009; 339:
b2535.
21
Gunderson, JG, Gabbard, GO. Making the case for psychoanalytic therapies in the
current psychiatric environment. J Am Psychoanal
Assoc
1999; 47:
679–704.
22
Luborsky, L. Principles of Psychoanalytic Psychotherapy. Manual for
Supportive–Expressive Treatment. Basic
Books, 1984.
23
Wallerstein, RS. Psychoanalytic treatments within psychiatry: an
expanded view. Arch Gen Psychiatry
2002; 59:
499–500.
24
Cutler, JL, Goldyne, A, Markowitz, JC, Devlin, MJ, Glick, RA. Comparing cognitive behavior therapy, interpersonal
psychotherapy, and psychodynamic psychotherapy.
Am J Psychiatry
2004; 161: 1567–73.
25
Lamb, WK. A meta-analysis of outcome studies in long-term
psychodynamic psychotherapy and psychoanalysis.
.
ProQuest,
2004.
26
Crits-Christoph, P, Barber, JP. Long-term psychotherapy. In
Handbook of Psychological Change: Psychotherapy Processes and
Practices for the 21st Century (eds Ingram, RE, Snyder, CR): 455–73. Wiley,
2000.
27
Leichsenring, F, Rabung, S, Leibing, E. The efficacy of short-term psychodynamic
psychotherapy in specific psychiatric disorders: a
meta-analysis. Arch Gen Psychiatry
2004; 61: 1208–16.
28
Berlin, JA. Does blinding of readers affect the results of
meta-analyses?
Lancet
1997; 350: 185–6.
29
Battle, CC, Imber, SD, Hoehn-Saric, R, Nash, ER, Frank, JD. Target complaints as criteria of
improvement. Am J Psychother
1966; 20: 184–92.
30
Derogatis, L. The SCL–90 Manual I: Scoring, Administration and Procedures
for the SCL–90–R. Clinical Psychometric
Research, 1977.
31
Millon, T. Millon Clinical Multiaxial Inventory (3rd
edn). National Computer
Services, 1984.
32
Weissman, MM, Bothwell, S. Assessment of social adjustment by patient
self-report. Arch Gen Psychiatry
1976; 33: 1111–5.
33
Hedges, LV, Olkin, I. Statistical Methods for Meta-analysis.
Academic Press,
1985.
34
Hedges, LV, Vevea, JL. Fixed- and random-effects models in
meta-analysis. Psychol Methods
1998; 3:
486–504.
35
Rosenberg, MS, Adams, DC, Gurevitch, J. MetaWin: Statistical Software for Meta-analysis,
. Sinauer,
1999.
36
Huedo-Medina, TB, Sanchez-Meca, J, Botella, J, Marin-Martinez, F. Assessing hetereogeneity in meta-analysis. Q
statistic or I2 index. Psychol
Methods
2006; 11:
193–206.
37
Quintana, SM, Minami, T. Guidelines for meta-analyses of counseling
psychology research. Couns Psychol
2006; 34: 839–77.
38
Begg, CB, Mazumdar, M. Operating characteristics of a rank correlation test
for publication bias. Biometrics
1994; 50: 1088–101.
39
Rosenthal, R. The file drawer problem and tolerance for null
results. Psychol Bull
1979; 86: 638–41.
40
SPSS. SPSS 15.0 Command Syntax Reference.
SPSS,
2006.
41
Cohen, J. Statistical Power Analysis for the Behavioral
Sciences. Erlbaum,
1988.
42
Hedges, LV. Distribution theory for Glass's estimator for effect
size and related estimators. J Educ Stat
1981; 6: 107–28.
43
Jadad, AR, Moore, RA, Carroll, D, Jenkinson, C, Reynolds, DJ, Gavaghan, DJ, et al. Assessing the quality of reports of
randomized clinical trials: is blinding necessary?
Control Clin Trials
1996; 17:
1–12.
44
Bachar, E, Latzer, Y, Kreitler, S, Berry, EM. Empirical comparison of two psychological therapies.
Self psychology and cognitive orientation in the treatment of anorexia
and bulimia. J Psychother Pract Res
1999; 8: 115–28.
45
Bateman, A, Fonagy, P. Randomized controlled trial of outpatient
mentalization-based treatment versus structured clinical management for
borderline personality disorder. Am J
Psychiatry
2009; 166: 1355–64.
46
Dare, C, Eisler, I, Russell, G, Treasure, J, Dodge, L. Psychological therapies for adults with anorexia
nervosa. Randomised controlled trial of out-patient
treatments. Br J Psychiatry
2001; 178: 216–21.
47
Gregory, RJ, Chlebowski, S, Kang, D, Remen, AL, Soderberg, MG, Stepkovitch, J, et al. A controlled trial of psychodynamic
psychotherapy for co-occurring borderline personality disorder and
alcohol use disorder. Psychotherapy
2008; 45:
28–41.
48
Huber, D, Klug, G. Munich Psychotherapy Study (MPS): the effectiveness
of psychoanalytic long-term psychotherapy for depression.
In Book of Abstracts. From Research to Practice (ed
Society for Psychotherapy Research): 154.
Ulmer Textbank,
2006.
49
Knekt, P, Lindfors, O, Harkanen, T, Valikoski, M, Virtala, E, Laaksonen, MA, et al. Randomized trial on the effectiveness of
long-and short-term psychodynamic psychotherapy and solution-focused
therapy on psychiatric symptoms during a 3-year
follow-up. Psychol Med
2008; 38:
689–703.
50
Korner, A, Gerull, F, Meares, R, Stevenson, J. Borderline personality disorder treated with the
conversational model: a replication study. Compr
Psychiatry
2006; 47: 406–11.
51
Svartberg, M, Stiles, T, Seltzer, MH. Randomized, controlled trial of the effectiveness of
short-term dynamic psychotherapy and cognitive therapy for Cluster C
personality disorders. Am J Psychiatry
2004; 161: 810–7.
52
Levy, KN, Meehan, KB, Kelly, KM, Reynoso, JS, Weber, M, Clarkin, JF, et al. Change in attachment patterns and reflective
function in a randomized control trial of transference-focused
psychotherapy for borderline personality disorder.
J Consult Clin Psychol
2006; 74: 1027–40.
53
Lipsey, MW, Wilson, DB. The efficacy of psychological, educational, and
behavioral treatment. Confirmation from meta-analysis.
Am Psychol
1993; 48: 1181–209.
54
Knekt, P, Lindfors, O, Laaksonen, MA, Raitasalo, R, Haaramo, P, Järvikoski, A, et al. Effectiveness of short-term and long-term
psychotherapy on work ability and functional capacity – a randomized
clinical trial on depressive and anxiety disorders.
J Affect Disord
2008; 107:
95–106.
55
Begg, CB. Publication bias. In The
Handbook of Research Synthesis (eds Cooper, H, Hedges, LV): 399–409. Russell
Sage Foundation, 1995.
56
Rosenthal, R. Meta-analytic Procedures for Social Research: Applied
Social Research Methods. Sage,
1991.
57
Bateman, A, Fonagy, P. 8-year follow-up of patients treated for borderline
personality disorder: mentalization-based treatment versus treatment as
usual. Am J Psychiatry
2008; 165: 631–8.
58
Beck, AT, Bhar, SS. Analyzing effectiveness of long-term psychodynamic
psychotherapy [letter]. JAMA
2009; 301:
931.
59
Leichsenring, F, Rabung, S. Double standards in psychotherapy
research. Psychother Psychosom
2011; 80:
48–57.
60
Brockmann, J, Schlüter, T, Eckert, J. Langzeitwirkungen psychoanalytischer und
verhaltenstherapeutischer Langzeittherapien [Long-term outcome of
long-term psychoanalytic and behavioral long-term
therapy]. Psychotherapeut
2006; 51:
15–25.
61
Puschner, B, Kraft, S, Kächele, H, Kordy, H. Course of improvement over 2 years in psychoanalytic
and psychodynamic outpatient psychotherapy.
Psychol Psychother
2007; 80:
51–68.
62
Doering, S, Hörz, S, Rentrop, M, Fischer-Kern, M, Schuster, P, Benecke, C, et al. Transference-focused psychotherapy v.
treatment by community psychotherapists for borderline personality
disorder: randomised controlled trial. Br J
Psychiatry
2010; 196: 389–95.
63
Chambles, DL, Hollon, SD. Defining empirically supported
therapies. J Consult Clin Psychol
1998; 66:
7–18.
64
Gabbard, GO, Gunderson, JG, Fonagy, P. The place of psychoanalytic treatments within
psychiatry. Arch Gen Psychiatry
2002; 59: 505–10.
65
Zaider, T, Heimberg, RG. Non-pharmacologic treatments for social anxiety
disorder. Acta Psychiatr Scand Suppl
2003; 417:
72–84.
Falk Leichsenring, Professor
15 August 2012
In a further comment to our meta-analysis [1] Kliem and colleagues reported "still some methodological discrepancies in the update of a meta-analysis" [2]. In research, however, the methods to be applied always depend on the question that is addressed. This question may be more or less narrow or wide. In psychotherapy research, especially in research on CBT, often narrow questions are addressed, e.g. "is treatment X effective in disorder Y"? However, under certain conditions, broad questions of research are more appropriate [3]. In our meta-analysis on LTPP, we examined such a broad question. We examined whether different forms of LTPP are superior to various other forms of psychotherapy in (different) complex mental disorders (personality disorders, chronic disorders, multiple disorders). This question serves as a good example for what is called "clinical diversity" or "clinical heterogeneity" [4, p. 276]. Thus,some heterogeneity between studies is to be expected. Furthermore, the aimof our meta-analysis was to make inferences beyond the observed sample of studies. For these reasons a random-effects model is more appropriate thena fixed-effects model [5]. Whereas the fixed effects model assumes that there is a true effect that is the same in every study, the random effectsmodel assumes that the effects assessed in the different studies are not identical, but follow some distribution [4, p. 280]. Thus, different questions of research are assessed: Whereas the fixed model addresses the question "what is the best estimate of the intervention effect?", the random effects model addresses the question "what is the average intervention effect?" [4, p. 281]. Applying a random effects model by the use of MetaWin 2.0 [6] we found a mean between-group effect size of d=0.54for overall outcome in favor of LTPP. For all random effects models, MetaWin yielded insignificant values for Q (p<0.09). For this reason, there was no need to exclude a study or to perform a sensitivity analysis.Kliem et al., however, question that the test for heterogeneity provided by MetaWin is appropriate [2]. As the statistical power for tests of heterogeneity is often low, especially if the number of studies is small, Takkouche et al. propose to use random effects models routinely and to quantify heterogeneity by means of Ri, i.e. the proportion of the total variance that is due to between-study variance [6]. Ri is assessed as Ri =tau-square/(tau-square + (S x var (beta))), with tau = between-study variance, S = number of studies and var(beta) = total variance. Small values of Ri (<0.40) indicate lack of heterogeneity [6,7]. To address the question of heterogeneity in our meta-analysis this way, we assessed Ri. According to the results, Ri was 0.09 for overall outcome, that is only 9% of the total variance was due to variance between studies. For target problems, symptoms, and personality functioning, Ri was low as wellwith values of 0.04, 0.08, and 0.08, respectively. Only for social functioning, the proportion of variance was somewhat higher but still in the range of low heterogeneity (Ri=0.24). According to these data, there is no indication of significant heterogeneity in effect sizes between the studies included in our random-effects meta-analysis. As a consequence, there is no need to exclude any study or to perform additional sensitivityanalysis. Furthermore, as noted above, some heterogeneity (maybe even including outliers) is in the nature of things when addressing a broad question of clinical diversity. The results of our meta-analysis stand as they were reported: LTPP is significantly superior to shorter forms of interventions in complex mental disorders [1].
1. Leichsenring, F Rabung, S. Long-term psychodynamic psychotherapy in complex mental disorders: update of meta-analysis. Brit J Psychiatry 2011; 199: 15-22.2. Kliem, S, Beller, J, Kroeger, C. Still some methodological discrepancies in the update of meta-analysis. Letter, Brit J Psychiatry, 2012. 3. Gotzsche PC. Why we need a broad perspective on meta-analysis. Brit MedJ 2000; 21: 585-6.4. Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, available from www.cochrane-handbook.org.4. Hedges LV, Vevea JL. Fixed- and random-effects models in meta-analysis.Psychol Meth 1998; 3: 486-504.5. Rosenberg MS, Adams DC, Gurevitch J. MetaWin. Statistical software for meta-analysis. Version 2.0. Sinauer Associates, 1999.6. Takkouche, B, Cadarso-Suarez, C, Spiegelmann, D. Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis. Am J Epidemiol 1999, 150, 206-215.7. Etminan M, Takkouche B, Isorna FC, Samii A. Risk of ischaemic stroke inpeople with migraine: systematic review and meta-analysis of observationalstudies. BMJ 2005, 330(7482):63.
... More
Conflict of interest: None declared
Write a replyBack to top
Soeren Kliem, Ph.D. Student
07 June 2012
In the latest issue of the British Journal of Psychiatry we pointed out some methodological discrepancies [1] regarding the meta-analysis "Long-term psychodynamic psychotherapy in complex mental disorders: updateof a meta-analysis" of Drs. Leichsenring and Rabung [2]. We want to thankDr. Leichsenring for replying to our objections [3]. Whereas some of our suggestions have been incorporated (see the correction), others have been refuted. First Leichsenring [3], for example, claimed that our re-analysis involvedthe calculation of a fixed effects model and that the discrepancies between their and our results were based on this modeling choice. We, however, did not calculate a fixed effects meta-analysis, as stated in ourletter, but rather used a random effects meta-analysis, as did Drs. Leichsenring and Rabung [2]. How then might the discrepancies be explained? One possible cause is that our re-analysis was conducted with the R package "metafor", but Drs. Leichsenring and Rabung instead utilized the MetaWin software. Thus we re-analyzed the meta-analysis this time using MetaWin and found that the "Qt-value" of MetaWin now approximately equals the "Qt-value" reported by Drs. Leichsenring and Rabung (pp. 19). The "Qt-value" reported by Drs. Leichsenring and Rabung as a test for heterogeneity, however, is not the standard test for heterogeneity, but adds the variance of the true effects (Tau^2) to the sample variances. This might correspond to a "test for heterogeneity in a random effects setting" but is essentially meaningless because it will not be significantin almost all practical situations. That is, the random effects model's raison detre is to explain all of the variance between effect sizes in therandom effects distribution (We thank Dr. Viechtbauer, the author of the Rpackage metafor, and Dr. Rosenberg, one of the authors of the MetaWin software for pointing this out to us; Personal Communications). Furthermore, it should always be examined whether the variance between studies might be explained by a mixed-effects analysis or by an outlier analysis. This is especially important if the usual test for heterogeneity("is the variance of the random effects distribution larger than zero?") is significant, as in our re-analysis [1]. Just because one uses a random effects model and therefor implicitly states that the variation is just random error doesn't make it so; the variation could also be due to moderator variables or outlying studies. We examined just that and found that one study was an outlier. In order to make our results reproducible we uploaded the dataset and our commented R script to the website "https://www.tu-braunschweig.de/Medien-DB/psychologie/e-letter/letter.pdf". In this script we further show that we could reproduce Drs. Leichsenring's and Rabung's [2] results if we added the variance of the true effects (Tau^2) to the variance usually analyzed by the test for heterogeneity (note that some results may differ slightly due to rounding errors). The output of our analysis with the MetaWin program is also included.
To substantiate our claim that one study is indeed an outlier we additionally used the influence function in the metafor package to calculate numerous case diagnostics indicating the influence of one study at a time on the model fit. The results indicated the respective study [4]to be clearly an outlier. The externally studentized residual of this study, for example, was 3.33 suggesting this study within a sample size of10 studies to be an outlier. The Funnel-Plot caclulated with metafor strongly seconded this result, for both see the attached R-code.If Drs. Leichsenring and Rabung [2] used the "random effects test for heterogeneity" for the other models as well and did not examine whether a mixed-effects model or study outliers might account for the variance, it must be assumed that the other results are also potentially faulty (pp.19). Therefore, all analyses should be re-calculated, and if necessary, corrected. The corrections of Dr. Leichsenring should, preferably, also be published with reproducible code.
Second, we would like to clarify our Bayesian analysis. Dr. Leichsenring [3] correctly writes: "Results of Bayesian meta-analyses depend largely on the specification of prior assumptions on the treatment effect and between-trial variance. Since Kliem et al did not provide any information about the assumptions of their analyses, it is impossible to interpret the presented result reasonably" (pp. 430). We used vague priorswhich minimize the impact of the prior information on the results, as is the standard convention in Bayesian analysis. Concretely we employed a uniform prior distribution for Tau(>0) and N(0,1000) prior distributionfor My. The main usefulness of choosing these priors is that the results of the Bayesian analysis become comparable with classical analyses. Consequently the Bayesian results replicated our other results obtained with more classical meta-analytic techniques. The usefulness of the Bayesian approach lays in the fact that direct probability statements can be made about the possible magnitude of the effect size.
Lastly, we nonetheless would like to thank Dr. Leichsenring for his effort in discussing the meta-analysis. In our view, the scientific foundation of long-term psychodynamic psychotherapy is an important research area. With their meta-analysis Drs. Leichsenring and Rabung [2] enabled important scientific discourse as we with our letters currently conduct.
Literature:
1. Kliem S, Beller J, Kroeger C. Methodological discrepancies in the update of a meta-analysis. Br J Psychiatry 2012; 200: 429.2. Leichsenring F, Rabung S. Long-term psychodynamic psychotherapy in complex mental disorders: update of a meta-analysis. Br J Psychiatry 2011;199: 15-22.3. Leichsenring F. Methodological discrepancies in the update of a meta-analysis. Author?s reply. Br J Psychiatry 2012; 200: 429-430.4. Bateman A, Fonagy P. The effectiveness of partial hospitalization in the treatment of borderline personality disorder, a randomized controlled trial. Am J Psychiatry 1999; 156: 1563-9.
Attachments: https://www.tu-braunschweig.de/Medien-DB/psychologie/e-letter/letter.pdf
... More
Conflict of interest: None declared
Write a replyBack to top
Soeren Kliem, Ph.D. Student
07 March 2012
Drs Leichsenring and Rabung1 reported that long-term psychodynamic psychotherapy (LTPP) is superior to less intensive forms of psychotherapy in complex mental disorders. Based on 10 trials, they found an overall effectiveness of ES = 0.55. In the aforementioned study, we found several methodological discrepancies:
First, it seems surprising that the Q-test indicated no significant unexplained variance, as the between group effect size of one of the primary studies2 (ES = 1.76) is quite outstanding in figure 2. To shed light on this issue, we recalculated the overall effect size using a random effects meta-analysis based on the values from figure 2. Our meta-analysis replicated Leichsenring and Rabung1 in the main parts. In contrast to Leichsenring and Rabung, however, we found significant unexplained variance (Q = 25.33, df = 9, p = 0.003) and a larger overall confidence interval of 0.29-0.82 (in contrast to 0.41-0.67 as reported by Leichsenring and Rabung). Additionally, computing an outlier analysis a significantly outlying study effect2 size was found (p < .001). Including the moderator considering the impact of this study yields an effect size of ES = 0.44 (95% CI 0.27-0.61, p < .001). The moderator effect, interpreted as the difference between the effect of the outlying study and the grand mean, was 1.32 (95% CI 0.57 to 2.07, p < .001). After removing the outlying study there was no significant unexplained variance (Q = 11.56, df = 8, p = .172).
Second, we calculated the fail safe-N according to Rosenthal3; 16 non-published studies with ES = 0 had to be included in the analysis to change the results of the meta-analysis (ES = 0.44) from significant to non-significant (ES < .16). As 16 is below 55 (5K + 10), the effect cannot be regarded as robust.
Lastly, to gain better insight into the interpretation of the overalleffect size as small, medium or large, we calculated a bayesian meta-analysis following Higgins, Thompson and Spiegelhalter4. The bayesian analysis essentially replicated the findings of our random effects meta-analysis. Additionally we found the probability, of the overall effect size to be small (ES < .5), at 72.5%. Thus, in contrast to Leichsenringand Rabung1, we found that the overall effect size may only be regarded as small in contrast to medium or large.
Therefore, we would greatly appreciate caution against a conclusion that the overall effectiveness of LTPP for treating complex mental disorders should now be considered as definitely proven.
1. Leichsenring F, Rabung S. Long-term psychodynamic psychotherapy incomplex mental disorders: update of a meta-analysis. Br J Psychiatry 2011;199: 15-222. Bateman A, Fonagy P. The effectiveness of partial hospitalization in the treatment of borderline personality disorder, a randomized controlled trial. Am J Psychiatry 1999; 156: 1563-9. 3. Rosenthal R. The file drawer problem and tolerance for null results. Psychol Bull 1979; 86: 638-41.
4. Higgins JPT, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. J R Statist Soc A 2009; 172:137-59.
... More
Conflict of interest: None declared
Write a replyBack to top
Falk Leichsenring, Professor of Psychotherapy Research
09 February 2012
Coyne [1] criticizes our recent meta-analysis of long-term psychodynamic psychotherapy [2]. However, Coyne just reiterates the arguments he or other critics already put forward against our 2008 meta-analysis [3] two years ago [4, 5]. We repeatedly responded to this criticism in detail [2, 6, 7]. Coyne is fully aware of this, but neither acknowledges nor even refers to our prior response to criticism. We showedin detail, for example, how we calculated effect sizes and that statistical power was not lower than in many studies of CBT [2, 6, 7].
The purpose of our update [2] was to take several criticismsput forward against our 2008 meta-analysis into account. In distinction tothe 2008 meta-analysis, we (1) only included controlled trials, (2) exclusively calculated between-group effect sizes and (3) included only active comparators as comparison conditions. Coyne fails to mention these essential differences compared to the 2008 meta-analysis. Instead of this he incorrectly claims that we updated our meta-analysis by only adding "one study" [1].
It is a pity that Coyne did not report our prior response tothese same criticisms that appeared 2 years ago. Thus, readers again are left to decide from Coyne's side of the argument without other available information. Coyne's exaggerated claims against the efficacy of LTPP are repeated in two essentially redundant criticisms in two journals two yearsapart [1, 4].
An earlier unedited version of his letter was unfortunately published on 12 January and subsequently retracted by the publishers [8]. In this earlier version, Coyne spread false information about the activities of the senior author, Dr Leichsenring. No public-domain evidence for these assertions was supplied, but as Coyne spread this falseinformation for several weeks, his assertions require a comment. Coyne stated:
"Leichsenring serves as representative for the interests of long-term psychodynamic therapy on the Wissenschaftlicher Beirat Psychotherapie (WBP), a body whose judgments about the scientific status of psychotherapies are accepted by German insurance companies as the basisfor reimbursement. Currently, LTPP does not receive reimbursement, based on WBP's finding of a lack of evidence for the added expense of longer-term treatment.... It is a pity that Leichsenring and Rabung did not report Leichsenring's activities so that readers could decide for themselves whether this agenda might have influenced Leichsenring and Rabung's exaggerated claims for the efficacy of LTPP that are repeated in two essentially redundant reviews of poor quality studies."
Dr Leichsenring is indeed a member of the Wissenschaftliche Beirat Psychotherapie (WBP). The members of the WBP are independent experts in psychotherapy research. They are not paid for working with the WBP. The WBP is the official organization of Germany that evaluates the scientific status of psychotherapeutic methods by the use of detailed methodological criteria (www.wbp.de). Based on this evaluation, the WBP gives a recommendation whether or not a method of psychotherapy can be recommended for training in psychotherapy. The WBP, however, gives no statements referring to reimbursement.
For this reason, the following statements by Coyne are simply and categorically false.
a)It is not true that Dr Leichsenring is "representative of the interests of long-term psychodynamic psychotherapy on the WBP". Like all members of the WBP, Dr Leichsenring is an independent expert in psychotherapy research.
b) It is false that the WBP's judgments "are accepted by German insurance companies as the basis for reimbursement." Whether or nota treatment is reimbursed by insurance companies is based on decisions of another autonomous organization, the "Gemeinsame Bundesausschuss" (GBA; www.g-ba.de).
c)And last, but not least, it is false that "Currently, LTPP does not receive reimbursement, based on the WBP's finding of a lack of evidence for the added expense of longer-term treatment." In fact, LTPPas well as long-term CBT (!) do receive reimbursement by German insurance companies and the WBP has acknowledged (both short-term and long-term) psychodynamic psychotherapy as scientific and efficacious and recommended it for training (www.wbp.de).
1.Coyne, J., Flawed meta-analysis of long-term psychodynamic therapy in jama reappers in bjp with one study added. British Journal of Psychiatry 2012, eLetter.
2.Leichsenring, F., Rabung, S., Long-term psychodynamic psychotherapy in complex mental disorders: update of meta-analysis. British Journal of Psychiatry 2011. 199 p. 15-22.
3.Leichsenring, F., Rabung, S, The effectiveness of long-term psychodynamic psychotherapy: a meta-analysis Journal of the AmericanMedical Association (JAMA) 2008. 300 p. 1551-1564.
4.Bhar, S.S., et al., Is longer-term psychodynamic psychotherapy more effective than shorter-term therapies? Review and critique of the evidence. Psychotherapy and Psychosomatics, 2010. 79: p. 208-216.5.Thombs, B.D., M. Bassel, and L.R. Jewett, Analyzing effectiveness of long-term psychodynamic psychotherapy. Letter to the Editor. JAMA, 2009 301: p. 930.
6.Leichsenring, F. and S. Rabung, The effectiveness of long-term psychodynamic psychotherapy - reply. Journal of the American Medical Association, 2009. 301: p. 932-933.
7.Leichsenring, F. and S. Rabung, Double standards in psychotherapy research. Psychotherapy and Psychosomatics, 2011. 80: p. 48-51.8. British Journal of Psychiatry. Re: Coyne, J., Flawed meta-analysis of long-term psychodynamic therapy in jama reappers in bjp with one study added. British Journal of Psychiatry 2012. eLetter.
... More
Conflict of interest: None declared
Write a replyBack to top
British Journal of Psychiatry British Journal of Psychiatry
09 February 2012
A longer version of this letter (Coyne, 'Flawed meta-anaysis...') was erroneously published online on 12 January 2012 and was withdrawn by the publishers on 6 February 2012.
Conflict of interest: None declared
Write a replyBack to top