I thank Ian Anderson (Reference Anderson2021, this issue) for critiquing our 40-page review (Read Reference Read, Kirsch and McGrath2019) of placebo-controlled ECT trials for depression and the meta-analyses based on those trials. He makes some valuable points. The 24-point quality scale we developed to evaluate the trials probably should have been analysed in relation to different aspects of quality rather than just reported as a total score. Our summary of the research demonstrating memory loss and brain damage (Sackeim Reference Sackeim, Prudic and Fuller2007; Fosse Reference Fosse and Read2013; Read Reference Read, Kirsch and McGrath2019, Reference Read, Hancock and Cunliffe2021a) was, indeed, brief.
Criticism of the review's methods
Placebo-controlled studies
Dr Anderson claims that we positioned placebo-controlled studies as the ‘only’ method to evaluate efficacy. We actually wrote: ‘ECT must be assessed using the same standards applied to psychiatric medications and other medical interventions, with placebo-controlled studies as the primary method for assessment’.
Given the disturbingly poor quality of the placebo studies (all 11 were pre-1986), ECT advocates turn to non-placebo studies for support. Our review acknowledged: ‘The many recent studies that either compare ECT to other treatments, or compare different types of ECT with each other, typically open with an unqualified statement that ECT is a very effective treatment for depression’. However, an earlier review, which found more than 2500 non-placebo ECT studies, concluded that even the best 91 studies failed to produce any ‘robust evidence that ECT is effective for depression, primarily because at least 60% maintained ECT participants on medication, 89% produced no meaningful follow-up data beyond the end of treatment, and none investigated whether ECT prevents suicide’ (Read Reference Read and Arnold2017).
Quality criteria
Dr Anderson describes some of our quality criteria as ‘idiosyncratic’. If criteria such as suicide, quality of life measure and patients’ ratings are considered peculiar, that speaks volumes about what he and his colleagues think is acceptable to exclude. Other criteria are ‘not explained’. Explaining why ‘sample sizes of ten or more’ and ‘follow-up data’ are desirable might have seemed condescending.
All 24 quality criteria were operationalised with explicit definitions, tested by the interrater reliability process.
Dr Anderson writes ‘There is no description of the criteria by which the robustness of the meta-analyses was assessed’. These are clearly stated: ‘The meta-analyses were evaluated primarily in terms of whether they considered the quality of the studies they included, but also in terms of whether they addressed efficacy beyond end of treatment’.
The evidence
Dr Anderson acknowledges that there is ‘next to no evidence’ on long-term benefits. Our review demonstrated that there has never been any evidence that ECT outperforms placebo beyond the end of treatment.
Nor is there any evidence that ECT prevents suicide, as is so often claimed. In a study published since our review, 14 810 patients receiving ECT were 1.3 times more likely to die by suicide than 58 369 non-ECT controls (Peltzman Reference Peltzman, Shiner and Watts2020).
Dr Anderson cites the latest meta-analysis (Mutz Reference Mutz, Vipulananthan and Carter2019), ignoring its being based on only one ECT study, which the authors themselves deemed at ‘high risk’ for bias.
How can ECT advocates deny that ECT causes brain damage when an ECT machine manufacturer lists ‘permanent brain damage and permanent memory loss’ as risks? (Somatics 2018).
Campaigning for better research and regulation
Dr Anderson bemoans the fact that the review ‘has been used to support a campaign headed by the lead author for the suspension of ECT’ (Read Reference Read, Kirsch and Cunliffe2020a), without mentioning that the stated purpose is to allow time for ‘a series of well designed, randomized, placebo-controlled studies’ (Read Reference Read, Kirsch and McGrath2019).
Following confirmation that ECT remains inadequately monitored and regulated in England (Read Reference Read and Arnold2018, Reference Read, Harrop and Geekie2021b; Harrop Reference Harrop, Read and Geekie2021) the campaign is calling for an independent enquiry by the government (Johnstone Reference Johnstone and Cunliffe2020). This has widespread support, including from the UK's largest mental health charity, Mind (Buckley Reference Buckley2020), the Royal College of Nursing, the Association of Clinical Psychologists, Headway (the brain injury association) and the Shadow Minister for Mental Health (Allin-Khan Reference Allin-Khan2020, Reference Allin-Khan2021).
Tone and Approach
Dr Anderson includes a section entitled ‘Tone and approach’. We are accused of being ‘adversarial’. Examples include our suggesting that the meta-analyses involved ‘carelessness, bias or both’, the exact same words used by Anderson to characterise our own work. The words ‘being forced to undergo ECT after stating that you do not want it’, to describe the experience of one in three ECT recipients in England (Read Reference Read, Harrop and Geekie2018, Reference Read, Harrop and Geekie2021b), are portrayed as ‘misleading’. The term ‘Brain damaging therapeutics’ is presented as an example of our being ‘emotive’, without disclosing that these were not our words at all but the title of an early paper arguing that ECT works because it reduces brain functioning (Freeman Reference Freeman1941). I am not sure where Dr Anderson's depicting our work as a ‘polemic dressed in the clothes of a scientific review’ falls on his ‘tone and approach’ spectrum. But I enjoyed his hutzpah, given that the review's second author is Irving Kirsch, Associate Director of Placebo Studies at Harvard Medical School.
Professor Kirsch has commented:
‘I don't think many ECT advocates understand just how strong placebo effects are for a major procedure like ECT. The failure to find any meaningful long-term benefits compared to placebo groups is particularly distressing. On the basis of the clinical trial data, ECT should not be used for depressed individuals’ (cited in Read Reference Read2020b).
Conclusions
Dr Anderson was actually relatively constructive and restrained. His one or two mischievous, but eloquent, taunts stand in stark contrast to the plethora of malicious attacks, on social media and elsewhere, from pro-ECT psychiatrists, targeting the authors, their professions, the journal and even the platforms, such as Psychology Today (Read Reference Read2020b), Aeon (Read Reference Read2021c) and Medscape (Vlessides Reference Vlessides2020), that had the audacity to publish summaries of the review. It was amid the most virulent torrent of such fear and loathing, on Medscape, that one woman was brave enough to write:
‘My long-term memory was destroyed. Memories of childhood friends, memories of major events I attended, memories of my training as a psychiatric registrar. I started struggling with simple spelling and calculations. […] I never told colleagues about this, as I felt ashamed. But I started talking to other people who had ECT and realized I am not alone. I can understand some of the negative responses by colleagues to this article, but I have to admit that I welcome the argument’ (cited in Vlessides Reference Vlessides2020).
Data availability
Data availability is not applicable as no new data were created or analysed.
Author contribution
J.R. was the sole contributor to this article.
Funding
This article involved no grant from any funding agency, commercial or not-for-profit.
Declaration of interest
None.
eLetters
No eLetters have been published for this article.