Suicide is a major public health issue. During 2002–2004 (latest available data) there were 8.6 suicide deaths per 100 000 population in England, with the majority occurring in young adult males. 1 The global mortality rate is estimated at 16 per 100 000 – one death every 40 seconds. 2 For every suicide it has been estimated that six people will experience intense grief, Reference Clark, Goldney, Hawton and van Heeringen3 which extrapolates to around 35 000 persons in the UK annually. Promoting the mental health of people bereaved through suicide is a key aim of the National Suicide Prevention Strategy. 4 Although the effects of such a bereavement are not necessarily more severe than bereavement following other causes of death, there are certain aspects such as stigmatisation and a sense of rejection that may make coping particularly difficult. Reference Hawton and Simkin5 A distinction has been drawn between normal grief and complicated grief where there is persistent yearning for the deceased that is severe and disruptive to normal life. Reference Hawton6 Such a response may be more common after deaths such as suicide. Diagnostic criteria have been proposed for inclusion in the American Psychiatric Association's Diagnostic and Statistical Manual of Mental Disorders: at least four of eight specific symptoms must be experienced frequently and/or be severely distressing for at least 6 months. Reference Zhang, El-Jawahri and Prigerson7
Sources of support for those bereaved through suicide include general practitioners, specialised therapists, self-help groups, specialised reading material and internet sites. Reference Hawton and Simkin5 However, little is known about the effects of providing support. We conducted a systematic review with the purpose of evaluating the effects of interventions to assist people bereaved by suicide in dealing with the impact of the death and the consequences for their well-being.
Method
Literature search
Over 30 databases and other sources were searched up to 1 October 2007, including Medline, EMBASE, PsycINFO and the Science Citation Index, as well as sources of grey literature and ongoing studies. No language restriction was applied. Details of the search strategy and the databases searched are available from the authors. We checked reference lists of all the potentially relevant papers and contacted organisations and experts in the field. Two reviewers independently screened the search results for eligible studies. Disagreements were resolved by consensus or through consultation with a third reviewer.
Inclusion criteria
Any type of intervention targeted at adults or children bereaved through suicide was eligible for inclusion, for example support groups, self-help and volunteer-led groups, as well as therapeutic interventions delivered by health professionals. There was no restriction on the relationship to the person who had died: studies of people bereaved through a personal or professional relationship were also eligible. All outcomes (qualitative and quantitative) were considered relevant. The key restriction was that only randomised controlled trials (RCTs) and studies with a control or comparison group (including cohort studies) were eligible. This was viewed as particularly important owing to the changing nature of grief over time. Reference Clark, Goldney, Hawton and van Heeringen3
Data extraction and quality assessment
Key study characteristics and outcomes were extracted and studies were quality-assessed by one reviewer and checked for accuracy by a second. Disagreements were resolved through consensus, and if necessary a third reviewer was consulted. One French-language paper required translation. The quality criteria (see Appendix) were based on the Centre for Reviews and Dissemination's guidance for undertaking systematic reviews, 8 and a report on evaluating non-randomised studies. Reference Deeks, Dinnes, D'Amico, Sowden, Sakarovitch, Song, Petticrew and Altman9 In order to assess the integrity of the intervention we drew on the Quality Assessment Tool for Quantitative Studies. 10
Data synthesis
Given the diversity of the studies in terms of settings, interventions, outcomes and outcome measures used, we undertook a narrative synthesis based on recent guidance. Reference Arai, Britten, Popay, Roberts, Petticrew, Rodgers and Sowden11,Reference Popay, Roberts, Sowden, Petticrew, Britten, Arai, Roen and Rodgers12 The primary study findings were interpreted, and similarities and differences between the studies investigated. This included consideration of study design, methodological quality, whether the study was appropriately powered, intervention characteristics and delivery, participants and outcome measures. Studies were grouped according to whether they had an active comparison group.
Results
Study characteristics
Eight studies met the inclusion criteria (Fig. 1). Reference Poijula, Dyregrov, Wahlberg and Jokelainen13–Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 There were four RCTs, Reference Constantino, Sekula and Rubinstein15–Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17,Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 one controlled study Reference Farberow18 and three observational studies with a control group, Reference Poijula, Dyregrov, Wahlberg and Jokelainen13,Reference Campbell14,Reference Seguin, Vinet-Bonin and Senecal19 one of which was retrospective Reference Campbell14 (online Table DS1). No UK-based study was identified. In the majority of studies the participants were members of the dead person's family, although two studies focused on school or university students. There were four studies of adults only, Reference Constantino, Sekula and Rubinstein15,Reference Kovac and Range16,Reference Seguin, Vinet-Bonin and Senecal19,Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 and one of children only. Reference Poijula, Dyregrov, Wahlberg and Jokelainen13 Two included a small number of children in their comparison group, Reference Campbell14,Reference Farberow18 and in one, outcome was reported separately for adults and children. Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 In most studies the majority of participants were women. Where ethnic data were reported, participants were predominantly White. Reference Campbell14–Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 Data on other participant-related potential prognostic factors were not reported consistently across the studies. Baseline scores on some key scales (where available) are reported in online Table DS1 and data from other measures used are available from the authors. Participants were recruited by researchers, Reference Kovac and Range16,Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17,Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 professional referral, Reference Poijula, Dyregrov, Wahlberg and Jokelainen13,Reference Campbell14 and multiple sources such as self-referral and professional referral. Reference Constantino, Sekula and Rubinstein15,Reference Farberow18,Reference Seguin, Vinet-Bonin and Senecal19
The studies had few inclusion or exclusion criteria (online Table DS1) and none of the studies selected participants on the basis of vulnerability to mental health problems such as depression or complicated grief. None of the included studies investigated interventions targeted at professionals such as emergency services personnel or health professionals. Although most studies used standardised outcome measures, there was little consistency in the measures chosen: three used the Beck Depression Inventory (BDI) and two the Impact of Event Scale (IES). Owing to the diversity of assessment instruments, it was difficult to assess the baseline similarity of participants across studies. Apart from three studies, Reference Constantino, Sekula and Rubinstein15,Reference Seguin, Vinet-Bonin and Senecal19,Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 the length of follow-up was less than 1 year. It is unlikely, therefore, that participants were followed long enough to allow a meaningful assessment of outcome in most studies.
Study selection.
The settings in which the interventions occurred were also diverse and included a school, Reference Poijula, Dyregrov, Wahlberg and Jokelainen13 the family home, Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 the scene of the suicide, Reference Campbell14 a laboratory at a university, Reference Kovac and Range16 and a suicide prevention centre. Reference Farberow18,Reference Seguin, Vinet-Bonin and Senecal19 Two studies did not report any details about the setting. Reference Constantino, Sekula and Rubinstein15,Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 With the exception of one study, Reference Kovac and Range16 the interventions were delivered in a family or group context by mental health professionals Reference Constantino, Sekula and Rubinstein15,Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17,Reference Seguin, Vinet-Bonin and Senecal19,Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 or by mental health professionals in conjunction with volunteers who had themselves been bereaved by suicide. Reference Campbell14,Reference Farberow18
Quality
With the exception of the study by de Groot et al, Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 substantial methodological problems were identified in the studies. The key threats to study validity are summarised in Table 1; the full quality appraisal is available from the authors.
Summary of results: intervention v. no intervention
| Study | Outcome measures used | Summary of results | Main threats to validity |
|---|---|---|---|
| Campbell (2002) Reference Campbell14 | Length of time between intervention and seeking treatment | The intervention group sought treatment significantly quicker than the comparison group. Intervention, mean 37.7 days (s.d.=1.2); comparison, 222.2 days (s.d.=240.7), P<0.001 | Non-randomised study using partly historical controls Generalisability Inadequate outcome measure — based on the assumption that seeking help following the intervention is a positive outcome |
| De Groot et al (2007) Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 | Primary outcome: self-reported complicated grief measured with ITG Secondary outcomes: CESD Suicidal ideation Perception of being to blame for the suicide (Likert scale) TRGR2L | There was no statistically significant difference between intervention and control groups on the primary outcome (ITG: adjusted mean difference -0.61, 95% CI -6.05 to 4.83, P=0.82) There was a statistically significant benefit for the intervention group compared with control in perception of being to blame (adjusted OR=0.18, 95% CI 0.05 to 0.67, P=0.01) but not for suicidal ideation (adjusted OR=1.08, 95% CI 0.33 to 3.57, P=0.89), CESD (adjusted mean difference 1.97, 95% CI -1.65 to 5.60, P=0.28) or TRGR2L (adjusted OR=0.39, 95% CI 0.15 to 1.01, P=0.06) When unadjusted scores were used there was no significant difference between groups on any of the measures. All analyses were adjusted for clustering of symptoms within families. The adjusted scores accounted for gender, having lived with the person who had died, and closeness of the relationship. In addition, the analyses of suicidal ideation and perception of being to blame were adjusted for baseline depression | No substantial threats to validity The study was randomised and although the method of allocation concealment was not ideal (a list was used) the authors state that an independent secretary administered the procedure. There were differences between the groups at baseline but an adjusted analysis was conducted to account for these differences. A greater proportion of the intervention group were male and had lived with the deceased compared with the control group |
| Farberow (1992) Reference Farberow18 | Intensity of nine emotions (anger towards deceased, anger towards self, anxiety, depression, grief, guilt, puzzlement, shame, suicidal ideation), rated as high, moderate or low | There was improvement on eight emotions (anger towards deceased, anger towards self, anxiety, depression, grief, guilt, puzzlement, shame) for the intervention group compared with one for the comparison group at 8 weeks. Statistical analysis was not conducted and comments on improvement seemed to be based on change within groups over time, not between groups | Non-randomised study with high risk of selection bias. There were differences between the groups at baseline |
| Pfeffer et al (2002) Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 | Beck Depression Inventory (parents) Childhood Post-traumatic Stress Reaction Index Children's Depression Inventory Revised Children's Manifest Anxiety Scale Social Adjustment Inventory for Children and Adolescents | There was a greater reduction in anxiety (RCMAS) and depression (CDI) at 12 weeks for children who received the intervention compared with those who did not (statistically significant), but not for social adjustment (SAICA), post-traumatic stress (CPSRI) or parental depression (BDI) Mean RCMAS score from baseline to follow-up: intervention 49.3 (s.d.=9.9) to 39.6 (s.d.=10.6); comparison 52.6 (s.d.=6.5) to 56.5 (s.d.=10.2), P≤0.001 Mean CDI score from baseline to follow-up: intervention 46.5 (s.d.=8.7) to 44.1 (s.d.=8.7); comparison 53.7 (s.d.=11.8) to 53.9 (s.d.=7.8), P≤0.006 | Inadequate method of randomisation to groups leading to risk of selection bias. There were differences between the groups at baseline Extremely high loss to follow-up in the control group |
Two of the RCTs were truly random, Reference Constantino, Sekula and Rubinstein15,Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 one was not (participants were assigned in alternating order), Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 and one did not report how randomisation was carried out. Reference Kovac and Range16 One RCT attempted to conceal treatment allocation. Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 There is therefore the risk that the effectiveness of the interventions was overestimated in the other studies, especially given that subjective outcome measures were used. The remaining studies used various methods to assign participants to the intervention and comparison groups, all of which had a high risk of selection bias. There were differences between groups at baseline in three studies, Reference Kovac and Range16–Reference Farberow18 or it was unclear whether they were similar. Reference Poijula, Dyregrov, Wahlberg and Jokelainen13,Reference Constantino, Sekula and Rubinstein15 None of the studies appeared to conduct a full intention-to-treat analysis including all allocated participants. In some situations this can lead to an overestimation of the treatment effect, but it is worth noting that in the study by de Groot et al those who dropped out had slightly more favourable scores at baseline for depression, complicated grief and self-blame. Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20
The studies were generally small and, with the exception of the de Groot et al study, Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 it was unclear whether they were appropriately powered to detect an effect on all the outcomes measured. Four of the studies indicated (explicitly or implicitly) that the intervention was implemented based on a treatment protocol or manual. Reference Constantino, Sekula and Rubinstein15–Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17,Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 It was possible to assess the fidelity of the intervention in only one study, which measured consistency of delivery. Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 Hence, there is the question of whether the intervention and comparison were delivered as planned, and in a consistent manner.
Study findings
Intervention v. no intervention
There was some evidence of a positive effect of interventions when compared with no intervention (Table 1). A 10-week bereavement group intervention for children, led by psychologists, was more effective than no intervention at reducing anxiety and depression, but not social adjustment and post-traumatic stress. Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 This was a small study and it was unclear whether it was appropriately powered to detect an effect on the outcomes measured. In addition, a fifth of the comparison group sought other interventions, which might have diluted or inflated the effect of the intervention. There were also differences between the groups at baseline: children in the intervention group were younger, had better social adjustment and the length of time since bereavement was shorter.
An 8-week group therapy intervention delivered by a mental health professional and a volunteer was associated with a lessening in intensity of eight of nine emotions assessed compared with one of nine emotions for the control group. Reference Farberow18 However, a statistical analysis was not reported for differences between groups, and at baseline the intervention group reported greater feelings of grief, shame and guilt than the comparison group. The reliability and validity of the outcome measure were unclear. The time lapse between bereavement and attending a crisis centre for assessment and treatment was shorter in those who had received an active outreach intervention at the scene of the suicide compared with those who had not; Reference Campbell14 however, this outcome measure is based on the assumption that seeking help following the intervention is a positive outcome. In the absence of any information about individuals who received the outreach intervention but did not seek help at the crisis centre, it is unclear whether this was an appropriate assumption.
The third study was a cluster randomised trial of family-based cognitive–behavioural therapy (CBT), compared with usual care, for first-degree relatives and spouses. Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 The intervention consisted of four sessions of CBT with a trained psychiatric nurse counsellor, 3–6 months following the bereavement. This was the best-quality study found: there was an adequate method of randomisation, an appropriate method was used to adjust for baseline differences and loss to follow-up was low. Thirteen months after the bereavement there was no beneficial effect on the primary outcome of self-reported complicated grief reaction (measured by the Inventory for Traumatic Grief) or on suicidal ideation or depression in the intervention group compared with controls. There was evidence, however, of fewer maladaptive grief reactions and less perception of being to blame for the suicide. Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20
Studies using an active comparator
The findings from the studies comparing two or more active interventions were equivocal (Table 2). Among undergraduates, writing therapy over a 2-week period which involved describing the events and emotions around their loss had some marginal benefits compared with a trivial writing condition. Reference Kovac and Range16 However, participants in the profound writing group also had less severe grief than the comparison group at baseline. In a school setting, implementation of a crisis intervention involving first talk through and psychological debriefing was associated with fewer pupils experiencing high-intensity grief, but not stress response, than a less intense crisis intervention. Reference Poijula, Dyregrov, Wahlberg and Jokelainen13 A study comparing four professionally led, closed-group interventions of 2 months, 4 months, 6 months and 12 months duration reported a trend in all four groups towards decreasing depression over the 12-month follow-up period. Reference Seguin, Vinet-Bonin and Senecal19 There was some variation between groups in the decrease in BDI score (least reduction in the 2-month group and greatest in the 4-month group), although there was considerable and unequal loss to follow-up across groups, and what appeared to be baseline differences between the groups. In both these studies there was a high risk of confounding due to indistinct comparators. Reference Poijula, Dyregrov, Wahlberg and Jokelainen13,Reference Seguin, Vinet-Bonin and Senecal19 There was no benefit in participating in a health professional-led bereavement group compared with a social group intervention for women bereaved by the suicide of their spouse, although it was unclear whether this study was appropriately powered to detect an effect. Reference Poijula, Dyregrov, Wahlberg and Jokelainen13
Summary of results: studies using an active comparator
| Study | Outcome measures used | Summary of results | Main threats to validity |
|---|---|---|---|
| Constantino et al (2001) Reference Constantino, Sekula and Rubinstein15 | Beck Depression Inventory Brief Symptom Inventory Grief Experience Inventory Social Adjustment Scale | There was no statistically significant difference between groups up to 12 months follow-up on any of the assessment scales (BDI, BSI, GEI, SAS) | This was a randomised study but the data for between-group comparisons were not reported. The authors stated there was no between-group difference, and combined the two groups to make before-and-after comparisons. Owing to the lack of a no-intervention control group it is unclear whether the improvement in the two groups would have occurred anyway |
| Kovac & Range (2000) Reference Kovac and Range16 | Grief Experience Questionnaire Grief Recovery Questionnaire Impact of Event Scale Non-routine healthcare visits (self-reported) | There was a significant improvement in grief associated with suicide (GEQ) for the intervention group compared with the control group (statistically significant) at 8 weeks but not on any of the other measures used (GRQ, IES, non-routine healthcare visits) Mean GEQ total score from baseline to 8 weeks: intervention 109.9 (s.d.=37.2) to 90.3 (s.d.=25.6); comparison 122.6 (s.d.=29.0) to 106.1 (s.d.=27.5), P<0.001 | Randomised study, but it was not possible to assess adequacy of randomisation and allocation concealment. There were differences between the groups at baseline Generalisability Conducted with undergraduates who were rewarded with course credits for participation |
| Poijula et al (2001) Reference Poijula, Dyregrov, Wahlberg and Jokelainen13 | Hogan Sibling Inventory of Bereavement Impact of Event Scale | Significantly more of the pupils in school A were classified as having high-intensity grief compared with the other schools (HSIB: school A 25% in high-intensity grief group compared with 5% in school B and 0% in school C), 4-9 months following the intervention. When a comparison was made between those who received an intervention and those who did not, there was no between-group difference in the proportion of participants classified as being at high and low risk of intense grief. Based on IES, the proportion of participants defined as being at high risk of PTSD were 24.1% for school A, 25% for school B and 15.4% for school C (NS) | Observational study using indistinct comparators. High risk of confounding |
| Seguin et al (2004) Reference Seguin, Vinet-Bonin and Senecal19 | Beck Depression Inventory Tessier Scale of Grief | There was improvement in depression scores (BDI) in the four groups over 1 year though it was unclear whether there was any between-group difference (statistical analysis not conducted). Mean BDI scores from baseline to 12 months follow-up: group A 15.0 (s.d.=9.37) to 11.6 (s.d.=11.6); group B 20.5 (s.d.=9.6) to 8.7 (s.d.=7.0); group C 17.7 (s.d.=11.4) to 0 (data available for only one participant); group D 21 (s.d.=9.4) to 13.6 (s.d.=12.0). The authors state that scores on the TSG remained stable, although this is not clear from the tables reported | Observational study using indistinct comparators. The complexity of these interventions is such that one cannot be sure that the only difference is treatment duration. High risk of confounding |
Discussion
Despite extensive searches, no language restrictions and broad inclusion criteria we identified only eight eligible studies, none of which focused on health professionals.
Interpretation of results
Six of the eight studies showed some evidence of benefit for participants receiving the intervention on at least one measure. However, because of the differences between studies and the methodological limitations, considerable care needs to be taken before accepting the assumption that some kind of intervention is better than none. Some of the methodological limitations, such as small sample size or the control group receiving support from elsewhere, might have resulted in the treatment effect being underestimated. However, the latter might also have led to an overestimation of the treatment effect if the additional support was detrimental to the control group. Other limitations such as non-randomised allocation of participants to intervention groups might also have led to an overestimation. Despite positive findings from the study with the lowest risk of bias, uncertainty remains, as there was no evidence of benefit on the primary outcome of self-reported complicated grief. This early-stage intervention has the benefit of being brief, although replication and evidence of a stronger treatment effect would increase confidence in the effectiveness of such an intervention. Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20
Owing to the paucity of data it was not possible to explore whether the effects of interventions varied with age, gender, self-referral, characteristics of the deceased or the nature of the relationship between the bereaved and the deceased. Whether bereaved individuals benefit from an intervention may depend on whether or not they are experiencing complicated grief. Reference Hawton6,Reference Stroebe, Schut and Stroebe21 However, it was not possible to explore this issue owing to the limited data available.
The review is limited by the small number of studies available, their diversity and general poor quality. This reflects the findings of a systematic review of bereavement care interventions for general population groups, where the authors reported considerable theoretical and clinical diversity, inadequate reporting of intervention procedures, methodological flaws, and few replication studies. Reference Forte, Hill, Pazder and Feudtner22 The evidence for a positive effect of interventions for general bereaved populations is also weak. Reference Forte, Hill, Pazder and Feudtner22–Reference Litterer Allumbaugh and Hoyt24 Our review did not address the question of whether interventions for people bereaved through suicide need to be different from those provided to people bereaved through other means. Given the limitations of the studies of general bereaved populations and populations bereaved through suicide, it is unlikely that data are currently available to address this question. However, it is an important issue that should be addressed.
Implications for practice and research
The evidence we have identified and appraised is not robust; clear implications for practice therefore cannot be drawn. However, based on the limited evidence available from single studies, the following tentative suggestions are made: psychologist-led group therapy for children may reduce anxiety and depression, Reference Pfeffer, Jiang, Kakuma, Hwang and Metsch17 and combined health professional- and volunteer-led group therapy for adults may reduce feelings of anger towards the deceased and self, anxiety, depression, grief, guilt, puzzlement and shame. Reference Farberow18 There is also recent evidence that a brief CBT family intervention by a trained psychiatric nurse counsellor resulted in fewer maladaptive grief reactions and less self-blame. Reference De Groot, de Keijser, Neeleman, Kerkhof, Nolen and Burger20 However, it remains unclear whether interventions are helpful and, if they are, the best timing of such intervention. Similarly, it is unclear whether they are helpful for all people bereaved through suicide or whether there are specific individuals who might benefit most – for example those experiencing complicated grief.
The views of participants were noticeably absent from the studies. Their views on the interventions received were generally not obtained and it was unclear whether the support given was viewed as helpful and appropriate to their needs. Obtaining the views of participants in future studies is vital to help identify the effective components of interventions and to establish what support is helpful to people bereaved by suicide. Grief can be culture-specific: consideration needs to be given to the generalisability of evidence to different ethnic groups. Research is required on the effectiveness of interventions in different ethnic groups as well as the potentially different responses of males and females, people of different ages and background as well as those experiencing complicated grief.
There is a pressing need for methodologically sound RCTs. Although this is a challenging study design to implement in this field, the recently published trial of CBT illustrates that it is possible. Sample size calculations need to take into account the need for analysis to investigate the impact of potentially important prognostic factors on outcome. It would aid meaningful comparison between studies if a core set of outcome measures could be used: consideration needs to be given to whether to use generic scales for anxiety and depression and/or grief specific measures.
Appendix
Quality assessment criteria
If the study was described as a randomised controlled trial (RCT), was the assignment to treatment groups really random?
If it was described as an RCT, was the treatment allocation concealed?
Was the assignment of participants to treatments described?
Were the groups balanced at baseline in relation to potential confounders?
Were baseline differences adequately adjusted for in the design or in the analysis?
Were important confounders reported?
Was outcome assessment made masked to group allocation?
What proportion of participants completed the study?
Were withdrawal rates and reasons similar across intervention and control groups?
Were the data collection tools shown or known to be valid for the outcome?
Were the data collection tools shown or known to be reliable for the outcome?
Was the statistical analysis appropriate?
Did the analyses include an intention-to-treat analysis?
Was the consistency of the intervention measured?
If yes, was the intervention provided to all participants in the same way?
Is it likely that participants received an unintended co-intervention?
Is it likely that contamination might have influenced the results?
Was the length of follow-up long enough for the outcomes to occur?
Acknowledgements
This study was funded by the Policy Research programme of the Department of Health. The views expressed in the publication are those of the authors and not necessarily those of the Department of Health.
eLetters
No eLetters have been published for this article.