Substance use disorders are a leading cause of global disease burden in terms of disability-adjusted life-years (DALYs).Reference Degenhardt, Charlson, Ferrari, Santomauro, Erskine and Mantilla-Herrara1 Drug use has been found to be associated with increased risk of unintended injuries, suicide, HIV infection, AIDS and liver cirrhosis, all of which contribute to greater disease burden.Reference Degenhardt, Charlson, Ferrari, Santomauro, Erskine and Mantilla-Herrara1 Moreover, there is evidence of substantial comorbidity between substance use disorders and other mental health disorders, which adds to the health burden associated with substance use disorders.Reference Hjorthøj, Østergaard, Benros, Toftdahl, Erlangsen and Andersen2,Reference Teesson, Slade and Mills3 In Australia, the annual economic costs including both healthcare costs and productivity loss associated with opioid misuse, cannabis and illicit drug use are substantial (over A$27 billion), and include cannabis (A$4.8 billion), opioids (A$17 billion) and methamphetamine (A$5.4 billion) in 2019 prices.Reference Whetton, Shanahan, Cartwright, Duraisingam, Ferrante and Gray4–Reference Whetton, Tait, Chrzanowka, Donnelly, McEntee and Muhktar6 Both health and economic burden highlight the substantial impacts of opioid misuse, cannabis and substance use disorders and the need to prevent them.
Economic evaluation is a tool used to determine whether a programme is cost-effective or good value for money, often providing critical information to assist decision makers in resource allocation and priority setting. A full economic evaluation compares costs and outcomes of two alternative interventions with results often presented as incremental cost-effectiveness ratios (ICERs).Reference Drummond, Claxton, Sculpher, Stoddart and Torrance7 Cost–benefit analysis (CBA), cost-effectiveness analysis (CEA) and cost–utility analysis (CUA) are types of full economic evaluations. CEA outcomes are measured in natural or physical units such as a reduction in the risk of taking illicit drugs or delaying the initial use of a substance. CUA utilise a generic outcome of health gain that combines both quantity and quality-of-life components. Examples of generic outcomes include DALYs avoided or quality-adjusted life-years (QALYs) gained.Reference Drummond, Claxton, Sculpher, Stoddart and Torrance7 Return-on-investment (ROI) studies are similar to CBA, wherein outcomes are measured in monetary values. However, ROIs usually only include cost-offsets and not health benefits.
There has been increasing global emphasis on adopting national strategies in the prevention of cannabis use, opioid misuse and illicit drug use. The UK and Australia, for example, have established national guidelines or strategies that highlight the importance of preventive interventions by focusing on reducing both the supply and demand.8,9 Interventions, such as school-based programmes and skills training, have been found to be effective in preventing or delaying substance uptake and preventing harms.Reference Teesson, Newton and Barrett10,Reference Tremblay, Baydala, Khan, Currie, Morley and Burkholder11 Given this evidence, it is essential to know whether such interventions provide good value for money. Cost-effectiveness evidence has been adopted and is a requirement to support the funding and reimbursement of interventions and medications in the UK with the National Institute for Health and Care Excellence.Reference Owen, Pennington, Fischer and Jeong12 Similarly, in Australia, although mental health interventions are not subjected to formal health technology assessment hurdles,Reference Le, Hay, Ananthapavan, Lee and Mihalopoulos13 implementation support from the Federal and State governments is provided after presenting a business case or a CBA where the benefits are presented in monetary values.Reference Le, Hay, Ananthapavan, Lee and Mihalopoulos13,Reference Frydenberg14
There are two existing reviews published in 2021 that investigated economic evaluations for alcohol, smoking, illicit drug use prevention and other mental health disorders. The review by Nystrand et al,Reference Nystrand, Gebreslassie, Ssegonja, Feldman and Sampaio15 which identified a single economic evaluation for illicit drug use prevention, was limited to CUA studies and studies that have transferability to the Swedish setting. The second review published by Le et alReference Le, Esturas, Mihalopoulos, Chiotelis, Bucholc and Chatterton16 included full economic evaluations for any mental health and substance use disorders, but did not have a specific focus on substances use prevention, as evident by the search strategy, which limits capture of relevant prevention evaluations. There are no published reviews of economic evaluations with a specific focus on preventive interventions for cannabis use, opioid misuse and illicit drug use or substance use disorders, leaving an important evidence gap for policy makers. Although cannabis is now legal in some jurisdictions, the legality of its use is still being debated in others; hence this review takes a broad approach in examining all preventive interventions.
Objective
The objective of this review is to determine which interventions have ‘value for money’ evidence for the prevention of opioid misuse, cannabis and illicit drug use.
Method
The current review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelineReference Page, McKenzie, Bossuyt, Boutron, Hoffmann and Mulrow17 and was registered with the PROSPERO database (identifier CRD42020147386; the protocol was amended to include additional researchers and choose the Drummond checklist as the tool for quality assessment). This review is part of a broader project that includes a review of the cost-effectiveness of treatment interventions for substance use disorders (PROSPERO identifier CRD42020147403). During the course of the review, deviations from the registered protocol were warranted and decided upon. Initially, the review was planned to encompass all substances, including alcohol and tobacco prevention, but the number of eligible publications necessitated a decision to organise separate reviews for alcohol, tobacco and other substances. We also decided to present results of this particular review by specific substance (i.e. opioid misuse, cannabis and illicit drug use) to better illustrate which interventions have been evaluated for the prevention of its use, and to better reflect the variation in prevention approaches for these substances. The last protocol deviation was the use of the Drummond checklist for quality assessment in place of the Quality of Health Economic Studies Instrument (QHES). Although the QHES is appropriate to assess quality of modelled economic evaluations, the Drummond checklist is useful for both modelled and trial economic evaluations.
Literature search
Electronic databases were searched for economic evaluations for alcohol, smoking, illicit drug use prevention and treatment in August 2019, and updated in May 2021. Electronic database searches were conducted in EMBASE and through the EBSCOhost platform for Medline, CINAHL, PsycINFO and EconLit databases. Further details of search terms are presented in Supplementary Appendix 1 available at https://doi.org/10.1192/bjo.2023.515. Search terms related to prevention and treatment, as well as terms for alcohol and smoking, opioid misuse, cannabis and illicit drug and substance use disorders, were included in the search. Treatment was explicitly included to expand the search because the terms ‘early interventions’, ‘early treatment’ and ‘preventive interventions’ are often used interchangeably. However, during the updated search for prevention, we decided to exclude the terminology ‘treatment’ because we identified no additional benefit of using this term during the initial screening. For this review, only cost-effectiveness studies that evaluated preventive interventions for opioid misuse, cannabis and illicit drug use (including problem use of prescription opioids) were included. Search strategies for specific databases differ on the subject headings used for their respective indexing. Subject headings were searched and uniquely utilised for each database except for EconLit. Keywords were used over subject headings in EconLit as subject headings were inappropriate. Other relevant free text search terms for titles and abstracts were first tested in Medline and were used in other databases through EBSCOhost. Filters were used to limit the searched articles to studies comprising peer-reviewed journal articles in English. No year restrictions were utilised. Grey literature search from cost-effectiveness registries was also conducted to supplement the search strategy.
Inclusion and exclusion criteria
Studies were included if they were full economic evaluations (i.e. comparing at least two interventions including costs and outcomes) or ROI studies that evaluated a preventive intervention for cannabis use, opioid misuse or illicit drug use or use disorders, and were published in English. Cost-of-illness studies, partial economic evaluations (particularly cost–outcome description studies or cost analysis), book chapters and thesis papers were not eligible. Classification for prevention studies was primarily based on the study population (e.g. not diagnosed to have a substance use disorder or prevention of progressing to a substance use diagnosis) following the framework set by Mrazek and Haggerty.Reference Mrazek and Haggerty18 Specifically, studies examining interventions that prevent exposures or alter behaviours that can lead to opioid misuse, cannabis and illicit drug use. Our review includes preventive interventions both at a population level (such as policy legislation) and an individual level (such as educational programmes). Targeted prevention (e.g. targeting at-risk populations for opioid misuse, cannabis and illicit drug use) is also included in this review.
Study selection and extraction
Articles retrieved from the online search were uploaded into Covidence (Veritas Health Innovation, Melbourne, Australia; see www.covidence.org), where duplicates were removed by the program. Two reviewers screened each article independently for inclusion during both title and abstract screening and full-text review stages (J.F., L.K.-D.L., M.L.C., J.K.P., O.C., H.N.Q.T., M. Sultana or N.H.). In the event of disagreement across the screening process, a third reviewer resolved the conflict. Data extraction commenced in November 2020 and was conducted by a single reviewer (J.F. or J.K.P.) in Microsoft Excel version 15.0 for Windows. The accuracy of extracted data was confirmed by a second reviewer (J.F. or J.K.P.). The results were extracted and synthesised in a descriptive and tabular format, which included information on the type of study, perspective and time horizon, costs and outcomes, and ICERs. Costs and ICERs were converted into 2019 United States dollars (US$) with Cost Converter version 1.6 (see https://eppi.ioe.ac.uk/costconversion/default.aspx) developed by the Co-convenors of the Campbell & Cochrane Economics Methods Group and Evidence for Policy and Practice Information and Co-ordinating Centre, for comparison across studies.Reference Shemilt, Thomas and Morciano19 For studies not reporting a reference year for costs, the assumption of 2 years before publication was used as the base year. Meta-analysis was not attempted because of the expected methodological heterogeneity across studies. Studies were grouped as prescription opioid misuse, cannabis use and illicit drug use prevention to account for cannabis being legal in some jurisdictions.
Quality assessment
The Drummond ten-point checklist for assessing economic evaluations was used to evaluate the quality of included studies.Reference Drummond, Claxton, Sculpher, Stoddart and Torrance7 The ten points for assessment include the research question, intervention(s) description, intervention effectiveness, costing methodology (identification, measurement and valuation), discounting or time preference, incremental analysis, sensitivity and uncertainty analysis, and presentation and discussion of results. The ten points include 33 sub-questions individually answered during quality assessment by two independent assessors (J.F., L.K.-D.L., M.L.C., J.K.P., O.C., H.N.Q.T., M. Sultana or N.H.). Conflicts were initially resolved by the quality assessors, with further unresolved conflicts adjudicated by a senior researcher (L.K.-D.L. or M.L.C.). Quality assessment identified which aspects highlighted by the Drummond checklist were met. A previously published scoring system was used to attach a score for each study.Reference Gonzalez-Perez20 Each criteria could be given a score of 1 for a ‘yes’, 0.5 for a ‘cannot tell’ or 0 for a ‘no’. A quality score of 9 to 10 is considered ‘good’, a score of 6 to 8.5 is considered ‘fair’ and a score ≤5.5 is considered poor quality.
Results
Study selection and inclusion
The literature search identified 5674 articles. After removing duplicates and screening the abstracts, 488 articles remained and were assessed in full-text review, resulting in 124 studies with further exclusions. The main reasons for exclusion are presented with the PRISMA diagram, with the most common reason being incorrect study design or not a full economic evaluation. A total of 364 prevention and treatment articles were identified that met the inclusion criteria. Of these, 11 articles dealt with cannabis use, opioid misuse and illicit drug use prevention, and met the full inclusion criteria for this review (Fig. 1).
Fig. 1 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagram.
Study characteristics
As shown in Table 1, problem prescription opioid use (n = 4) and cannabis use (n = 3) prevention were evaluated in the majority of included studies, whereas other illicit drug use prevention was evaluated in two studies (cocaine, ecstasy and methamphetamine). Two studies considered non-specified illicit drug use prevention. Nine studies used a single type of economic analysis (three studies each for CBA, CEA and CUA). Multiple types of evaluation frameworks (e.g. CUA/CBA and CEA/CBA) were used in combination for two studies. In terms of study methods, economic modelling was utilised in the majority of studies (n = 7), followed by pre–post study design (n = 3) and a randomised controlled trial (RCT) incorporating economic modelling. The majority of the studies (n = 7) were conducted in the USA, followed by Sweden (n = 2). The UK and South Korea had one study each. Children (aged 5–14 years) were the main target population in 70% of the studies, which involved school-based and family-centred (universal) interventions. Adults were the target population in the remaining studies, evaluating selective preventive interventions.
Table 1 Study details
ICER, incremental cost-effectiveness ratio; SFP:10-14, Strengthening Families Program 10–14; LST, Life Skills Training; Project ALERT, Adolescent, Learning, Experiences, Resistance and Training; CEA, cost-effectiveness analysis; WTP, willingness-to-pay; CUA, cost–utility analysis; QALY, quality-adjusted life-year; ISFP, Iowa Strengthening Families Program; CBA, cost–benefit analysis; RCT, randomised controlled trial; PYMU, past-year methamphetamine use case; SET, Social and Emotional Training; NPV, net present value; SBIRT, screening, brief intervention and referral to treatment; STRIVE, SupporT to Reunite, Involve and Value Each other.
Main findings
Prevention of prescription opioid misuse
Four studies evaluated the cost-effectiveness of prescription opioid misuse prevention, three of which were conducted in the USA and one in South Korea. The interventions identified for the USA setting were a school-based programme, a family-centred programme and misuse-deterrent opioid formulations; a doctor's database assisting patient risk assessment was evaluated in the South Korean setting. All four studies utilised economic models to evaluate cost and benefit of intervention over 1- to 30-year time horizons.
Two of the studies evaluated misuse-deterrent opioid formulations against extended-release opioids. White et alReference White, Birnbaum, Rothman and Katz31 conducted a CBA with a third-party payer perspective (i.e. private insurance), using a 1-year time horizon; Kumar et alReference Kumar, Agboola, Synnott, Segel, Webb and Ollendorf27 conducted a CEA considering a health sector perspective with a 5-year time horizon. Both studies included direct costs related to healthcare utilisation.Reference Kumar, Agboola, Synnott, Segel, Webb and Ollendorf27 The White et alReference White, Birnbaum, Rothman and Katz31 budget impact model estimated that there were potential cost-savings ranging from US$0.748 to US$2 billion for the insurance payer; however, the misuse-deterrent opioid prescription cost used in the study was a shadow cost or a similar cost of a branded opioid. In contrast, the misuse-deterrent opioid prescription costs used by Kumar et alReference Kumar, Agboola, Synnott, Segel, Webb and Ollendorf27 were actual drug costs that resulted in significant costs to the healthcare system. Sensitivity analysis indicated that the model was sensitive to misuse-deterrent opioid price, where a 40% reduction in misuse-deterrent opioid prescription cost would result in cost neutrality.
The study by Crowley et alReference Crowley, Jones, Coffman and Greenberg21 evaluated youth school-based programmes, a family-centred programme or a combination of both, and compared them with having no programme over a 6-year time horizon. Only intervention delivery costs were included in the analysis. A willingness-to-pay (WTP) threshold of US$8667 per case of non-medical opioid misuse prevented was established based on the average societal cost for youth engaged in nonmedical prescription opioid use. Three sets of interventions (Life Skills Training (LST) programme only, Strengthening Families Program 10–14 (SFP:10–14) + All Stars programme and SFP:10–14 + LST) were deemed to be cost-effective, given that the ICER fell below the predetermined WTP threshold of US$8667 to prevent one youth from misusing prescription opioids before the 12th grade.Reference Crowley, Jones, Coffman and Greenberg21
The South Korean study by Kim et alReference Kim, Kim and Suh25 evaluated an opioid abuse preventive programme, ‘the Network System to Prevent Doctor-Shopping for Narcotics’, which allows doctors access to a database of a patient's previous narcotics use, allowing them to determine if a patient is at risk of misusing narcotics. Over a 30-year time horizon, compared with no programme, implementing the programme was determined to be cost-effective (US$227 per QALY; WTP threshold of US$31 362 per QALY) from a healthcare system perspective. Threshold analysis showed that the programme was 100% cost-effective even when using a WTP threshold of US$900 per QALY. Furthermore, including cost beyond the healthcare system under a societal perspective indicated that the intervention was cost-saving against having no programme.Reference Kim, Kim and Suh25
In summary, the literature showed that there are cost-effective preventive interventions for opioid misuse in the case of the school-based interventions (LST, SFP:10–14 + All Stars and SFP:10–14 + LST) and the doctor's database on assessing patient risk, as all fell under WTP thresholds.
Cannabis use prevention
Three studies evaluated cannabis use prevention interventions. Two studies evaluated school-based interventions and the third study evaluated two family-centred interventions and a web-based intervention.
A school-based educational programme integrated within different curriculums was evaluated by Mitchel et alReference Mitchel, Hu, Donnell and Swisher28 in the USA. The CEA used a pre–post study design with a 10-month time frame. This study resulted in one of three integrated curriculums being effective. The study did not report an ICER, but instead presented an ‘effective cost’ or a cost-effectiveness ratio by dividing the societal cost of an intervention by the number of students with positive intervention effects. The study showed that the ‘effective cost’ for the religion curriculum with prevention education programme was US$181 per case prevented of cannabis and cigarette consumption.Reference Mitchel, Hu, Donnell and Swisher28 The second school-based intervention, Project ALERT (Adolescent, Learning, Experiences, Resistance and Training), was evaluated with an economic model in the Swedish setting by Deogan et al.Reference Deogan, Zarabi, Stenström, Högberg, Skärstrand and Manrique-Garcia22 Project ALERT aimed to prevent cannabis experimentation and continuation of use compared with a ‘do nothing’ scenario under a societal perspective. In their modelling, they included prevention of regular use of cannabis and transitioning to using other illicit drugs. The study found that the intervention was cost-effective at 20 years, with an ICER of US$2845 per QALY gained. When the time horizon was extended to a lifetime time horizon, the ICER reduced to US$1904 per QALY gained.Reference Deogan, Zarabi, Stenström, Högberg, Skärstrand and Manrique-Garcia22
The third cannabis prevention study by Pennington et alReference Pennington, Collins, Leigh, Martin, Owen and Fischer30 simulated three different targeted behavioural interventions identified from literature review. Two family-based interventions (Focus on Families and Familias Unidas) were evaluated against active comparators with short time horizons of 1 and 2 years, respectively. The cannabis model generated for the evaluation included intervention, crime and treatment of potential psychotic disorder costs that was described as a partial public sector perspective. Considering the reported WTP threshold of US$31 014, none of the interventions were cost-effective. Reported ICERs were US$153 915 305 per QALY gained (Focus on Families) and US$373 711 per QALY gained (Familias Unidas). The third intervention was modelled over 2 years and was a web-based intervention that resulted in an ICER of US$741 697 per QALY gained, which also exceeded the WTP threshold.
For cannabis use prevention, the school-based programme Project ALERT had promising cost-effectiveness evidence.
Illicit drug use prevention
Five studies were identified that looked at prevention of methamphetamine use, ecstasy use, cocaine use and general drug use. Evaluated preventive interventions were family-centred programmes; school-based interventions; screening, brief intervention and referral to treatment (SBIRT); and motivational interviewing. The first four were evaluated in a universal population whereas motivational interviewing was evaluated in an at-risk or indicated population.
Hajizadeh et alReference Hajizadeh, Stevens, Applegate, Huang, Kamboukos and Braithwaite24 evaluated a family-centred intervention, ParentCorps, comparing it with a standard pre-kindergarten programme by using a model that simulated pre-kindergarten children over a lifetime. The societal perspective included healthcare (obesity, diabetes and drug use related), judiciary and productivity in addition to intervention costs. ParentCorps was shown to have a savings of US$4703 and an additional 0.27 QALYs.Reference Hajizadeh, Stevens, Applegate, Huang, Kamboukos and Braithwaite24 In the USA setting, an economic evaluation alongside an RCT evaluated the cost-effectiveness of a family-based intervention, Iowa Strengthening Families Program (ISFP), and a school-based intervention, LST, or a combination thereof, in preventing methamphetamine use. Guyll et alReference Guyll, Spoth and Crowley23 undertook economic analyses using both CEA and CBA. The perspective taken was from the employer and included productivity-related costs in addition to employer-funded healthcare costs. The CEA utilised a 5.5- to 6.5-year time horizon, whereas the modelled CBA evaluated a career-duration time horizon (from 18 to 65 years). ISFP, LST and a combination of LST and an adaptation of ISFP (SFP:10–14 + LST) were found to be effective and cost-effective under CBA. ICERs reported for CEA were US$31 664 (ISFP), US$6377 (LST) and US$78 206 (SFP:10–14 + LST) per past-year methamphetamine use case prevented. Modelled CBA results showed positive benefit–cost ratios of 3.84 (ISFP), 19.04 (LST) and 1.56 (SFP:10–14 + LST).Reference Guyll, Spoth and Crowley23 Another school-based intervention, Social and Emotional Training (SET), was evaluated by Klapp et al in seventh to ninth grade students over 5 years. The study reports an intervention cost of US$596 per student and a benefit of US$8292 from avoided social burden of drug use, equivalent to US$13.9 per dollar spent.Reference Klapp, Belfield, Bowden, Levin, Shand and Zander26 The final universal prevention study evaluated SBIRT compared with no SBIRT, under a healthcare perspective CBA for adults. The study reports annual cost-savings equal to a ratio of US$16 per dollars spent.Reference Paltzer, Moberg, Burns and Brown29
Pennington et alReference Pennington, Collins, Leigh, Martin, Owen and Fischer30 assessed motivational interviewing for at-risk young gay and bisexual men, and a family-based intervention for newly homeless youth for cocaine use prevention. The modelling used a partial public sector perspective by including healthcare and criminal justice sector costs over a 2-year time horizon. Costs in the model included intervention, criminal justice and cocaine dependence treatment costs (including cocaine-specific hospital admission and cocaine-related cardiovascular treatment). Two motivational interviewing interventions were evaluated against educational videos in gay men. ICERs reported for the motivational interviewing interventions were US$698 549 and US$306 455 per QALY gained. The family intervention was evaluated against standard care by modelling a homeless youth population, and reported an ICER of US$1 500 422 per QALY gained.Reference Pennington, Collins, Leigh, Martin, Owen and Fischer30
In the Pennington et alReference Pennington, Collins, Leigh, Martin, Owen and Fischer30 study, a targeted prevention strategy, motivational and cognitive behavioural intervention, was modelled for prevention of ecstasy use in people who occasionally use illict drugs. The intervention was modelled over a 1-year time horizon and included similar costs as mentioned previously. The intervention resulted in a ICER of US$731 622 per QALY gained.Reference Pennington, Collins, Leigh, Martin, Owen and Fischer30
Several preventive interventions for illicit drug use are backed by value-for-money evidence. SBIRT, family-based interventions (ParentCorps and ISFP), school-based interventions (LST and SET) or a combination (SFP:10–14 + LST) had promising cost-effectiveness results.
Quality assessment
Overall, most of the studies (73%) are of fair quality, except for two studies (18%) with good quality and one study (9%) with poor quality.Reference Gonzalez-Perez20 Most of the studies satisfied the requirements for a good research question based on the Drummond criteria. Only 64% of studies reported the economic perspective taken by the evaluation. The evidence for intervention effectiveness was sourced from RCTs (18%), systematic reviews of multiple clinical studies (27%) and observational studies (64%). Hajizadeh et alReference Hajizadeh, Stevens, Applegate, Huang, Kamboukos and Braithwaite24 utilised both a RCT and observational evidence to model cost-effectiveness. Costs and consequences identified were wide enough for the research question (82%) and covered the perspective taken (73%). Only 64% reported inclusion of capital and/or rollout costs. In terms of measurement of costs and consequences, 91% of the studies were judged to have adequate description and justification, and no studies omitted any identified costs and consequences. There was adequate reporting of valuation, with most studies using market values and all studies clearly identifying sources. Discounting was used in seven out of nine studies that reported time horizons longer than 1 year. Most studies (82%) conducted incremental cost and outcome analysis. The majority employed sensitivity analysis, which guided the conclusions (73%). Presentation of results were reported with the majority discussing generalisability (64%), comparison with existing evidence (73%), implementation (64%) and need for further research (82%). A summary of the quality assessment is presented in Table 2.
Table 2 Quality assessment
Discussion
Summary of the main findings
This review is the first international review to comprehensively bring together economic evaluations of preventive interventions specifically for opioid misuse, cannabis and illicit drug use. The review distinguishes itself from other reviews that did not have a specific focus on cannabis use, opioid misuse and illicit drug use prevention.Reference Nystrand, Gebreslassie, Ssegonja, Feldman and Sampaio15,Reference Le, Esturas, Mihalopoulos, Chiotelis, Bucholc and Chatterton16 We found that there are preventive interventions that are supported by cost-effectiveness evidence that are of fair to good quality. In particular, school-based (LST, Project ALERT and SET) and family-centred programmes (ParentCorps and ISFP), or combinations of both (SFP:10–14 + All Stars, SFP:10–14 + LST), have demonstrated promising cost-effectiveness results across cannabis use, opioid misuse and illicit drug use prevention. Other preventive interventions with cost-effectiveness evidence are SBIRT for illicit drug use prevention and the Network System to Prevent Doctor-Shopping for Narcotics for problem opioid use prevention. Although multiple preventive interventions for cannabis use, opioid misuse and illicit drug use have been found to have positive effects, particularly in the short term,Reference Tremblay, Baydala, Khan, Currie, Morley and Burkholder11 this review found that there are still limited numbers of full economic evaluations in this area. Most of the studies have been published in the past decade in the USA, with no economic evaluations found for low- and middle-income countries. Another review by Le et alReference Le, Esturas, Mihalopoulos, Chiotelis, Bucholc and Chatterton16 also identified a similar lack of economic evaluations in low- and middle-income countries in their review of economic evaluations of mental health prevention and promotion.
Although the review intended to look into a broad range of preventive programmes, no studies were identified that focused on supply reduction, as all studies focused on demand reduction. Most programmes included in this review were universal and targeted young people (<18 years) through school settings. This is logical given that delaying initial consumption is typically the goal of cannabis use, opioid misuse and illicit drug use prevention. The majority of studies used economic modelling to simulate the cost-effectiveness of interventions. Economic models allow researchers to estimate population-level costs and effects over extended time periods. The models for substance use prevention projected costs and outcomes from 1-year to lifetime time horizons. Longer time horizons provided favourable cost-effectiveness results, from avoidance of longer-term costs to health and social systems. This trend is similar to alcohol and tobacco prevention interventions with lifetime time horizons included in the Nystrand et alReference Nystrand, Gebreslassie, Ssegonja, Feldman and Sampaio15 review. A limitation of using a longer time horizon is that models use assumptions that may limit confidence in conclusions.
There were a variety of perspectives reported. The most common perspective was societal, which would be appropriate given the costs associated with substance use that fall outside the healthcare system, such as judiciary and productivity costs.32 This is consistent with the recommendation promoted by Neumann et al,Reference Neumann, Ganiats, Russell, Sanders and Siegel33 as societal perspective reflects public interest. Some studies chose to evaluate narrow health sector or employer perspectives, most likely because of the difficulties of collecting costs for criminal justice and lost productivity associated with substance use. Using narrower perspectives are not necessarily inferior to a societal perspective, as choices regarding intervention or policy adoption depend on what level of evidence a decision maker requires. For instance, if an employer plans to implement a prevention programme, benefits of increased productivity may be enough for decision-making. This is the same when health payers use a healthcare perspective in deciding which programmes should be implemented.
All CBA studies reported cost-savings for the interventions evaluated, meaning the dollar value of the benefit gained was greater than every dollar being spent on the intervention. For CEA and CUA, Hajizadeh et alReference Hajizadeh, Stevens, Applegate, Huang, Kamboukos and Braithwaite24 showed cost-savings and increased QALYs, which points toward ParentCorps intervention dominance. Interpretation of other ICERs would depend on a WTP threshold. Of the studies, four reported WTP thresholds, and three reported ICERs falling below the threshold designating the interventions as cost-effective.
Methodological limitations of included studies
The Drummond checklist highlighted several limitations of the included studies. Multiple studies did not report perspectives that direct which resources should be identified, measured and valued. Several studies also evaluated interventions against active comparators, potentially minimising the incremental outcomes measured. In terms of evidence of effectiveness, most studies used observational data rather than RCTs, which may introduce bias. In addition, the economic models often relied on assumptions, especially when extrapolating a longer time horizon, adding to uncertainty in the results. Further research with economic evaluation alongside trials with long-term follow-up is required. Some studies did not address uncertainties in their results by failing to conduct sensitivity and uncertainty analysis, which could have increased confidence in the results. Although the Drummond checklist is clearly capable of identifying low-quality studies, it remains less effective in distinguishing high-quality studies.Reference Gonzalez-Perez20
Implications for policy and future directions for research
When considering which preventive interventions to roll out, decision makers should consider cost-effectiveness in addition to effectiveness data. Given the few studies noted in this review, further economic evaluations should be considered alongside intervention implementation in real-world settings, adding to the information available to decision makers. Of the interventions identified, ParentCorps for illicit drug use prevention and the Network System to Prevent Doctor-Shopping for Narcotics for problem opioid use prevention were of high quality and also highly cost-effective. The school-based interventions Project ALERT and SET were also cost-effective, but the evaluations were of fair quality.
The lack of economic evaluations in low- and middle-income countries is expected given that the Global Burden of Disease study revealed lower drug-attributable burden in lower-income countries. However, it is noteworthy that despite lower rates of illicit drug use in low- and middle-income countries, individuals with substance use problems have experienced higher mortality and have been less likely to receive treatment than those in high-income countries.Reference Medina-Mora and Gibbs S34,Reference Peacock, Leung, Larney, Colledge, Hickman and Rehm35 Further research is required to establish cost-effectiveness evidence of preventive interventions for cannabis use, opioid misuse and illicit drug use in these contexts. The methodology used in previous alcohol prevention evaluations by Chisholm et al can be a basis for future research.Reference Chisholm, Moro, Bertram, Pretorius, Gmel and Shield36,Reference Chisholm, Rehm, Van Ommeren and Monteiro37 This has the potential to bridge the gap in evidence to inform low- and middle-income countries regarding the impact of substance use prevention. In these studies, different alcohol prevention interventions were evaluated at different global contexts (e.g. world regions or low- and middle-income countries).
Strengths and limitations of the review
The original review protocol reflected our intention for a large-scale review that included prevention of alcohol and tobacco use; however, the large number of included studies warranted separate reviews. Although this limits the scope of this review, it highlights the cost-effectiveness evidence specific to opioid misuse, cannabis use and illicit drug use prevention. Meta-analysis was not attempted because of the heterogeneity in design and methodology, a problem that is common to systematic reviews of economic evaluations.Reference Shields and Elvidge38 However, the review presented costs in a single reference year for comparison across studies. Another limitation of this review is that non-English studies were excluded, which may have resulted in the exclusion of potentially relevant articles in low- and middle-income countries where English is not the first language. There may also be other relevant articles that were unintentionally excluded from the use of limited online libraries and during the screening process. Given this limitation, grey literature search from cost-effectiveness registries was performed to minimise missed studies. Although no ROI studies were found, it was the intention of this review to include such studies as they may be more familiar to public sector decision makers. Most of the studies are from the past 15 years, and so are still relevant for consideration.
In conclusion, our review showed that there has been limited economic evaluation studies around opioid misuse, cannabis and illicit drug use prevention. The differences in context and methodologies of identified studies do not facilitate generalisability of the cost-effectiveness findings. The studies were of reasonable quality, indicating some promising cost-effectiveness evidence. In particular, ParentCorps, Project ALERT and SET, which were analysed from the societal perspective, and the Network System to Prevent Doctor-Shopping for Narcotics for problem opioid use prevention, which was analysed from the healthcare perspective, all showed cost-effective and were of high-quality evaluation. Further research is required to confirm the replication of the economic evaluation results, as well as to explore further context-specific piloting of promising programmes accompanied by economic evaluation.
Supplementary material
Supplementary material is available online at https://doi.org/10.1192/bjo.2023.515
Data availability
All data and materials are available within the manuscript and supplementary resources. Further information may be available by request to the corresponding author, J.F.
Author contributions
L.K.-D.L., M.L.C., N.N., J.F. and C.M. designed the study and wrote the protocol. C.C., T.S., M. Sunderland, N.N., M.T. and C.M. acquired the funding. J.F. performed the literature search. J.F., L.K.-D.L., M.L.C., J.K.P., O.C., H.N.Q.T., M. Sultana and N.H. conducted screening, data extraction and quality assessment. J.F., L.K.-D.L., M.L.C., Y.Y.L., C.M., C.C., T.S., M. Sunderland, N.N. and M.T. contributed to the interpretation of the data. J.F. and L.K.-D.L. produced the first draft of the manuscript. All authors read, edited and approved the final version of the manuscript.
Funding
This review is funded by the National Health and Medical Research Council (NHMRC) Centre for Research Excellent PRevention and Early intervention in Mental Illness and Substance usE (PREMISE), under grant APP1134909. The funder had no involvement in any part of this publication.
Declaration of interest
None.
Open access
eLetters
No eLetters have been published for this article.