We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.
To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
The use of artificial intelligence (AI) in health care has the potential to improve clinical and patient outcomes and to reduce rising costs. There is an exponential increase in health technologies that use AI. We present a health technology assessment (HTA) case study demonstrating that the rapid rise in publications presents challenges for HTA bodies seeking to provide robust, timely assessments.
Methods
We conducted an HTA of AI-assisted endoscopy in the detection and characterization of lower gastrointestinal (GI) cancer. Searches were conducted up to October 2023. Unusually, the search targeted only the intervention: artificial intelligence and lower-GI-tract endoscopy (including colonoscopy, proctoscopy, etc.). The search strategy was peer reviewed. MEDLINE, Embase, KSR Evidence, CINAHL, Cochrane Library, and the INAHTA HTA database were searched, as well as ongoing trial registers and key websites. A date limit of 2010 onwards was applied, as Xbox Kinect launched in 2010 and was the first mainstream device used for healthcare imaging.
Results
Two network meta-analyses, 15 meta-analyses, one systematic review of meta-analyses, and three systematic reviews published since 2020 were identified. One review conducted searches to January 2020, identifying three randomized controlled trials (RCTs); a review that searched up to February 2023 identified 21 RCTs. There was substantial overlap regarding included primary studies, but not all reviews included the same outcomes. An additional seven RCTs were published in 2023. We also identified 12 cohort studies published between 2021 and 2023. We prioritized higher quality meta-analyses of clinical RCTs to include all outcomes of interest and updated the meta-analyses for primary outcomes.
Conclusions
This case study of an HTA of an AI-related technology demonstrates how rapidly the field is moving. It is necessary to use well targeted but not overly exclusive search strategies, limit by date, and prioritize inclusion of identified evidence according to quality and availability of outcomes. Time should be allowed to update existing meta-analyses.
Approximately five million people live with diabetes in the UK. The cost of this is approximately 10 percent of the National Health Service (NHS) budget. Wales has the highest prevalence of diabetes of any country in the UK. Educating people on how to best manage their condition can minimize associated complications. Digital platforms can aid self-management and improve risk factors.
Methods
This rapid review aimed to address the following research question: What is the clinical and cost effectiveness of digital platforms for personalized diabetes management to inform decision-making and guidance in the NHS? Digital platforms for this rapid review can be driven using artificial intelligence, machine learning, or through the application of data rules. Clinical evidence published since 2008 on health economics and patient, carer, and family perspectives relevant to Wales was identified by searching relevant databases such as MEDLINE. One relevant economic analysis was conducted using the UK Prospective Diabetes Study Outcomes Model 2.
Results
Outcomes included improvements in glycemic control, healthcare resource use (e.g., number of total general practitioner and emergency department visits per year), reduction in body weight among participants, reduction in cholesterol levels, and positive patient-reported outcome measures. An economic analysis identified in the literature review found that a digital platform was more effective and less costly than routine diabetes care and was, therefore, dominant. The analysis was based on observed reductions in glycosylated hemoglobin levels from a database of people with diabetes in NHS Scotland.
Conclusions
The evidence suggests there are benefits in using digital platforms to aid self-management among people with diabetes. Studies reporting on glycosylated hemoglobin levels found statistically significant and clinically important benefits from using digital platforms. Digital platforms also have the potential to be more effective and less costly than routine diabetes care in Wales and the UK.
Since the vaccine roll out, research has focused on vaccine safety and efficacy, with large clinical trials confirming that vaccines are generally effective against symptomatic COVID-19 infection. However, breakthrough infections can still occur, and the effectiveness of vaccines against transmission from infected vaccinated people to susceptible contacts is unclear.
Health Technology Wales (HTW) collaborated with the Wales COVID-19 Evidence Centre to identify and examine evidence on the transmission risk of SARS-CoV-2 from vaccinated people to unvaccinated or vaccinated people.
Methods
We conducted a systematic literature search for evidence on vaccinated people exposed to SARS-CoV-2 in any setting. Outcome measures included transmission rate, cycle threshold (Ct) values and viral load. We identified a rapid review by the University of Calgary that was the main source of our outcome data. Nine studies published following the rapid review were also identified and included.
Results
In total, 35 studies were included in this review: one randomized controlled trial (RCT), one post-hoc analysis of an RCT, 13 prospective cohort studies, 16 retrospective cohort studies and four case control studies.
All studies reported a reduction in transmission of the B.1.1.7 (Alpha) variant from partial and fully vaccinated individuals. More recent evidence is uncertain on the effects of vaccination on transmission of the B.1.617.2 (Delta) variant. Overall, vaccine effectiveness in reducing transmission appears to increase with full vaccination, compared with partial vaccination. Most of the direct evidence is limited to transmission in household settings therefore, there is a gap in the evidence on risk of transmission in other settings. One UK study found protection against onward transmission waned within 3 months post second vaccination.
Conclusions
Early findings that focused on the alpha variant, showed a reduction in transmission from vaccinated people. There is limited evidence on the effectiveness of vaccination on transmission of the Delta variant, therefore alternative preventative measures to reduce transmission may still be required.
At various stages of the COVID-19 pandemic, face coverings have been recommended and encouraged as one of the interventions to reduce transmission of the SARS-CoV-2 virus. However, in the earlier stages of the pandemic, decisions on face coverings relied primarily on evidence based on other viral respiratory infections. More direct evidence on the use of face coverings with COVID-19 developed in tandem with the pandemic.
Health Technology Wales undertook an ultra-rapid review to inform national guidelines, the work assessed the evidence on the effectiveness of face coverings to reduce SARS-CoV-2 transmission. We also reviewed evidence on the efficacy of different types of face coverings.
Methods
We conducted a systematic literature search for evidence to address (i) the effectiveness of face coverings to reduce the spread of COVID-19 in the community, and (ii) the efficacy of different types of face coverings designed for use in community settings. We identified a rapid review in 2021 by Public Health England that closely aligned with our review questions. This provided the main source for identifying relevant studies, supplemented by a search for publications following their search date.
Results
We identified two evidence reviews (including the Public Health England review) that examined the effectiveness of face coverings on reducing transmission of SARS-CoV-2; reporting on 31 and 39 studies, respectively. Two further primary studies were published after the two evidence review searches were included. Overall, the evidence suggested that face coverings may provide benefits in preventing SARS-CoV-2 transmission, although the higher-quality studies suggested that these benefits may be modest. Medical masks appeared to have higher efficacy than fabric masks, although the evidence was mixed.
Conclusions
At the time of this review, evidence on the effectiveness of face coverings remains limited and conclusions rely on low-quality sources of evidence with high risk of bias, although higher-quality evidence points to some benefit. Face coverings may play a role in preventing transmission of SARS-CoV-2, particularly as part of a bundle of other preventative measures.
The COVID-19 pandemic has had a dramatic impact on the health and social care landscape, both in terms of service provision and citizen need. Responsive, evidence-based research is essential to develop and implement appropriate policies and practices that manage both the pandemic itself, and the impact COVID-19 has on other health and social care issues.
To address this, the Wales COVID-19 Evidence Centre (WCEC) was launched in 2021 with the aim of providing the best available, up-to-date, and relevant evidence to inform health and care decision making across Wales.
Methods
Funded by the Welsh Government, the WCEC comprises of a core team and several collaborating partner organizations, including Health Technology Wales, Wales Centre for Evidence-Based Care, Specialist Unit for Review Evidence Centre, SAIL Databank, Public Health Wales, Bangor Institute for Health & Medical Research in conjunction with Health and Care Economics Cymru, and the Public Health Wales Observatory. Over the last year, WCEC has developed its rapid review processes and methodology informed by best international practice and aims to provide around 50 reviews each year. WCEC works alongside various stakeholder groups from health and social care across Wales, and they form an integral part of the review process, from scoping to knowledge mobilization.
Results
To date, the WCEC has produced reviews on a diverse range of COVID-19 topics, including transmission, vaccination uptake (barriers, facilitators and interventions), mental health and wellbeing, as well as face coverings and other preventative interventions. The topics have also covered a wide range of populations, from general public, to healthcare workers, to children. These reviews have been used to inform policy and decision-making, including the Welsh Government’s Chief Medical Officer 21-day COVID-19 reviews.
Conclusions
The WCEC has brought together multiple specialist centers with a diverse range of skills to produce timely reviews of the most up-to-date research to support decision makers across health and social care. These reviews have informed policy and decision-making across Wales.
Health Technology Wales (HTW) review guidance 3 years after publication to establish if reassessment is warranted because, for example, new evidence has become available. Since the publication of guidance on flash glucose monitoring (FGM) in 2018, HTW introduced a patient and public involvement (PPI) process with novel approaches to flexible engagement. This enabled HTW to include three streams of patient evidence into the review of FGM devices.
Methods
HTW’s Patient and Public Involvement Standing Group (PPISG) considered appropriate methods of engagement using the HTW Patient and Public Involvement Mechanism Tool. This tool considers the nature of the health technology, the presence of appropriate patient organizations and questions that can be put to patients, as well as other approaches for obtaining patient evidence.
Results
HTW contacted Diabetes Cymru and met with them to discuss contributing to the appraisal of FGM devices. Diabetes Cymru produced a patient submission summarizing the experiences of their patient network, with particular focus on the expansion of the technology to closed-loop insulin systems. Diabetes Cymru later attended HTW’s Appraisal Panel committee and gave a presentation. Additionally, HTW conducted a patient evidence literature review. This review summarized published qualitative studies on a range of perspectives, including carer perspectives, family perspectives, children and adolescences perspectives as well as considerations from specific environments, such as schools, workplaces, homes, care homes and communities. In addition to new clinical and cost effectiveness evidence, this PPI input was used to formulate new guidance recommending more widespread adoption of FGM.
Conclusions
The introduction of flexible approaches to PPI enabled HTW to gain patient evidence from multiple sources. This ensured greater patient representation and a more detailed understanding of the role of FGM devices across different patient communities. This added considerable richness to the patient evidence, which is vital to understand the everyday impacts of FGM and its use amongst patients. Combining flexible PPI with the new clinical and cost effectiveness evidence resulted in a change in the original guidance recommendation.
The course was run online in 2020 and attended by 20 healthcare workers who were invited to join the evaluation. Questionnaires were completed by participants before the training program (baseline), immediately after the training (post), and 3 months following the end of the program (follow-up). After the follow-up questionnaires, participants were invited to join a Focus Group to expand on their responses. Descriptive and exploratory statistical analysis was performed on quantitative data, and qualitative data was subjected to Thematic Analysis.
Results
Exploratory data analysis showed that self-reported competence, confidence, and comfort in providing spiritual care significantly improved following training (p = 0.002) and were maintained over time (p = 0.034). In qualitative analysis, the main themes were: (1) overwhelmed by content; (2) the importance of practical training; (3) spiritual care is for everyone; (4) spiritual care should come from the heart; (5) training needs to be inclusive; and (6) spirituality is culturally specific.