Hostname: page-component-699b5d5946-pj6dz Total loading time: 0 Render date: 2026-02-27T11:38:22.996Z Has data issue: false hasContentIssue false

Barriers to the application of Health Technology Assessment (HTA) results: the case of COVID-19 vaccine deployment in Ghana

Published online by Cambridge University Press:  02 February 2026

Brian Adu Asare*
Affiliation:
Health Technology Assessment Secretariat, Ministry of Health , Ghana SAVING Consortium
Emmanuella Abassah-Konadu
Affiliation:
Health Technology Assessment Secretariat, Ministry of Health , Ghana SAVING Consortium
Sarah Ama Kafui Okine
Affiliation:
Ministry of Health , Ghana SAVING Consortium
Ivy Amankwah
Affiliation:
Health Technology Assessment Secretariat, Ministry of Health , Ghana SAVING Consortium
Desmond Dzidzornu Otoo
Affiliation:
Health Technology Assessment Technical Working Group, Ministry of Health , Ghana
Hannah Asante
Affiliation:
Health Technology Assessment Secretariat, Ministry of Health , Ghana
Saviour Yevutsey
Affiliation:
Health Technology Assessment Secretariat, Ministry of Health , Ghana SAVING Consortium
Maxwell Ayindenaba Dalaba
Affiliation:
University of Health and Allied Sciences , Ghana SAVING Consortium
Mustapha Immurana
Affiliation:
University of Health and Allied Sciences , Ghana SAVING Consortium
Matilda Aberese-Ako
Affiliation:
University of Health and Allied Sciences , Ghana SAVING Consortium
Joycelyn Azeez
Affiliation:
Health Technology Assessment Technical Working Group, Ministry of Health , Ghana SAVING Consortium
Edith Enyonam Gavor
Affiliation:
Public Health Specialist, Ghana SAVING Consortium
Martha Gyansa-Lutterodt
Affiliation:
Ghana College of Pharmacists, Public Health, Ghana SAVING Consortium
Evelyn Ansah
Affiliation:
University of Health and Allied Sciences , Ghana SAVING Consortium
Tuoyo Okorosobo
Affiliation:
SAVING Consortium
Olumide Ogundahunsi
Affiliation:
SAVING Consortium
Abraham Hodgson
Affiliation:
SAVING Consortium
Seth Owusu Agyei
Affiliation:
University of Health and Allied Sciences , Ghana SAVING Consortium
Margaret Gyapong
Affiliation:
University of Health and Allied Sciences , Ghana SAVING Consortium
*
Corresponding author: Brian Adu Asare; Email: basare100@gmail.com
Rights & Permissions [Opens in a new window]

Abstract

Objectives

Health Technology Assessment (HTA) guides healthcare decision-making, while Implementation Research (IR) addresses challenges in operationalizing these decisions. The SAVING (Sustainable Access and Delivery of New Vaccines in Ghana) Consortium aims to enhance health intervention delivery in Ghana, focusing on HTA evidence. This study identifies barriers to the application of HTA-related evidence (cost analysis) in coronavirus disease 2019 (COVID-19) vaccine deployment in Ghana.

Methods

This qualitative exploratory study purposively selected 12 key stakeholders with high interest and power relating to COVID-19 vaccine deployment in Ghana. Through in-depth interviews, seven stakeholders from diverse sectors contributed insights into barriers to the application of HTA-related evidence. Thematic analysis was conducted with narrative reporting supported by direct quotes for substantiation.

Results

Six main barriers were identified: (1) timing and access to HTA reports, (2) technical complexities, (3) relevance of content, (4) political considerations and power dynamics, (5) health system fragmentation, and (6) poor responsiveness of decision-makers to research. Proposed solutions include engaging political decision-makers continuously, simplifying technical reports, aligning report content with policymakers’ needs, reducing political considerations, enhancing capacity building, fostering health system cohesion, and improving responsiveness to research.

Conclusions

HTA is vital for informed healthcare decisions. However, technical complexity, relevance of content, inappropriate timing, and lack of access to HTA reports, among other barriers, prevent the uptake of HTA findings. Continuous and improved engagement between HTA producers and policymakers, along with rapid production of HTA, has the potential to improve the uptake of HTA findings, even during public health emergencies.

Information

Type
Assessment
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2026. Published by Cambridge University Press

Introduction

Health Technology Assessment (HTA) determines value in the introduction, adoption, and use of health technologies in health systems (Reference O’Rourke, Oortwijn and Schuller1;Reference O’Rourke, Oortwijn and Schuller2) and seeks to inform decision-making (3;4). In translating evidence to practice, Implementation Research (IR) seeks to address bottlenecks and approaches for unique settings. IR can provide data to guide optimal roll-out of interventions assessed through HTA (5). Such interventions can be vaccines, medical devices, procedures, diagnostic tests, systems, and healthcare programs (3). The SAVING (Sustainable Access and Delivery of New Vaccines in Ghana) Consortium (6), made up of the University of Health and Allied Sciences as the lead, the Ministry of Health (MOH), the Ghana Food and Drugs Authority (FDA), the Swiss Tropical and Public Health Institute, collaborating with the World Health Organization (WHO) special program for Research and Training in Tropical Diseases (also known as WHO-TDR), and Programme for Appropriate Technology in Health (PATH)/Access and Delivery Partnership (ADP), aims to enhance health intervention delivery in Ghana, focusing on use of HTA and HTA-related evidence.

The health system in Ghana is governed by a central MOH with administrative and policy formulation functions, while service delivery is by the Ghana Health Service (GHS). Ghana’s MOH institutionalized HTA as a tool for decision-making, in response to the 67th World Health Assembly resolution agenda item 15.7 on HTA (7), toward efficiency improvements in resource use. In 2019, Ghana established an HTA multi-agency steering committee (HTA-SC), an HTA multidisciplinary technical working group (HTA-TWG), and a multi-representational secretariat for HTA (HTA-SEC) with clear terms of reference to govern and manage the conduct and uptake of HTA (8). This is further supported by an HTA strategy, outlining the strategic objectives (9), HTA reference case, setting out methodological standards for HTA (10), and the HTA process guideline, defining a priori steps for producing HTAs to ensure transparency and consistency (11). Thus, Ghana intends to use HTA in policy prioritization, selection of health technologies, pricing strategies for health technologies, as well as procurement of pharmaceuticals and other health technologies, including vaccines (9).

HTA is used to assess the safety, effectiveness, costs, and economic implications, as well as ethical, social, legal, and organizational aspects of health technologies (Reference Lampe, Mäkelä and Garrido12;13). WHO and the United Nations Children’s Fund (UNICEF) provide the COVID-19 Vaccine Introduction and deployment Costing tool (CVIC tool) (14;15) (see Supplementary Material 1), for costing coronavirus disease 2019 (COVID-19) vaccine initiatives in countries. This tool was used to cost COVID-19 vaccine deployment in Ghana, addressing the cost dimension of HTA analysis (16;17) (See Supplementary Material 2). The study was based on the government-initiated National Deployment and Vaccination Plan (NDVP) (16) (see Supplementary Material 3), guided by the WHO UNICEF submission and review plan (17). The NDVP is a comprehensive plan by the MOH and GHS, in collaboration with health partners, to protect the population and mitigate the spread of the virus, paving the way for socioeconomic recovery. This included procurement and deployment of COVID-19 vaccines, involving Ghana’s National Immunization Technical Advisory Group (NITAG) and other relevant statutory and regulatory bodies (16).

The CVIC tool aims to guide countries to introduce COVID-19 vaccines into their health systems (18). The tool estimates incremental costs for resource mobilization purposes, including the World Bank’s COVID-19 Fast-Track Loan Facility, and country-level decision-making. It was used to estimate the cost-component of COVID-19 vaccine deployment in Ghana (Reference Nonvignon, Owusu and Asare19) for a target population of 17.5 million. This HTA-related study identified the cost of vaccines accounting for 78–83 percent of total vaccination costs, translating to a cost per fully vaccinated person of $20.9–$26.2, and made recommendations through the HTA system (Reference Nonvignon, Owusu and Asare19;20). Because deployment would cost Ghana about 61–76 percent of the 2021 health sector budget for nonremuneration activities, it was recommended for decision-makers to ensure vaccine cost containment for a sustainable vaccination program. (Supplementary Materials 4 and 5). Before the COVID-19 pandemic, HTA systems in Ghana were established to respond to evidence needs for policymakers, but not under the constraints of public health emergencies like the COVID-19 pandemic. Uptake of HTA recommendations could be seamless, but not always straightforward (Reference Kolasa, Schubert, Manca and Hermanowski21). In an HTA conducted in 2020 for hypertension management (Reference Gad, Lord and Chalkidou22), the National Medicines Selection Committee (NMSC), integrated the HTA recommendations into Standard Treatment Guidelines, 7th edition 2017 (23), and Essential Medicines List, 7th edition, 2017 (24), with the National Health Insurance Authority (NHIA) updating the National Health Insurance Medicines List (25). Other HTAs in Ghana have been applied satisfactorily, but not in a public health emergency or pandemic setting such as COVID-19. It appeared that integrating insights from the HTA-related analyses on COVID-19 vaccines encountered some barriers, leading to suboptimal application. Also, when the COVID-19 pandemic emerged, Ghana’s HTA system faced the challenge of rapidly responding to the need for timely, relevant, and accessible HTA findings to guide vaccine procurement and deployment decisions, exposing gaps in the existing framework. This study explores the barriers affecting the application of HTA-related evidence on COVID-19 vaccine deployment in Ghana. It seeks to contribute insights on HTA utilization in health policy and practice, particularly during public health crises in Ghana or other similar contexts.

Methods

Study design

This study explored the barriers to the application of HTA recommendations in Ghana’s COVID-19 vaccine deployment during a public health emergency. The qualitative approach sought to provide rich insights into this potentially complex and multifaceted issue.

Sampling

This study adopted non-probability sampling to choose an appropriate purposive sample (Reference Vasileiou, Barnett, Thorpe and Young26) drawn from a stakeholder analysis. It identified twelve stakeholders, with high interest and high power concerning COVID-19 vaccine deployment, as initial participants, including the MOH, HTA SC, HTA TWG, HTA-SEC, Expanded Programme of Immunization, Presidential Advisory Committee on COVID-19, National Technical Coordination Committee for COVID-19, NITAG, Drug Policy Unit (DPU), NMSC, NHIA, and the FDA, represented by professionals, policy decision-makers, and researchers involved in the generation of evidence, procurement, supply, and deployment of vaccines in Ghana. A snowballing technique was considered to reach any other relevant stakeholder(s). The following stakeholders were included: participants from the Procurement and Supply Directorate of the MOH (PS-MOH), the Policy Planning Monitoring and Evaluation Directorate of the MOH (PPME-MOH), and the Ministry of Finance (MOF). Seven interviews were conducted, using an interview guide with participant consent form (see Supplementary Material 6), with representatives from the DPU, NMSC, the HTA-SEC, HTA-TWG, the PS-MOH, HTA-SC/PPME-MOH, and MOF (see Supplementary Material 7 for Supplementary Table S1: Stakeholder groups and their roles).

Data collection technique and tools

The interview guide was developed based on a review of the literature on challenges and the application of HTA results (Reference Kemparaj and Chavan27). Although some stakeholders were hesitant to participate due to the sensitive nature of the subject, the challenge was overcome through continuous emphasis on the anonymity of data and participant identity. In-depth interviews were conducted using open-ended questions, administered by trained researchers, ensuring privacy and lasting about 45 minutes. These were audio-recorded with participant consent, transcribed verbatim, and cross-checked for accuracy within the research team to facilitate thorough data analysis. The transcriptions were captured in Microsoft Word and imported into NVivo 14 (28) for coding and analysis.

Data analysis

The qualitative analysis was done thematically and involved a multistep process of data familiarization through reading and re-reading the transcripts, initial coding, categorization leading to theme development, and iterative review for alignment with research goals (Reference Braun and Clarke29). This led to a synthesized narrative, with validity and credibility enhanced through peer debriefing sessions. To ensure anonymity, the positions of the participants under the quotes have been listed under three-character identifiers.

Results

The study found several barriers to the application of HTA results during the deployment of COVID-19 vaccines in Ghana. One major barrier was the timeliness and accessibility to reports. Delays in evidence generation meant that by the time evidence was available, it was no longer applicable. Other barriers include the relevance of content, where there was a perception of a disconnect between findings and the immediate needs of the pandemic. Also, it was noted that the report was technical and complex, making it difficult for non-experts in the HTA subject to understand and use for decision-making. Political considerations and power dynamics with political decisions often outweighing scientific recommendations, health system fragmentation with different sectors and departments operating in silos, and low responsiveness to research findings due to affordability, were further barriers identified in the study.

Figure 1 presents the resulting thematic map.

Figure 1. Thematic map: barriers to application of HTA results.

Timeliness and access to HTA reports

Study participants highlighted that untimely release and limited accessibility to the HTA report impeded its use in decision-making for COVID-19 vaccine procurement in Ghana, especially under the urgency and rapidly evolving context of a public health emergency. Timely release would offer adequate opportunity for comprehension of the evidence and perusal of the cost analyses and their recommendations before subsequent use. Some quotes from participants are captured below:

“… So, the timing of the result coming out and the timing of the decision on vaccines is also another issue. As to whether the report came out timely enough for decision-makers to be able to use it in that thing is something we really have to look at critically”. (HHS)

“One, the timing, but COVID didn’t give anybody any time to do things at the pace that one would have wanted to. It was like the country was running ahead of the recommendations so before we could say ‘jack’ serious decisions have been taken outside the recommendations”. (HHT)

A participant added that access to the report was a problem because the report was not widely disseminated. It was added that a report that cannot be accessed cannot be used or implemented.

“So, if the key decision-makers who are the key stakeholders do not have access to the reports… it cannot be used.” (MST)

It was revealed that even though the report was submitted to the Information Technology department for dissemination through the MOH website, there was uncertainty about the actual publication. This would affect access to the report for implementation.

“It’s a good question. I think we shared with the IT department for them to upload to the ministry website but to be frank I think I have to check whether they actually have” (HHS)

Technicality and complexity of reports

Participants highlighted that the technical density of HTA reports made it challenging for non-technical stakeholders and policymakers to understand, hindering its adoption and implementation. It was widely reported that while the report (shared through a dissemination workshop) contained rigorous data analysis, the language used was complex, with advanced economic analysis. Some participants noted that they were able to understand the material only due to their experience and familiarity with the report.

“The third one, it will be the ability for the decision-maker to understand what is in that report”(HHS)

“But for me, being able to use it at my level and the factors that enhance it, I think it’s because I understand the material and I know what is in it.” (HHS)

Relevance of content of the report to decision-making

Participants highlighted a mismatch between the content of the report and the decisions to be made. The government was interested in evidence to select the most effective vaccine; however, the evidence provided was mainly on the cost of deployment, posing a barrier to the application of findings. Some participants noted other factors beyond cost, which are important in vaccine procurement, such as human resources, usage, and benefits.

“Secondly the content; what actually the report is speaking to. It’s because if I need evidence to be able to select the vaccines and you give me evidence to be able to deploy the vaccines, you are not answering my questions you see.

My opinion is that we may recommend evidence, but the evidence becomes just one of the factors that may be considered in prioritization and may be other more complex issues will also be considered in prioritizing a particular action.” (HHS)

“… I even like the report about being able to estimate the human resource that will need to apply to this. So, in terms of what they did, one, the cost is also a condition but for me what supersedes the price is about the usage, the benefit.” (HDP)

Additionally, some participants indicated that regional and international entities were involved in decision-making. The African Union provided pooled procurement mechanisms for vaccines to countries, which were not covered in the report:

“There were other things that people don’t even want to look at, which the report also didn’t look at. We were doing what we call pool procurement. So, the African Union was also helping countries to choose based on not too much information at the time COVID came and we didn’t have any background data to back, you know. So, remember, there were other mechanisms and other forces at play that were even beyond the country.” (HHT)

Political considerations and power dynamics

Participants mentioned that although studies were conducted and reports were generated by technical officers, final implementation decisions were usually made by politically inclined decision-makers. It was therefore difficult to determine the actual factors informing decisions beyond the recommendations of the report.

“There were other political factors that were beyond the technical work that we did…in my opinion, politicians needed to prove to the masses that they cared about them so they couldn’t wait for the recommendations.” (HHT)

“One, political influence in the sourcing. Two, who will be supplying. Because when it comes to the vaccine, it’s one of the essential commodities. So, the political influence, technical we advise the political that for this particular vaccine these are the manufacturers, these are the source, but they make the approval.” (HDP)

Participants added that as part of political considerations on evidence-informed decision-making, different interests and power dynamics created more complexities, such as the selective use of HTA results. Side-lining scientific evidence not in line with the interests of influential actors leads to inconsistencies in implementation, complicating evidence-adoption with negotiations, lobbying, and power struggles among key actors and stakeholders.

“Yes! So, I think there could be interest and there could be power dynamics as well. So, when the interest is in a particular course of action than what the report seems to suggest and then there is also power to fuel or implement that interest; then you realize that, that combination of interest and power when is contrary to what evidence is saying will have his way” (HHS)

“Of course, there are complexities between actors and interests and all those things are very complex, but I think if I add, it’s the complexity of the actor that was a hindrance” (HHS)

A participant added that the absence of a legal framework to support the implementation of key health evidence leaves room for the use of power in arbitrary decision-making, irrespective of available evidence.

“But the absence of any legal enforcement or legal backing for the work to be done, then people will be at liberty to do whatever they want. Politically, they can.” (HDS)

Health system fragmentation in decision-making

Participants highlighted that despite a well-structured health system in Ghana, fragmentation in coordination, communication, and resource allocation impeded the dissemination of HTA evidence across various levels during the COVID-19 pandemic. Decision-making by MOH primarily targeted the GHS, neglecting other agencies like teaching hospitals, leading to challenges in onboarding HTA recommendations by other stakeholders. Participants pointed out that the system was highly compartmentalized, with different agencies, departments, and sectors working in isolation.

“We will take a decision, where will the decision come from and who will implement it. The ministry will take a decision and only involve GHS and forget the teaching hospitals. One of the things that I saw during the COVID was that all communications were directed to GHS, and I was asking myself ‘is it only GHS which is treating the COVID patients?’” (HDP)

“So that is very important in their buy-in. If you don’t get their buy-in, implementation becomes difficult. If you have given to GHS, then they are sitting there unconcerned…” (HDP)

To better understand the barriers related to health system fragmentation, a schematic representation of Ghana’s healthcare system is presented in Figure 2 below.

Figure 2. Ministry of Health organizational structure.

The MOH frames policy and heath sector agenda, while GHS implements healthcare delivery policy with other agencies, including the teaching hospitals, regulatory authorities, and health financing authorities, implementing a specific health-sector agenda. During the COVID-19 pandemic, fragmentation in coordination and communication among these entities led to suboptimal implementation of HTA findings.

Responsiveness to research findings due to affordability

Participants identified poor responsiveness to research findings due to the affordability of interventions by decision-makers as a barrier to the effective implementation of HTA reports.

“The recommendations though are efficient recommendations we just couldn’t afford that option … maybe some other factors you see, so recommendations could be good but then it is also possible we are not in the position to just afford it.” (HHS)

Overall synthesis of themes

Figure 3 demonstrates the connections between identified themes. On one hand, challenges relating to the production of HTA reports included being delayed and inaccessible, technically complex with irrelevant content, which are difficult to interpret and apply. These challenges compound limited responsiveness to findings due to affordability constraints. On the other hand, the decision-making environment (structures and functions) is also influenced by political considerations and power dynamics, as different interests and competing priorities often create siloed and fragmented health system operations, hindering responsiveness to evidence. These two broad issues undermine the decision-maker’s application of HTA results and are critical determinants of the implementation of HTA recommendations in the specific context studied.

Figure 3. Relationships between identified themes from the thematic analysis.

Discussion

The uptake of HTA recommendations has been found to vary, influenced by a range of level-specific factors, including socio-political, organizational, and professional dynamics (Reference Kolasa, Schubert, Manca and Hermanowski21;Reference Gagnon, Sánchez and Pons30). These factors refer to phenomena at various strategic and operational levels of health system organization, which affect the uptake of HTA findings. At the socio-political level, the organization and funding of healthcare systems impact the uptake of HTA recommendations. At the level of healthcare institutions, formal organizational structures as well as pre-existing partnerships with HTA bodies facilitate the uptake. For healthcare professionals, the considerable independence of specialists, the significance of peer influence and collective oversight, as well as the clarity of professional obligations, all contribute to the adoption of HTA recommendations into clinical practice (Reference Gagnon, Sánchez and Pons30). Variability in the uptake of HTA findings into national drug reimbursement decisions has also been documented (Reference Kolasa, Schubert, Manca and Hermanowski21). The six barriers identified in this study are not only rooted in socio-political aspects of healthcare organization and funding, but also in HTA process-related issues (see Figure 3).

The first barrier identified by stakeholders – timing of report release – has been identified as an important factor for the uptake of HTA findings by other authors; though in a hospital-level HTA system, with a 2- to 4-month timing projected as ideal (Reference McGregor and Brophy31). Timing was particularly challenging, considering the national rather than hospital-level context in the Ghana case. Ghana developed a national HTA process guideline recommending 37 weeks (9.25 months) to 77 weeks (19.25 months) for a full HTA and 6 weeks (1.5 months) to 18 weeks (4.5 months) for a rapid HTA, respectively, in an attempt to responsively meet evidence needs for policy decision-making (11). Timely access to high-quality, relevant research findings, as well as partnerships, relationship- and skill-building with policymakers, are identified as essentials for evidence use (Reference Oliver, Innvar, Lorenc, Woodman and Thomas32;Reference Kostyuk, Akanov and Nurgozhin33) with appropriate timing, promoting uptake of recommendations (Reference Dams, Gonzalez Rodriguez, Cheung, Wijnen and Hiligsmann34). Furthermore, limited access affected effective use, highlighting the importance of timely, accessible communication of HTA results to ensure they can inform decision-making processes. It could be argued that a flexible and iterative decision-making process, open to mid-implementation changes, can adapt to evolving evidence, ensuring responsiveness in rapidly changing situations like a pandemic.

Participants highlighted challenges for non-technical decision-makers and implementers to understand the HTA report (due to technical density), impeding uptake. This emphasizes the breakdown of HTA reports into easily understandable messages for a wide range of stakeholders. This is consistent with studies (Reference Henshall, Koch and von Below35), which identified the complex and technical format of HTA reports to hinder uptake. Inadequate presentation format has been listed among the five most important barriers to the uptake of HTA reports in the Netherlands (Reference Cheung, Evers, de Vries and Hiligsmann36). Capacity building for users of HTA reports can improve understanding and use in decision-making. This includes monitoring and evaluation of the evidence-to-decision process to assess impact.

Participants noted a barrier due to a mismatch between report content and decision-maker needs. This mismatch aligns with the concept of “relevance” in evidence-informed policymaking (Reference Oliver, Innvar, Lorenc, Woodman and Thomas32), which promotes research evidence to be aligned with the policy issue at hand. Various factors, including the lack of involvement of decision-makers in the research process, account for this mismatch. Another study (Reference Cheung, Evers and De Vries37) highlighted the availability of relevant-HTA research as an essential catalyst in the use of HTA findings, indicating the need to involve decision-makers in the HTA process, align HTA questions with policy needs, among others, as strategies to enhance “relevance.”

Participants noted that the final decisions were largely driven by political considerations through political actors. With the absence of a legal framework on the use of HTA evidence, political actors may express decision-making power considering other factors, potentially neglecting scientific evidence. Non-scientific evidence is reported to play a role in decision-making across various sectors, often overshadowing scientific evidence (Reference Lorenc, Tyner and Petticrew38). In public health decision-making, the role of scientific data and distinguishing between reality and methodological assumptions (Reference Samuels39) is complex, often hindered by decision-makers’ perceptions and practical constraints (Reference Orton, Lloyd-Williams, Taylor-Robinson, O’Flaherty and Capewell40). The COVID-19 pandemic exposed these limitations of evidence-based decision-making in informing consistent policies across different contexts (Reference Rubin, Errett, Upshur and Baekkeskov41). This was particularly evident in the initial response to health crises, where evidence-based decision-making may not always yield optimal policies (Reference Rubin, Errett, Upshur and Baekkeskov41). In some settings, urgency and precaution were the government’s primary considerations (Reference Askim and Christensen42). The influence of political considerations and power dynamics on the application of HTA results is consistent with Lukes’ three-dimensional model of power (Reference Lukes43), which indicates the exercise of power in three ways: decision-making power, nondecision-making power, and ideological power. This study reveals that political actors wield decision-making and agenda-setting power in vaccine policies, but have little influence over stakeholder perceptions, underscoring the need for stakeholder engagement to effectively bridge the gap between scientific evidence and political decision-making. The MOH has policy processes that promote evidence-based rather than eminence-based approaches (Reference Isaacs and Fitzgerald44). These processes are supposed to protect decision-making from overt influences.

Participants noted that although several health and nonhealth agencies were working to contain the pandemic, most decisions taken by the MOH were toward the GHS, neglecting other agencies. Ghana’s health system is well structured with aligned levels of decision-making, yet participants report fragmentations in coordination, communication, and resource allocation under pandemic emergencies, which could have led to distortions in decision-making on HTA recommendations. The reported fragmentation in this study aligns with the health system strengthening framework by the WHO (45). This framework indicates that a well-functioning health system hinges on robust service delivery, an efficient health workforce, a responsive health information system, access to essential medical technologies, sound financing, and effective leadership. The reported fragmentation, particularly in service delivery, workforce, and governance, underscores the necessity for an integrated approach involving all stakeholders in decision-making despite the effect of public health emergencies to promote the use of HTA findings.

Participants noted that research findings not adequately acknowledged, acted upon, or integrated into decision-making can lead to negative outcomes. The study discovered that decision-makers’ inadequate response to the dissemination of the HTA report could be potentially due to the urgency of decision-making, a finding consistent with the concept of “research utilization” in health policy (Reference Lavis, Robertson, Woodside, CB and Abelson46). Effective communication and integration of research findings into decision-making processes are often hindered by research complexity, lack of relevance to decision-making needs, decision-makers’ limited capacity to understand and utilize research, and the perceived unaffordability of recommendations.

The barriers identified are similar to those reported by other authors in pandemic evidence-informed decision-making, including rapidly evolving evidence, concerns about scientific integrity, limited capacity for evidence assessment, the need for quick decision-making under uncertainty, and a lack of transparency in decision application (Reference Vickery, Atkinson and Lin47). In Europe, some barriers to HTA usage included limited generalizability, non-availability of relevant HTA research, lack of consensus between HTA findings, insufficient quality of findings, and lack of access to relevant HTA research (Reference Cheung, Evers and De Vries37). In other Sub-Saharan Africa countries, very little use of HTA evidence has been reported due to poor coordination and disconnect from policy (Reference Hollingworth, Fenny, Yu, Ruiz and Chalkidou48). In South Africa, a study on challenges to implementing HTA reported: limited political support, local capacity, awareness of HTA, and poor data as barriers (Reference Mueller49). The results in all these studies resonate with the findings of this current study. Effective policy reform requires both an understanding of political dynamics and the use of critical technical analysis, as neglecting either can lead to ineffective application of research by technical actors or unattained policy objectives by political actors (Reference Agyepong and Adjei50). The effective application of HTA in this public health emergency in Ghana faced multiple barriers, and addressing these through strategies like continuous stakeholder and political engagement, capacity building, health system integration, and adaptive decision-making processes is key to translating HTA results into policy and practice.

Conclusion

The findings of this study provide an understanding of the barriers to the application of HTA results in Ghana, particularly in the context of the COVID-19 pandemic. Key barriers to the uptake of HTA findings included: inappropriate timing and lack of access to HTA reports; technicality and complexity of content; relevance of content; political considerations and power dynamics; health system fragmentation; and responsiveness to findings due to affordability. Continuous and improved stakeholder engagement (between HTA producers and policymakers) along the HTA production process has the potential to improve uptake of findings, even during public health emergencies.

Supplementary Table S2 highlights the key findings and recommendations (Supplementary Material 8).

Supplementary material

The supplementary material for this article can be found at http://doi.org/10.1017/S0266462325100342.

Data availability statement

All data generated or analyzed during this study will be included in the published article. Where the sources are articles or documents, these would be cited, and references provided to the source articles.

Acknowledgments

This study was made possible through funding from the European and Developing Countries Clinical Trials Partnership (EDCTP), through the SAVING Consortium. The Access and Delivery Partnership (ADP) is acknowledged for the various roles it has played in this study. The authors would also like to thank the study participants for their participation in providing vital information.

Author contribution

MG, EA, AH, TO, OO, and SOA provided leadership and guided the design of the study. HA, IA, EA, BA, SAKO, and EG collected data for the study. BAA prepared the initial draft of the manuscript. DDO, HA, SKY, MAD, MI, and MA reviewed the draft manuscript, providing inputs and perspectives. SKY, JA, and ML provided policy perspectives to the analysis. BA, EA, SKY, IA, and DDO edited the manuscript. All authors reviewed the manuscript.

Funding statement

The conduct of this study has been made possible through funding from the EDCTP project Grant number CSA2018HS-2528, implemented by the SAVING Consortium in Ghana.

Competing interest

The authors declare none.

Ethics approval and consent to participate

The study was approved by the Ghana Health Service Ethical Review Committee (GHS-ERC 003/05/22) and the Ethical Review Committee of the University of Health and Allied Sciences (UHAS-REC A.9[1] 21-22). All participants provided informed consent before participating in the study. Participants were assured of their right to withdraw from the study at any time without any negative consequences. Confidentiality was maintained by anonymizing the data and storing it securely.

Limitations

Due to the sensitivity of the subject matter, there were several constraints in securing interviews with all key informants identified in the stakeholder analysis.

References

O’Rourke, B, Oortwijn, W, Schuller, T, Group the IJT. The new definition of health technology assessment: a milestone in international collaboration. Int J Technol Assess Health Care. 2020;36(3):187190. Available from: https://www.cambridge.org/core/journals/international-journal-of-technology-assessment-in-health-care/article/new-definition-of-health-technology-assessment-a-milestone-in-international-collaboration/8A3BA65D279F3FDAA83ADB3D08CF8C17.Google Scholar
O’Rourke, B, Oortwijn, W, Schuller, T. Announcing the new definition of health technology assessment. Value Health. 2020;23(6):824825.Google Scholar
INAHTA. HTA definition. [Internet]. INAHTA Website; Canada, 2016. Available from: http://www.inahta.net/.Google Scholar
WHO. WHO webpage on HTA. WHO - Health Technology Assessment; Geneva, 2022. Available from: https://www.who.int/teams/health-product-policy-and-standards/assistive-and-medical-technology/medical-devices/assessment.Google Scholar
WHO TDR. Implementation Research Toolkit - Workbook. 2014.Google Scholar
Savings Consortium [Internet]. [cited 2025 Feb 12]. Available from: https://savingconsortium.org/.Google Scholar
WHA. Ghana’s statement at the 67th world health assembly. In Geneva: WHO; 2014. Available from: who.int.Google Scholar
Ghana Ministry of Health. Terms of reference and meeting norms for the Ghana HTA governance structures. 1st ed. MOH, editor Accra: MOH; 2019.Google Scholar
Ghana HTA TWG. Ghana strategy for health technology assessments. Ghana Ministry of Health; 2020.Google Scholar
Ghana Ministry of Health. The HTA reference case for Ghana. Accra: Ghana 2023.Google Scholar
Ghana Ministry of Health. Ghana HTA process guideline. 1st ed. Accra: Ghana 2022.Google Scholar
Lampe, K, Mäkelä, M, Garrido, MV, et al. The HTA Core model: a novel method for producing and reporting health technology assessments. Int J Technol Assess Health Care. 2009;25(S2):920.Google Scholar
EUnetHTA. HTA Core Model - EUnetHTA Joint Action 2, Work Package 8 [Internet]. EUnetHTA, 2016 [cited 2022 Oct 13]. (version 3.0). Available from: http://www.htacoremodel.info/BrowseModel.aspxGoogle Scholar
WHO, UNICEF. Vaccine Introduction and deployment Costing (CVIC) costing tool. 2020.Google Scholar
WHO, UNICEF. Vaccine Introduction and deployment Costing (CVIC) costing tool. 2022.Google Scholar
Ministry of Health. COVID-19 vaccine deployment and vaccination plan. Accra; 2021.Google Scholar
WHO. COVID-19 national deployment and vaccination plan: submission and review process, WHO Geneva, 29 January 2021 [Internet]. [cited 2025 Jan 12]. Available from: https://iris.who.int/bitstream/handle/10665/339154/WHO-2019-nCoV-NDVP-country_plans-2021.1-eng.pdf?sequence=1Google Scholar
COVAX World Health Organization. COVID-19 vaccine introduction and deployment costing tool (CVIC tool). Geneva: WHO; 2022.Google Scholar
Nonvignon, J, Owusu, R, Asare, B, et al. Estimating the cost of COVID-19 vaccine deployment and introduction in Ghana using the CVIC tool. Vaccine. 40(12):18791887. Available from: http://www.ncbi.nlm.nih.gov/pubmed/35190206.Google Scholar
Ghana HTA TWG, MOH. Cost analysis of COVID-19 vaccine introduction and deployment in Ghana. Accra; 2021.Google Scholar
Kolasa, K, Schubert, S, Manca, A, Hermanowski, T. A review of health technology assessment (HTA) recommendations for drug therapies issued between 2007 and 2009 and their impact on policymaking processes in Poland. Health Policy (New York). 2011;102(2–3):145151.Google Scholar
Gad, M, Lord, J, Chalkidou, K, et al. Supporting the development of evidence-informed policy options: an economic evaluation of hypertension Management in Ghana. Value Health. 2020;23(2):171179.Google Scholar
Ghana Ministry of Health. Standard treatment guidelines. 7th ed. MOH, editor Accra: MOH; 2017.Google Scholar
Ghana Ministry of Health. Essential medicines list. 7th ed. Accra: MOH; 2017.Google Scholar
National Health Insurance Authority. National Health Insurance Medicines List [Internet]. 2023 [cited 2015 Aug 10]. Available from: http://www.nhis.gov.gh/MedList.aspxGoogle Scholar
Vasileiou, K, Barnett, J, Thorpe, S, Young, T. Characterising and justifying sample size sufficiency in interview-based studies: systematic analysis of qualitative health research over a 15-year period. BMC Med Res Methodol. 2018;18(1):148.Google Scholar
Kemparaj, U, Chavan, S. Qualitative research: a brief description. Indian J Med Sci. 2013;67(3):89.Google Scholar
QSR International Pty Ltd. NVivo 14 [Internet]. 2020 [cited 2023 Jul 25]. Available from: https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home.Google Scholar
Braun, V, Clarke, V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77101.Google Scholar
Gagnon, MP, Sánchez, E, Pons, JM. Integration of health technology assessment recommendations into organizational and clinical practice: a case study in Catalonia. Int J Technol Assess Health Care. 2006;22(2):169176.Google Scholar
McGregor, M, Brophy, JM. End-user involvement in health technology assessment (HTA) development: a way to increase impact. Int J Technol Assess Health Care. 2005;21(2):263267.Google Scholar
Oliver, K, Innvar, S, Lorenc, T, Woodman, J, Thomas, J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14(1):112.Google Scholar
Kostyuk, A, Akanov, A, Nurgozhin, T. A barriers to and facilitators of the use of HTA reports by policymakers in Kazakhstan. Value Health. 2016;19(7):A833.Google Scholar
Dams, F, Gonzalez Rodriguez, JL, Cheung, KL, Wijnen, BFM, Hiligsmann, M. Relevance of barriers and facilitators in the use of health technology assessment in Colombia. J Med Econ. 2018;21(5):510517.Google Scholar
Henshall, C, Koch, P, von Below, GC, et al. Health technology assessment in policy and practice. Int J Technol Assess Health Care. 2002;18(2):447455.Google Scholar
Cheung, KL, Evers, SMAA, de Vries, H, Hiligsmann, M. The most important barriers and facilitators to the use of HTA by policy makers. The European health psychologist. 2016;18:477. Available from: https://api.semanticscholar.org/CorpusID:79118142.Google Scholar
Cheung, KL, Evers, S, De Vries, H, et al. Most important barriers and facilitators of HTA usage in decision-making in Europe. Expert Rev Pharmacoecon Outcomes Res. 2018;18(3):297304.Google Scholar
Lorenc, T, Tyner, E, Petticrew, M, et al. PP71 cultures of evidence among decision-makers in non-health fields: systematic review of qualitative evidence. J Epidemiol Community Health (1978). 2013 Sep 10;67(Suppl 1): A76.3–A77.Google Scholar
Samuels, SW. Role of scientific data in health decisions. Environ Health Perspect. 1979;32:301307.Google Scholar
Orton, L, Lloyd-Williams, F, Taylor-Robinson, D, O’Flaherty, M, Capewell, S. The use of research evidence in public health decision making processes. Systematic Review PLoS One. 2011;6(7):e21704.Google Scholar
Rubin, O, Errett, NA, Upshur, R, Baekkeskov, E. The challenges facing evidence-based decision making in the initial response to COVID-19. Scand J Public Health [Internet]. 2021;49(7):790796. Available from: https://doi.org/10.1177/1403494821997227.Google Scholar
Askim, J, Christensen, T. Crisis decision-making inside the core executive: rationality, bureaucratic politics, standard procedures and the COVID-19 lockdown. Public Policy Adm. 2022;095207672211296.Google Scholar
Lukes, S. Power: A radical view. 2nd ed, Palgrave: Macmillan; 2005.Google Scholar
Isaacs, D, Fitzgerald, D. Seven alternatives to evidence based medicine. BMJ. 1999;319(7225):16181618.Google Scholar
WHO. Everybody’s business -- strengthening health systems to improve health outcomes: WHO’S framework for action [internet]. Geneva: World Health Organization; 2007. Available from: https://apps.who.int/iris/handle/10665/43918.Google Scholar
Lavis, JN, Robertson, D, Woodside, JM, CB, McLeod, Abelson, J. How can research organizations more effectively transfer research knowledge to decision makers? Milbank Q [Internet]. 2003 [cited 2023 Jul 23];81(2):221. Available from: /pmc/articles/PMC2690219/.Google Scholar
Vickery, J, Atkinson, P, Lin, L, et al. Challenges to evidence-informed decision-making in the context of pandemics: qualitative study of COVID-19 policy advisor perspectives. BMJ Glob Health. 2022;7(4):e008268.Google Scholar
Hollingworth, S, Fenny, AP, Yu, SY, Ruiz, F, Chalkidou, K. Health technology assessment in sub-Saharan Africa: a descriptive analysis and narrative synthesis. Cost Effectiveness and Resource Allocation. 2021;19(1):39.Google Scholar
Mueller, D. Addressing the challenges of implementing a health technology assessment policy framework in South Africa. Int J Technol Assess Health Care. 2020;36(4):453458.Google Scholar
Agyepong, IA, Adjei, S. Public social policy development and implementation: a case study of the Ghana National Health Insurance scheme. Health Policy Plan. 2007;23(2):150160.Google Scholar
Figure 0

Figure 1. Thematic map: barriers to application of HTA results.

Figure 1

Figure 2. Ministry of Health organizational structure.

Figure 2

Figure 3. Relationships between identified themes from the thematic analysis.

Supplementary material: File

Asare et al. supplementary material

Asare et al. supplementary material
Download Asare et al. supplementary material(File)
File 20.2 MB