Objectives: The study aims to develop an understanding of the views of children and adolescents, parents, and professionals on upper limb prosthetic devices to develop and improve device design. Previous research has found that children are dissatisfied with prostheses but has relied heavily on parent proxy reports and quantitative measures (such as questionnaires) to explore their views.

Methods: Thirty-four participants (eight children aged 8–15 years with upper limb difference, nine parents, eight prosthetists, and nine occupational therapists) contributed to the development of new devices through the BRIDGE methodology of participatory design, using focus groups and interviews.

Results: The study identified areas for improving prostheses from the perspective of children and adolescents, developed prototypes based on these and gained feedback on the prototypes from the children and other stakeholders (parents and professionals) of paediatric upper limb prostheses. Future device development needs to focus on ease of use, versatility, appearance, and safety.

Conclusions: This study has demonstrated that children and adolescents can and should be involved as equal partners in the development of daily living equipment and that rapid prototyping (three-dimensional printing or additive manufacturing), used within a participatory design framework, can be a useful tool for facilitating this.

Objectives: The INTEGRATE-HTA project provided methodology to evaluate complex technologies. This study provides guidance on how to retrieve and critically appraise available evidence on moderators and predictors of treatment effects and on patient preferences for treatment outcomes as a source of complexity.

Methods: Search filters for PubMed were developed by hand-searching a large volume of articles reporting on relevant aspects. Search terms were retrieved from selected papers and algorithmically combined to find the optimal combination of search terms. For the development of the appraisal checklists literature was searched in PubMed and Google Scholar together with citation chasing. For the CHecklist for the Appraisal of Moderators and Predictors (CHAMP) a Delphi procedure was used to value a set of eligible appraisal criteria retrieved from the literature.

Results: Search filters were developed optimized for different accuracy measures. The final version of CHAMP consists of a seventeen questions covering the design, analysis, results and transferability of results of moderator and predictor analysis. The final checklist for appraisal of literature on patient preferences for treatment outcomes consist of six questions meant to help the user to identify relevant quality issues together with a guidance toward existing tools concerning the appraisal of specific preference elicitation methods.

Conclusions: Incorporating knowledge on subgroups for whom a specific treatment will produce more benefit holds the promise of better targeting and, ultimately, enhancing overall effectiveness and efficiency of healthcare technology. Finally, incorporating information on preferences for treatment outcomes will foster health technology assessment that addresses outcomes that are important to patients.

Objectives: This study aims to describe how a negative reimbursement decision—based on the health technology assessment (HTA) report of a nondrug intervention—affects healthcare providers in Germany.

Methods: Knee arthroscopy was chosen as an example, because as of April 2016 this procedure is no longer reimbursed for osteoarthritis, but is still covered for other indications, including meniscal lesions. The exclusion followed an HTA report prepared by the Institute for Quality and Efficiency in Health Care (IQWiG). Here, we examine how the decision to revoke reimbursement for arthroscopy was perceived by the surgical community. Information was collected from official hospital statistics, the internet, and informal interviews with orthopedic surgeons.

Results: In 2015, a total of 37,920 arthroscopic procedures were performed for knee osteoarthritis in Germany. Several surgical societies were unhappy with the negative decision, which was issued as a directive in November 2015, and they challenged the decision-making process as well as the underlying scientific evidence. In March 2016, fifteen societies issued joint recommendations on how to differentiate osteoarthritis from other knee diseases and how to document other diseases in a way that inspections by representatives of health insurance funds would not detect any deficiencies. In informal interviews, orthopedic surgeons indicated that miscoding of the principal diagnosis (meniscal tear rather than knee osteoarthritis) is to be expected, especially in the hospital sector.

Conclusions: HTA can have a significant impact on the provision of health services, but various loopholes allow physicians to undermine policy decisions. Therefore, it is important to involve all stakeholders in HTA and to convince them of the benefits of evidence-based medicine.

Objectives: The aim of our study was to describe approaches to health technology assessment (HTA) for medicines in the Slovak healthcare system and the related decision-making processes concerning reimbursement for medicines.

Methods: Analysis of the Slovak legislative framework related to HTA and the reimbursement process for medicines was performed. Additionally, current practices of the Working Group for Pharmacoeconomics, Clinical Outcomes and Health Technology Assessment of the Slovak Ministry of Health were evaluated.

Results: In Slovakia, there is always at least one treatment available in each determined therapeutic class with no co-payment. HTA is becoming an established method for the evaluation of cost-effectiveness of medicines in Slovak healthcare policy. The majority of decision makers within Slovakia support the idea of increased use of and the quality and efficiency of HTA methods. However, it is crucial to overcome several practical barriers to facilitate progress in the field of HTA in the Slovak Republic.

Conclusions: It can be seen that participation within the European Network for Health Technology Assessment (EUnetHTA JA 2 and EUnetHTA JA 3 projects) has significantly improved the quality of the process of HTA in Slovakia. Further legislative activities in this field are required due to the approved strategy for European Union cooperation on HTA.

Objectives: Patient production losses occur when individuals’ capacities to work, whether paid or unpaid, are impaired by illness, treatment, disability, or death. There is controversy about whether and how to include patient production losses in economic evaluations in health care. Patient production losses have not previously been considered when evaluating medications for reimbursement under the U.K. National Health Service. Proposals for value-based assessment of health technologies in the United Kingdom created renewed interest in whether and how to include costs from a wider societal perspective, such as patient production losses, within economic evaluation of healthcare interventions.

Methods: A narrative review was undertaken of theoretical, ethical, and policy issues that might inform decisions that involve the normative question of whether or not to include patient production losses in economic evaluation.

Results: It seems difficult to reconcile the implications of including patient production losses with the objectives of a healthcare system dedicated to providing universal healthcare coverage without regard to patients’ ability to pay.

Conclusions: Tax payer funded healthcare systems may legitimately adopt maximands other than health gain, but these will be at the opportunity cost of less than maximum health gains.

Objectives: Exoskeletons are electromechanical devices that are worn by a human operator to increase their physical performance. Several exoskeletons have been developed to restore functional movements, such as walking, for those with paralysis due to neurological impairment. However, existing exoskeletons have limitations with respect to affordability, size, weight, speed, and efficiency, which may reduce their functional application. Therefore, the aim of this scoping review is to collect and narratively synthesize the perspectives of users of exoskeleton technology.

Methods: A systematic literature search was conducted across several healthcare related online databases.

Results: A total of 4,619 articles were identified, of which 51 were selected for full review. Only three studies were identified that met the inclusion criteria. Of these, one showed an incongruence between users’ expectations and experiences of device use; another reported perspectives on potential rather than actual device use, ranking design features in order of perceived importance; and the other reported ratings of ease of device use in training.

Conclusions: The heterogeneity of studies included within this review, leave the authors unable to suggest consensus as to user perspectives of exoskeleton technology. However, it is apparent that users are able to suggest priorities for exoskeleton design and that users’ perspectives of exoskeleton technology might change in response to experience of use. The authors, therefore, suggest that exoskeleton design should be an iterative process, whereby user perspectives are sought, incorporated and refined by tangible experience, to ensure that devices developed are acceptable to and usable by the populations they seek to re-enable.

Objectives: The aim of this study was to review 5 years of activity from a new system devised by the National Institute for Health and Care Excellence (NICE), for assessing medical devices and diagnostics aimed at identifying and speeding adoption of technologies with clinical and cost advantages, compared with current practice in the United Kingdom healthcare system.

Methods: All eligible notified technologies were classified using the Food and Drug Administration and Global Medical Device Nomenclature nomenclatures. Decisions about selecting technologies for full assessment to produce NICE recommendations were reviewed, along with the reasons given to companies for not selecting products.

Results: Between 2009 and 2014, 186 technologies were notified (46 percent therapeutic and 54 percent diagnostic). Thirty-nine were judged ineligible (no regulatory approval), and 147 were considered by an independent committee. Of these, eighty (54 percent) were not selected for full assessment, most commonly because of insufficient evidence (86 percent): there were uncertainties specifically about benefits to the health service (54 percent), to patients (39 percent), and about cost (24 percent). The remaining 67 were selected and assessed for Medical Technology guidance (52 percent) (noninferior and/or lower cost consequences than current practice), for Diagnostics guidance (43 percent) or other NICE recommendations about adoption and use. Classifying technologies by two different systems showed no selection bias for any technology type or disease area.

Conclusions: Identifying new or under-used devices and diagnostics with potential benefits and promoting their adoption is important to health services in the United Kingdom and worldwide. This new system offers a means of fostering both uptake and further research. Lack of research data on new products is a major obstacle to evaluation.

Objectives: Economic evaluation (EE) is an accepted element of decision making and priority setting in healthcare. As the number of published EEs grows, so does the number of systematic reviews (SRs) of EEs. Although search methodology makes an important contribution to SR quality, search methods in reviews of EEs have not been evaluated in detail. We investigated the resources used to identify studies in recent, published SRs of EEs, and assessed whether the resources reflected recommendations.

Methods: We searched MEDLINE for SRs of EEs published since January 2013 and extracted the following from eligible reviews: databases searched, health technology assessment (HTA) sources searched, supplementary search techniques used. Results were compared against the minimum search resources recommended by National Institute for Health and Care Excellence (NICE) (MEDLINE, Embase, NHS EED, EconLit) for economic evidence for single technology appraisals, and resource types suggested in the summary of current best evidence from SuRe Info (economic databases, general databases, HTA databases, HTA agency Web pages, gray literature).

Results: Sixty-five SRs met the inclusion criteria; data were extracted from forty-two. Five reviews (12 percent) met or exceeded the NICE recommended resources. Nine reviews (21 percent) searched at least four of the five types of resource recommended by SuRe Info. Five reviews (12 percent) searched all five. Twenty-three reviews (55 percent) did not meet the NICE recommendations or four of five of the SuRe Info recommended resource types. Search reporting was frequently unclear or incorrect.

Conclusions: Searches conducted for the majority of recently published SRs of EEs do not meet two published approaches.

Objectives: The aim of this study was to evaluate whether ostomy industry patent activity (PA) is associated with patient outcomes and healthcare costs.

Methods: Two groups of ostomy pouch users based on manufacturer PA (low or high) were compared in terms of ostomy-related wear patterns, adverse events, and healthcare expenditure. Using Swedish registry data, all patients with newly formed stomas were divided between each group and were followed during a 2-year period (2011–12). Propensity score matching and parametric duration analysis were used to compare outcomes between patients of similar characteristics such as sex, age, and ostomy surgery type.

Results: In both one- and two-piece systems, the high PA group had significantly lower monthly ostomy-related expenditure than the low PA group (one-piece: 197.47 EUR versus 233.34 EUR; two-piece: 164.00 EUR versus 278.98 EUR). Fewer pouch and skin wafer purchases per month were an important driver of cost differences. Both groups had similar likelihood of purchasing dermatological products for skin complications over time.

Conclusions: PA in the ostomy care industry was associated with reduced healthcare costs, but not necessarily with fewer skin complications. It suggests that there is a health economic benefit from products made by patent intensive companies which may differentiate them from generic comparators, but more research is needed to understand the impact of activities conducive to medical innovation on health outcomes.

Objectives: The objective of this study is to illustrate and provide a better understanding of the role of health technology assessment (HTA) processes in decision making for drug reimbursement in Poland and how this approach could be considered by other countries of limited resources.

Methods: We analyzed the evolution of the HTA system and processes in Poland over the past decade and current developments based on publicly available information.

Results: The role of HTA in drug-reimbursement process in Poland has increased substantially over the recent decade, starting in 2005 with the formation the Agency for Health Technology Assessment and Tariff System (AOTMiT). The key success factors in this development were effective capacity building based on the use of international expertise, the implementation of transparent criteria into the drug reimbursement processes, and the selective approach to the adoption of innovative medicines based on the cost-effectiveness threshold among other criteria.

Conclusions: While Poland is regarded as a leader in Central and Eastern Europe, there is room for improvement, especially with regard to the quality of HTA processes and the consistency of HTA guidelines with reimbursement law. In the “pragmatic” HTA model use by AOTMiT, the pharmaceutical company is responsible for the preparation of a reimbursement dossier of good quality in line with HTA guidelines while the assessment team in AOTMiT is responsible for critical review of that dossier. Adoption of this model may be considered by other countries with limited resources to balance differing priorities and ensure transparent and objective access to medicines for patients who need them.

Objectives: The health technology assessment (HTA) Core Model® is a tool for defining and standardizing the elements of HTA analyses within several domains for producing structured reports. This study explored the parallels between the Core Model and a national HTA report. Experiences from various European HTA agencies were also investigated to determine the Core Model's adaptability to national reports.

Methods: A comparison between a national report on Genetic Counseling, produced by the Cellule d'expertise médicale Luxembourg, and the Core Model was performed to identify parallels in terms of relevant and comparable assessment elements (AEs). Semi-structured interviews with five representatives from European HTA agencies were performed to assess their user experiences with the Core Model.

Results: The comparative study revealed that 50 percent of the total number (n = 144) of AEs in the Core Model were relevant for the national report. Of these 144 AEs from the Core Model, 34 (24 percent) were covered in the national report. Some AEs were covered only partly. The interviewees emphasized flexibility in using the Core Model and stated that the most important aspects to be evaluated include characteristics of the disease and technology, clinical effectiveness, economic aspects, and safety.

Conclusions: In the present study, the national report covered an acceptable number of AEs of the Core Model. These results need to be interpreted with caution because only one comparison was performed. The Core Model can be used in a flexible manner, applying only those elements that are relevant from the perspective of the technology assessment and specific country context.

Objectives: The aim of this study was to illustrate the contribution of stakeholder engagement to the impact of health technology assessment (HTA) using an Irish HTA of a national public access defibrillation (PAD) program.

Background: In response to draft legislation that proposed a PAD program, the Minister for Health requested that Health Information and Quality Authority undertake an HTA to inform the design and implementation of a national PAD program and the necessary underpinning legislation. The draft legislation outlined a program requiring widespread installation and maintenance of automatic external defibrillators in specified premises.

Methods: Stakeholder engagement to optimize the impact of the HTA included one-to-one interviews with politicians, engagement with an Expert Advisory Group, public and targeted consultation, and positive media management.

Results: The HTA quantified the clinical benefits of the proposed PAD program as modest, identified that substantial costs would fall on small/medium businesses at a time of economic recession, and that none of the programs modeled were cost-effective. The Senator who proposed the Bill actively publicized the HTA process and its findings and encouraged participation in the public consultation. Participation of key stakeholders was important for the quality and acceptability of the HTA findings and advice. Media management promoted public engagement and understanding. The Bill did not progress.

Conclusions: The HTA informed the decision not to progress with legislation for a national PAD program. Engagement was tailored to ensure that key stakeholders including politicians and the public were informed of the HTA process, the findings, and the advice, thereby maximizing acceptance. Appropriate stakeholder engagement optimizes the impact of HTA.

Objectives: Despite recent development of health technology assessment (HTA) methods, there are still methodological gaps for the assessment of complex health technologies. The INTEGRATE-HTA guidance for effectiveness, economic, ethical, socio-cultural, and legal aspects, deals with challenges when assessing complex technologies, such as heterogeneous study designs, multiple stakeholder perspectives, and unpredictable outcomes. The objective of this article is to outline this guidance and describe the added value of integrating these assessment aspects.

Methods: Different methods were used to develop the various parts of the guidance, but all draw on existing, published knowledge and were supported by stakeholder involvement. The guidance was modified after application in a case study and in response to feedback from internal and external reviewers.

Results: The guidance consists of five parts, addressing five core aspects of HTA, all presenting stepwise approaches based on the assessment of complexity, context, and stakeholder involvement. The guidance on effectiveness, health economics and ethics aspects focus on helping users choose appropriate, or further develop, existing methods. The recommendations are based on existing methods’ applicability for dealing with problems arising with complex interventions. The guidance offers new frameworks to identify socio-cultural and legal issues, along with overviews of relevant methods and sources.

Conclusions: The INTEGRATE-HTA guidance outlines a wide range of methods and facilitates appropriate choices among them. The guidance enables understanding of how complexity matters for HTA and brings together assessments from disciplines, such as epidemiology, economics, ethics, law, and social theory. This indicates relevance for a broad range of technologies.

Objectives: Coverage decisions are decisions by third party payers about whether and how much to pay for technologies or services, and under what conditions. Given their complexity, a systematic and transparent approach is needed. The DECIDE (Developing and Evaluating Communication Strategies to Support Informed Decisions and Practice Based on Evidence) Project, a GRADE (Grading of Recommendations Assessment, Development and Evaluation) Working Group initiative funded by the European Union, has developed GRADE Evidence to Decision (EtD) framework for different types of decisions, including coverage ones.

Methods: We used an iterative approach, including brainstorming to generate ideas, consultation with stakeholders, user testing, and pilot testing of the framework.

Results: The general structure of the EtD includes formulation of the question, an assessment using twelve criteria, and conclusions. Criteria that are relevant for coverage decisions are similar to those for clinical recommendations from a population perspective. Important differences between the two include the decision-making processes, accountability, and the nature of the judgments that need to be made for some criteria. Although cost-effectiveness is a key consideration when making coverage decisions, it may not be the determining factor. Strength of recommendation is not directly linked to the type of coverage decisions, but when there are important uncertainties, it may be possible to cover an intervention for a subgroup, in the context of research, with price negotiation, or with restrictions.

Conclusions: The EtD provides a systematic and transparent approach for making coverage decisions. It helps ensure consideration of key criteria that determine whether a technology or service should be covered and that judgments are informed by the best available evidence.

Objectives: The translation of research findings into policy and practice is crucially dependent on the applicability of such findings in a given decision-making context. We explored in a case study whether a generic consultation guide to assess the applicability of a health technology could be rapidly deployed and deliver useful insights.

Methods: A consultation guide based on the context and implementation for complex interventions (CICI) framework was developed and piloted to assess the applicability of reinforced home-based palliative care in three European countries. Individual consultations in England and Germany and a panel discussion in Poland were completed.

Results: Various barriers may hinder successful implementation of reinforced home-based palliative care in the three countries. Whilst the experts across all countries emphasized the lack of funding along with organization and structure as major barriers, information varied by country for many of the other identified barriers and facilitators. Participants in the pilot study provided positive feedback in terms of understanding the topic and purpose of the consultation, and both individual and panel consultations could be easily implemented.

Conclusions: In this case study, the consultation guide presented a pragmatic, ready-to-use tool to assess the applicability of a health technology. As shown here, it can be used in a generic manner without discrete empirical information on the technology in question or, ideally, makes use of specific information collected as part of a HTA. Further studies are needed to validate this guide and apply it to other types of health technologies and more diverse decision-making contexts.

In reference to the article A Decade of Health Technology Assessment in Poland by I. Lipska et al. (1), I would like to provide you with some comments and additional information on the changes in reimbursement policies in the Polish healthcare system currently taking place, which is likely to lead to increased number of health technology assessments (HTAs) of medical devices (MDs).

Objectives: The Managed Uptake of Medical Methods Program (MUMM) started 10 years ago as a joint venture of the Finnish Office for Health Technology Assessment (Finohta) and the twenty hospital districts in Finland. The aim is to offer information on the effectiveness, safety, organizational effects, and costs of new medical methods to support decisions concerning their uptake in secondary care. In this article, we discuss the successes and challenges of implementing the MUMM program.

Methods: A study of awareness and use of five MUMM recommendations for various medical specialties with short-form web-based surveys to hospitals.

Results: The recommendations were noticed and considered relevant. In overall assessment they received a mean rating of 8.4 (range: 4 to 10). Two thirds of the respondents thought MUMM recommendations were useful for practice, but only a third had actually used them in decision making.

Conclusions: HTA-based MUMM recommendations were well received by physicians but in practice they are less used than clinical practice guidelines. Short-form electronic surveys were a useful way of gathering information about awareness and implementation. The surveys also functioned as another method of informing key physicians about the recommendations.