It is very fitting that the strap line for the article on reassessment (1) is derived from the quote “politics is the art of the possible” attributed to Otto von Bismarck. Bismarck was the first chancellor of the unified German Empire that preserved peace in Europe until 1914. Politically deft, he persuaded the southern German states to join with his North German Confederation by provoking hostilities with France.

Objectives: The aim of this study was to identify and critically appraise the use of Value of Information (VOI) analyses undertaken as part of health technology assessment (HTA) reports in England and Wales.

Methods: A systematic review of National Institute for Health Research (NIHR) funded HTA reports published between 2004 and 2013 identified the use of VOI methods and key analytical details in terms of: (i) types of VOI methodology used; (ii) parameters and key assumptions; and (iii) conclusions drawn in terms of the need for further research.

Results: A total of 512 HTA reports were published during the relevant timeframe. Of these, 203 reported systematic review and economic modeling studies and 25 of these had used VOI method(s). Over half of the twenty-five studies (n = 13) conducted both EVPI (Expected Value of Perfect Information) and EVPPI (Expected Value of Partial Perfect Information) analyses. Eight studies conducted EVPI analysis, three studies conducted EVPI, EVPPI, and EVSI (Expected Value of Sampling Information) analyses and one study conducted EVSI analysis only. The level of detail reporting the methods used to conduct the VOI analyses varied.

Conclusions: This review has shown that the frequency of the use of VOI methods is increasing at a slower pace compared with the published volume of HTA reports. This review also suggests that analysts reporting VOI method(s) in HTA reports should aim to describe the method(s) in sufficient detail to enable and encourage decision-makers guiding research prioritization decisions to use the potentially valuable outputs from quantitative VOI analyses.

In the wake of the UN Summit on non-communicable diseases (NCDs) (1), the subject has become a priority on most health agendas and scientific publications in this area have increased considerably over the past few years. NCDs are a threat, both for the sustainability of public health structures and for the wellbeing of the general population worldwide. Many risk factors have been identified as preventable and the determining role of lifestyle habits, such as physical exercise and food, in the pathogenesis of NCDs is now generally acknowledged.

Objectives: The aim of this study was to identify individuals with expertise in ethics analysis in Canada, who might contribute to health technology assessment (HTA); to gauge these individuals’ familiarity with, and experience participating in, the production of HTA.

Methods: A contact list was developed using the Canadian Bioethics Society membership list and faculty listings of Canadian universities, bioethics centers, and health agencies. An eighteen-question email survey was distributed to potential respondents to collect data on demographic information, education and work experience in applied ethics, and involvement in HTA.

Results: The survey response rate was 52.8 percent (350/663). Respondents worked primarily in academic institutions (50.4 percent) or hospitals (15.4 percent). Many respondents (83.1 percent) had education, formal training, or work-related experience in practical ethics related to health care, with many having a doctorate (34.5 percent) or master's degree (19.0 percent). One quarter (24.5 percent; n = 87) of respondents indicated they had been involved in an analysis of ethical issues for HTA. Almost two-thirds (65.4 percent; n = 165) of those who had not previously participated in ethics analysis believed they might usefully contribute to an analysis of ethical issues in HTA. Experts who have conducted ethics analysis in HTA had more than twice the odds of having education and training in ethics and a PhD than those who might contribute to ethics analysis.

Conclusion: Many people have contributed to ethics analysis in HTA in Canada, and more are willing to do so. Given the absence of a reliable credential for ethics expertise, HTA producers should exercise caution when enlisting ethics experts.

When the late Freddie Mercury penned these words (1), perhaps he had in mind bringing innovative medicines and devices to patients more quickly.

Introduction: Evidence requirements may differ across HTA bodies, and so pharmaceutical companies must plan to synergize their evidence generation strategy, across global regulatory and HTA bodies. Until recently, companies had no official platform to discuss the clinical development of a drug with HTA bodies; however, this is changing.

Objectives: To achieve broad usage in the EU, products must achieve both regulatory and reimbursement approval, the latter of which is based on HTA appraisal in many markets. The objective of this study is to present and evaluate the different options available for early HTA consultation (during drug development/Phase III) in the major European markets from the industry perspective.

Methods: An exploratory (nonsystematic) literature review was performed to identify the European markets offering early HTA consultations, and each process was analyzed using a set of predefined metrics that are relevant to industry (the ability to consult with the regulatory body in parallel, consultation fees, length of consultation meeting, language of consultation meeting, maximum number of pharmaceutical company employees attending, procedural timelines, nature of data for which consultative advice can be sought, the output of the process, and the ability to involve external experts).

Results: Four different types of early HTA consultation processes were identified across the major European HTA markets. The nature of these processes varied in terms of the types and number of questions that can be addressed, the length of the meeting, the reporting output, and the ability to involve external experts.

Conclusions: The availability of various options for early HTA consultation may help to avoid a mismatch between the evidence generated by means of a product's clinical development program, and the evidence expected by HTA bodies and payers, which can facilitate the pricing and reimbursement process upon a product's market authorization.

Objectives: The aim of this study was to get an overview of current theory and practice in early assessments of medical devices, and to identify aims and uses of early assessment methods used in practice.

Methods: A systematic literature review was conducted in September 2013, using computerized databases (PubMed, Science Direct, and Scopus), and references list search. Selected articles were categorized based on their type, objective, and main target audience. The methods used in the application studies were extracted and mapped throughout the early stages of development and for their particular aims.

Results: Of 1,961 articles identified, eighty-three studies passed the inclusion criteria, and thirty were included by searching reference lists. There were thirty-one theoretical papers, and eighty-two application papers included. Most studies investigated potential applications/possible improvement of medical devices, developed early assessment framework or included stakeholder perspective in early development stages. Among multiple qualitative and quantitative methods identified, only few were used more than once. The methods aim to inform strategic considerations (e.g., literature review), economic evaluation (e.g., cost-effectiveness analysis), and clinical effectiveness (e.g., clinical trials). Medical devices were often in the prototype product development stage, and the results were usually aimed at informing manufacturers.

Conclusions: This study showed converging aims yet widely diverging methods for early assessment during medical device development. For early assessment to become an integral part of activities in the development of medical devices, methods need to be clarified and standardized, and the aims and value of assessment itself must be demonstrated to the main stakeholders for assuring effective and efficient medical device development.

Background: Ethics has been part of health technology assessment (HTA) from its beginning in the 1970s, and is currently part of HTA definitions. Several methods in ethics have been used in HTA. Some approaches have been developed especially for HTA, such as the Socratic approach, which has been used for a wide range of health technologies. The Socratic approach is used in several ways, and there is a need for harmonization to promote its usability and the transferability of its results. Accordingly, the objective of this study was to stimulate experts in ethics and HTA to revise the Socratic approach.

Methods: Based on the current literature and experiences in applying methods in ethics, a panel of ethics experts involved in HTA critically analyzed the limitations of the Socratic approach during a face-to-face workshop. On the basis of this analysis a revision of the Socratic approach was agreed on after deliberation in several rounds through e-mail correspondence.

Results: Several limitations with the Socratic approach are identified and addressed in the revised version which consists of a procedure of six steps, 7 main questions and thirty-three explanatory and guiding questions. The revised approach has a broader scope and provides more guidance than its predecessor. Methods for information retrieval have been elaborated.

Conclusion: The presented revision of the Socratic approach is the result of a joint effort of experts in the field of ethics and HTA. Consensus is reached in the expert panel on an approach that is considered to be more clear, comprehensive, and applicable for addressing ethical issues in HTA.

Background: A framework for collaborative production and sharing of HTA information, the HTA Core Model, was originally developed within EUnetHTA in 2006–08. In this paper, we describe the further development of the Model to allow implementation and utilization of the Model online. The aim was to capture a generic HTA process that would allow effective use of the HTA Core Model and resulting HTA information while at the same time not interfering with HTA agencies' internal processes.

Methods: The work was coordinated by a development team in Finland, supported by an international expert group. Two pilot testing rounds were organized among EUnetHTA agencies and two extensive core HTA projects tested the tool in a real setting. The final work was also formally validated by a group of HTA agencies.

Results: The HTA Core Model Online—available at http://www.corehta.info—is a web site hosting a) a tool to allow electronic utilization of the HTA Core Model and b) a database of produced HTA information. While access to the HTA information is free to all, the production features are currently available to EUnetHTA member agencies only. A policy was crafted to steer the use of the Model and produced information.

Conclusions: We have successfully enabled electronic use of the HTA Core Model and agreed on a policy for its utilization. The system is already being used in subsequent HTA projects within EUnetHTA Joint Action 2. Identified shortcomings and further needs will be addressed in subsequent development.

Objectives: The aim of this study was to assess potential cost-effectiveness of using a prostate cancer specific functional imaging technology capable of identifying residual localized disease versus small volume metastatic disease for asymptomatic men with low but detectable prostate specific antigen (PSA) elevation following radical prostatectomy.

Methods: Markov modeling was used to estimate the incremental impact on healthcare system costs (2012 USD) and quality-adjusted life-years (QALYs) of two alternative strategies: (i) using the new diagnostic to guide therapy versus (ii) current usual care—using a combination of computed tomography, magnetic resonance imaging, and bone scan to guide therapy. Costs were based on estimates from literature and Medicare reimbursement. Prostate cancer progression, survival, utilities, and background risk of all-cause mortality were obtained from literature. Base-case diagnostic sensitivity (75 percent), specificity (90 percent), and cost (USD 2,500) were provided by our industry partner GE Healthcare.

Results: The new diagnostic strategy provided an average gain of 1.83 (95 percent uncertainty interval [UI]: 1.24–2.64) QALYs with added costs of USD 15,595 (95 percent UI: USD -6,330–44,402) over 35 years. The resulting incremental cost-effectiveness ratio was USD 8,516/QALY (95 percent UI: USD -2,947–22,372). Results were most influenced by the utility discounting rate and test performance characteristics; however, the new diagnostic provided clinical benefits over a wide range of sensitivity and specificity.

Conclusion: This analysis suggests a diagnostic technology capable of identifying whether men with biochemical recurrence after radical prostatectomy have localized versus metastatic disease would be a cost-effective alternative to current standard work-up. The results support additional investment in development and validation of such a diagnostic.

Background: Adaptive approaches to the introduction of drugs and medical devices involve the use of an evolving evidence base rather than conventional single-point-in-time evaluations as a proposed means to promote patient access to innovation, reduce clinical uncertainty, ensure effectiveness, and improve the health technology development process.

Methods: This report summarizes a Health Technology Assessment International (HTAi) Policy Forum discussion, drawing on presentations from invited experts, discussions among attendees about real-world case examples, and background paper.

Results: For adaptive approaches to be understood, accepted, and implemented, the Forum identified several key issues that must be addressed. These include the need to define the goals of and to set priorities for adaptive approaches; to examine evidence collection approaches; to clarify the roles and responsibilities of stakeholders; to understand the implications of adaptive approaches on current legal and ethical standards; to determine costs of such approaches and how they will be met; and to identify differences in applying adaptive approaches to drugs versus medical devices. The Forum also explored the different implications of adaptive approaches for various stakeholders, including patients, regulators, HTA/coverage bodies, health systems, clinicians, and industry.

Conclusions: A key outcome of the meeting was a clearer understanding of the opportunities and challenges adaptive approaches present. Furthermore, the Forum brought to light the critical importance of recognizing and including a full range of stakeholders as contributors to a shared decision-making model implicit in adaptive pathways in future discussions on, and implementation of, adaptive approaches.

Background: Although value issues are increasingly addressed in health technology assessment (HTA) reports, HTA is still seen as a scientific endeavor and sometimes contrasted with value judgments, which are considered arbitrary and unscientific. This article aims at illustrating how numerous value judgments are at play in the HTA process, and why it is important to acknowledge and address value judgments.

Methods: A panel of experts involved in HTA, including ethicists, scrutinized the HTA process with regard to implicit value judgments. It was analyzed whether these value judgments undermine the accountability of HTA results. The final results were obtained after several rounds of deliberation.

Results: Value judgments are identified before the assessment when identifying and selecting health technologies to assess, and as part of assessment. They are at play in the processes of deciding on how to select, frame, present, summarize or synthesize information in systematic reviews. Also, in economic analysis, value judgments are ubiquitous. Addressing the ethical, legal, and social issues of a given health technology involves moral, legal, and social value judgments by definition. So do the appraisal and the decision-making process.

Conclusions: HTA by and large is a process of value judgments. However, the preponderance of value judgments does not render HTA biased or flawed. On the contrary they are basic elements of the HTA process. Acknowledging and explicitly addressing value judgments may improve the accountability of HTA.

Transcatheter aortic valve implantation (TAVI or TAVR) is a newly introduced medical procedure enabled by a new device. Although its introduction does not represent that of all medical devices, it does illustrate a situation in which a device provides a new alternative to standard care in a specific group of patients. Unlike drugs, the medical device category is highly heterogeneous and includes both diagnostic and treatment (accessories, implantable, enablers) and capital equipment. The TAVI- case was discussed as one of the examples in the Policy Forum Meeting and the authors were acting as facilitators that summed up both the case as presented and the discussion between the members that followed. We wish to give a special thanks to the participants of the group work for their input to the discussion.

Objectives: The aim of this study was to estimate the cost-effectiveness of nebulized magnesium sulphate (MgSO4) in acute asthma in children from the perspective of the UK National Health Service and personal social services.

Methods: An economic evaluation was conducted based on evidence from a randomized placebo controlled multi-center trial of nebulized MgSO4 in severe acute asthma in children. Participants comprised 508 children aged 2–16 years presenting to an emergency department or a children's assessment unit with severe acute asthma across thirty hospitals in the United Kingdom. Children were randomly allocated to receive nebulized salbutamol and ipratropium bromide mixed with either 2.5 ml of isotonic MgSO4 or 2.5 ml of isotonic saline on three occasions at 20-min intervals. Cost-effectiveness outcomes were constructed around the Yung Asthma Severity Score (ASS) after 60 min of treatment; whilst cost-utility outcomes were constructed around the quality-adjusted life-year (QALY) metric. The nonparametric bootstrap method was used to present cost-effectiveness acceptability curves at alternative cost-effectiveness thresholds for either: (i) a unit reduction in ASS; or (ii) an additional QALY.

Results: MgSO4 had a 75.1 percent probability of being cost-effective at a GBP 1,000 (EUR 1,148) per unit decrement in ASS threshold, an 88.0 percent probability of being more effective (in terms of reducing the ASS) and a 36.6 percent probability of being less costly. MgSO4 also had a 67.6 percent probability of being cost-effective at a GBP 20,000 (EUR 22,957) per QALY gained threshold, an 8.5 percent probability of being more effective (in terms of generating increased QALYs) and a 69.1 percent probability of being less costly. Sensitivity analyses showed that the results of the economic evaluation were particularly sensitive to the methods used for QALY estimation.

Conclusions: The probability of cost-effectiveness of nebulized isotonic MgSO4, given as an adjuvant to standard treatment of severe acute asthma in children, is less than 70 percent across accepted cost-effectiveness thresholds for an additional QALY.

Objectives: The aim of this study was to assist in the development of a health technology assessment (HTA) program for the Ministry of Health (MOH) of the Republic of Kazakhstan

Methods: Mentoring of an initial HTA program in Kazakhstan was provided by the Canadian Society for International Health (CSIH) by means of a partnership with the Kazakhstan MOH. HTA materials, courses, and one-on-one support for the preparation of a series of initial HTA reports by MOH HTA staff were provided by a seven-member CSIH team over a 2.5-year project.

Results: Guidance documents on HTA and institutional strengthening were prepared in response to an extensive set of deliverables developed by the MOH and the World Bank. Introductory and train-the-trainer workshops in HTA and economic evaluation were provided for MOH staff members, experts from Kazakhstan research institutes and physicians. Five short HTA reports were successfully developed by staff in the Ministry's HTA Unit with assistance from the CSIH team. Challenges that may be relevant to other emerging HTA programs included lack of familiarity with some essential underlying concepts, organization culture, and limited time for MOH staff to do HTA work.

Conclusions: The project helped to define the need for HTA and mentored MOH staff in taking the first steps to establish a program to support health policy decision making in Kazakhstan. This experience offers practical lessons for other emerging HTA programs, although these should be tailored to the specific context.

Objectives: In many economic evaluations and reimbursement decisions, quality-adjusted life-years (QALYs) are used as a measure of benefit to assess effectiveness of novel therapies, often based on the EQ-5D 3-level questionnaire. As only five dimensions of physical and mental well-being are reflected in this tool, significant aspects of the patient experience may be missed. We evaluate the use of the EQ-5D as a measurement of clinical change across a wide range of disorders from dermatological (acne) to life-threatening (metastatic cancers).

Methods: We analyze published studies on the psychometric properties of the EQ-5D 3-level questionnaire, extracting information on the Visual Analogue Scale versus Index score, Standardized Response Mean, and Effect Size. These are compared with ranges generally accepted to represent good responsiveness in the psychometric literature.

Results: We find that only approximately one in five study populations report subjective health state valuation of patients within 5 percent of the score attributed by the EQ-5D index, and more than 40 percent of studies report unacceptable ceiling effects. In the majority of studies, responsiveness of the EQ-5D index was found to be poor to moderate, based on Effect Size (63 percent poor–moderate) and Standardized Response Mean (72 percent poor–moderate).

Conclusions: We conclude that the EQ-5D index does not adequately reflect patient health status across a range of conditions, and it is likely that a significant proportion of the subjective patient experience is not accounted for by the index. This has implications for economic evaluations of novel drugs based on evidence generated with the EQ-5D.

Objectives: Many European countries perform rapid assessments of the relative effectiveness (RE) of pharmaceuticals as part of the reimbursement decision making process. Increased sharing of information on RE across countries may save costs and reduce duplication of work. The objective of this article is to describe the development of a tool for rapid assessment of RE of new pharmaceuticals that enter the market, the HTA Core Model® for Rapid Relative Effectiveness Assessment (REA) of Pharmaceuticals.

Methods: Eighteen member organisations of the European Network of Health Technology Assessment (EUnetHTA) participated in the development of the model. Different versions of the model were developed and piloted in this collaboration and adjusted accordingly based on feedback on the content and feasibility of the model.

Results: The final model deviates from the traditional HTA Core Model® used for assessing other types of technologies. This is due to the limited scope (strong focus on RE), the timing of the assessment (just after market authorisation), and strict timelines (e.g. 90 days) required for performing the assessment. The number of domains and assessment elements was limited and it was decided that the primary information sources should preferably be a submission file provided by the marketing authorisation holder and the European Public Assessment Report.

Conclusions: The HTA Core Model® for Rapid REA (version 3.0) was developed to produce standardised transparent RE information of pharmaceuticals. Further piloting can provide input for possible improvements, such as further refining the assessment elements and new methodological guidance on relevant areas.

Objectives: The aim of this study was to present the development, structure and results of a database on planned and ongoing health technology assessment (HTA) projects (POP Database) in Europe.

Methods: The POP Database (POP DB) was set up in an iterative process from a basic Excel sheet to a multifunctional electronic online database. The functionalities, such as the search terminology, the procedures to fill and update the database, the access rules to enter the database, as well as the maintenance roles, were defined in a multistep participatory feedback loop with EUnetHTA Partners.

Results: The POP Database has become an online database that hosts not only the titles and MeSH categorizations, but also some basic information on status and contact details about the listed projects of EUnetHTA Partners. Currently, it stores more than 1,200 planned, ongoing or recently published projects of forty-three EUnetHTA Partners from twenty-four countries. Because the POP Database aims to facilitate collaboration, it also provides a matching system to assist in identifying similar projects. Overall, more than 10 percent of the projects in the database are identical both in terms of pathology (indication or disease) and technology (drug, medical device, intervention). In addition, approximately 30 percent of the projects are similar, meaning that they have at least some overlap in content.

Conclusions: Although the POP DB is successful concerning regular updates of most national HTA agencies within EUnetHTA, little is known about its actual effects on collaborations in Europe. Moreover, many non-nationally nominated HTA producing agencies neither have access to the POP DB nor can share their projects.

Objectives: Legal analysis can highlight important issues that are relevant when deciding whether a medical technology should be implemented or reimbursed. Literature and studies show that even though the law is an acknowledged part of health technology assessment (HTA), legal issues are rarely considered in practice. One reason for this may be the lack of knowledge about the diversity of legal issues that are relevant for HTA. Therefore, this contribution aims primarily to identify and then explain the relevant legal issues in HTA. This study offers a framework for identifying the legal issues in HTAs in different jurisdictions and provides a basis for further research.

Methods: After extensive literature search, the authors review Swiss health law to identify legal issues that are relevant to HTA. The authors then categorize these legal issues using a framework with an inside and outside perspective. Finally, they explain a selection of these legal issues with several examples.

Results: This study reveals numerous legal issues that are relevant for HTA and underlines the necessity of incorporating legal analysis in HTAs. The suggested perspectival framework in this study provides a basis to structure the legal analysis. The identified legal issues are relevant in other countries and the perspectival framework is transferable to other jurisdictions.

Conclusions: The article underlines the importance of in-depth discussion about the role of law in HTA. It provides a structured overview of the legal issues in HTA and suggests a development of more concrete instruments toward a standardized legal technology assessment.