Skip to main content

Effective early warning systems for new and emerging health technologies: Developing an evaluation framework and an assessment of current systems

  • Kieran Murphy (a1), Claire Packer (a1), Andrew Stevens (a1) and Sue Simpson (a1)

Objectives: The aim of this study was to define an effective early warning system, to identify and rank the characteristics of an effective early warning system for emerging health technologies, and to evaluate current early warning systems against these characteristics.

Methods: An iterative Delphi-type process with the thirteen members of the International Information Network on New and Changing Health Technologies (EuroScan). We synthesized key characteristics that network members had graded. Members were then asked whether these characteristics were present or fulfilled in their system.

Results: The definition of an effective early warning system developed was the following: a system that identifies innovations in the field of health technology likely to have a significant impact; and disseminates information relevant to the needs of the customer which is timely, so as to enable appropriate decision making (such as resource allocation), facilitate appropriate adoption, and identify further research requirements. Five primary and eleven secondary components of effective early warning systems were identified. The five primary characteristics concerned relevance, independence, resourcing, a clear pathway for the outputs to reach decision makers, and defined customers. Although the primary characteristics were present or fulfilled to some extent in the majority of evaluated early warning systems, there was considerable variability in the presence of the secondary characteristics in the evaluated systems.

Conclusions: Our study provides a definition for an effective early warning system and a shared understanding of the important characteristics and components of such systems. This work should provide guidance to those setting up new early warning systems as well as for those managing and reviewing current systems.

Hide All
Hailey D. 2003. Elements of effectiveness for health technology assessment programs. HTA Initiative #9. Edmonton, Alberta: Alberta Heritage Foundation for Medical Research;
Robert G, Stevens A, Gabbay J. 1999 Early warning systems' for identifying new healthcare technologies. Health Technol Assess. 3: 1108.
Simpson S, Carlsson P, Douw K, Packer C. 2002. A comparative analysis of early warning systems demonstrates differences in methods and structure: A survey of EuroScan member agencies. Proceedings of the 18th Annual Meeting of the International Society of Technology Assessment in Health Care. Germany: Urban & Fischer;
Simpson S, Hyde C, Cook A, Packer C, Stevens A. 2003 Assessing the accuracy of forecasting: Applying standard diagnostic assessment tools to a health technology early warning system. Int J Technol Assess Health Care. 20: 381384.
Wanke M, Juzwishin D, Thornley R, Chan L. 2006. An exploratory review of evaluation of health technology assessment agencies. HTA Initiative #16. Edmonton, Alberta: Alberta Heritage Foundation for Medical Research;
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

International Journal of Technology Assessment in Health Care
  • ISSN: 0266-4623
  • EISSN: 1471-6348
  • URL: /core/journals/international-journal-of-technology-assessment-in-health-care
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Altmetric attention score

Full text views

Total number of HTML views: 6
Total number of PDF views: 56 *
Loading metrics...

Abstract views

Total abstract views: 322 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 22nd March 2018. This data will be updated every 24 hours.