Skip to main content
    • Aa
    • Aa
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 12
  • Cited by
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Jackson, Jim 2013. Translational Medicine.

    de Jong, Stefan P.L. Wardenaar, Tjerk and Horlings, Edwin 2016. Exploring the promises of transdisciplinary research: A quantitative study of two climate research programmes. Research Policy, Vol. 45, Issue. 7, p. 1397.

    Luce, Bryan and Cohen, Rebecca Singer 2009. Health technology assessment in the United States. International Journal of Technology Assessment in Health Care, Vol. 25, Issue. S1, p. 33.

    Dorling, Hannah Cook, Andrew Ollerhead, Liz and Westmore, Matt 2015. The NIHR Public Health Research Programme: responding to local authority research needs in the United Kingdom. Health Research Policy and Systems, Vol. 13, Issue. 1,

    Guinea, J. Sela, E. Gomez-Nunez, A. J. Mangwende, T. Ambali, A. Ngum, N. Jaramillo, H. Gallego, J. M. Patino, A. Latorre, C. Srivanichakorn, S. and Thepthien, B. 2015. Impact oriented monitoring: A new methodology for monitoring and evaluation of international public health research projects. Research Evaluation, Vol. 24, Issue. 2, p. 131.

    Banzi, Rita Moja, Lorenzo Pistotti, Vanna Facchini, Andrea and Liberati, Alessandro 2011. Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Research Policy and Systems, Vol. 9, Issue. 1,

    Yazdizadeh, Bahareh Majdzadeh, Reza Janani, Leila Mohtasham, Farideh Nikooee, Sima Mousavi, Abdmohammad Najafi, Farid Atabakzadeh, Maryam Bazrafshan, Azam Zare, Morteza and Karami, Manoochehr 2016. An assessment of health research impact in Iran. Health Research Policy and Systems, Vol. 14, Issue. 1,

    Turner, Sheila Davidson, Peter Stanton, Louise and Cawdeary, Victoria 2014. Features of successful bids for funding of applied health research: a cohort study. Health Research Policy and Systems, Vol. 12, Issue. 1,

    Adam, P. Solans-Domenech, M. Pons, J. M. V. Aymerich, M. Berra, S. Guillamon, I. Sanchez, E. and Permanyer-Miralda, G. 2012. Assessment of the impact of a clinical and health services research call in Catalonia. Research Evaluation, Vol. 21, Issue. 4, p. 319.

    Banzi, Rita Moja, Lorenzo Liberati, Alessandro Gensini, Gian Franco Gusinu, Roberto and Conti, Andrea A. 2009. Measuring the impact of evidence: the Cochrane systematic review of organised stroke care. Internal and Emergency Medicine, Vol. 4, Issue. 6, p. 507.

    Viswanathan, Meera Nerz, Patrick Dalberth, Barbara Voisin, Christiane Lohr, Kathleen N Tant, Elizabeth Jonas, Daniel E and Carey, Timothy 2012. Assessing the impact of systematic reviews on future research: two case studies. Journal of Comparative Effectiveness Research, Vol. 1, Issue. 4, p. 329.

    Fraser, A. G. Daubert, J.-C. Van de Werf, F. Estes, N. A. M. Smith, S. C. Krucoff, M. W. Vardas, P. E. Komajda, M. Anker, S. Auricchio, A. Bailey, S. Bonhoeffer, P. Borggrefe, M. Brodin, L.-A. Bruining, N. Buser, P. Butchart, E. Calle Gordo, J. Cleland, J. Danchin, N. Daubert, J. Degertekin, M. Demade, I. Denjoy, N. Derumeaux, G. Di Mario, C. Dickstein, K. Dudek, D. Estes, N. Farb, A. Flotats, A. Fraser, A. Gueret, P. Israel, C. James, S. Kautzner, J. Komajda, M. Krucoff, M. Lombardi, M. Marwick, T. Mioulet, M. O'Kelly, S. Perrone-Filardi, P. Rosano, G. Rosenhek, R. Sabate, M. Smith, S. Swahn, E. Tavazzi, L. Van de Werf, F. van der Velde, E. van Herwerden, L. Vardas, P. Voigt, J.-U. Weaver, D. and Wilmshurst, P. 2011. Clinical evaluation of cardiovascular devices: principles, problems, and proposals for European regulatory reform: Report of a policy conference of the European Society of Cardiology. European Heart Journal, Vol. 32, Issue. 13, p. 1673.

  • International Journal of Technology Assessment in Health Care, Volume 25, Issue 1
  • January 2009, pp. 1-5

Assessing the impact of England's National Health Service R&D Health Technology Assessment program using the “payback” approach

  • James Raftery (a1), Stephen Hanney (a2), Colin Green (a3) and Martin Buxton (a2)
  • DOI:
  • Published online: 01 January 2009

Objectives: This study assesses the impact of the English National Health Service (NHS) Health Technology Assessment (HTA) program using the “payback” framework.

Methods: A survey of lead investigators of all research projects funded by the HTA program 1993–2003 supplemented by more detailed case studies of sixteen projects.

Results: Of 204 eligible projects, replies were received from 133 or 65 percent. The mean number of peer-reviewed publications per project was 2.9. Seventy-three percent of projects claimed to have had had an impact on policy and 42 percent on behavior. Technology Assessment Reports for the National Institute for Health and Clinical Excellence (NICE) had fewer than average publications but greater impact on policy. Half of all projects went on to secure further funding. The case studies confirmed the survey findings and indicated factors associated with impact.

Conclusions: The HTA program performed relatively well in terms of “payback.” Facilitating factors included the program's emphasis on topics that matter to the NHS, rigorous methods and the existence of “policy customers” such as NICE.

Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

2.American Gastroenterologist Association. American Gastroenterologist Association medical position statement: Evaluation of dyspepsia. Gastroenterology. 2005;129:17531755.

3.N. Black Evidence based policy: Proceed with care. BMJ. 2001;323;275279.

6.PW Duncan , R Zorowitz , B Bates , Management of adult rehabilitation care: A clinical practice guideline. Stroke. 2005;36:e100e143.

7.B Ferguson , P Kelly , A Georgiou , Assessing payback from NHS reactive research programmes. J Manag Med. 2000;14:2536.

8.S Hanney , M Buxton , C Green , D Coulson , J Raftery . An assessment of the impact of the NHS Health Technology Assessment Programme. Health Technol Assess. 2007;11:iiiiv, ix-xi, 1-180.

9.S Hanney , M Gonzalez-Block , M Buxton , M Kogan . The utilisation of health research in policy-making: Concepts, examples and methods of assessment. Health Res Policy Syst. 2003;1:2.

10.S Hanney , J Grant , S Wooding , MJ Buxtom . Proposed methods for reviewing the outcomes of research: The impact of funding by the UK's ‘Arthritis Research Campaign’. Health Res Policy Syst. 2004;2:4.

14.SC Johnston , JD Rootenberg , S Katrak , WS Smith , JS Elkins . Effects of a US National Institutes of Health programme of clinical trials on public health and costs. Lancet. 2006;367:13191327.

15.L Kalra , A Evans , I Perez , Alternative strategies for stroke care: A prospective randomised controlled trial. Lancet. 2000;356:894899.

16.L Kalra , A Evans , I Perez , A randomised controlled comparison of alternative strategies for stroke care. Health Technol Assess. 2005;9:iiiiv, 1–79.

19.P Kwan , J Johnston , AY Fung , A systematic evaluation of payback of publicly funded health and health services research in Hong Kong. BMC Health Serv Res. 2007;7:121.

20.S Shah , JE Ward . Outcomes from NHMRC public health research project grants awarded in 1993. Aust N Z J Public Health. 2001;25:556560.

22.E Ward , M King , M Lloyd , Randomised controlled trial of nondirective counselling, cognative-behaviour therapy and usual general practitioner care for patients with depression. I: Clinical effectiveness. BMJ. 2000;321:13831388.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

International Journal of Technology Assessment in Health Care
  • ISSN: 0266-4623
  • EISSN: 1471-6348
  • URL: /core/journals/international-journal-of-technology-assessment-in-health-care
Please enter your name
Please enter a valid email address
Who would you like to send this to? *