Skip to main content
    • Aa
    • Aa


  • Georgios Lyratzopoulos (a1), Steven Barnes (a2), Heather Stegenga (a2), Suzi Peden (a2) and Bruce Campbell (a3)...

Background: Keeping clinical practice recommendations up-to-date with a continually evolving evidence base presents challenges. Resources required to update recommendations compete with those needed to evaluate newer treatments.

Methods: We describe an approach developed by the UK National Institute for Health and Clinical Excellence (NICE) for updating clinical practice recommendations for new interventional procedures and we evaluate relevant initial experience of using this system. Depending on whether evidence for a procedure is judged adequate or inadequate for safety and efficacy, use in clinical practice is usually recommended with either “normal” or “special” arrangements for patient consent, data collection and institutional oversight, respectively. We examined whether differences in the state of the evidence at the initial and the updated appraisal of procedures were associated with changed recommendations.

Results: Since 2008, updating of recommendations focuses on procedures with initially inadequate evidence. “Special arrangements” recommendations about eleven procedures were updated after 3.3–6.5 years (median, 5.3 years), and recommendations for six were changed to “normal arrangements.” Overall, procedures with changed (“special-to-normal”) recommendations had a greater increase in the number of patients included in observational studies published since the initial guidance.

Conclusions: Procedures with changed (“special-to-normal”) recommendations generally had greater increases in their evidence base. Although uncertainties about optimal methods for keeping evidence-based recommendations up-to-date remain, this experience should be useful to policy makers in developing processes for prioritizing scarce resources for updating clinical practice recommendations. Further studies are needed about the value placed on “updated” recommendations by clinicians, policy-makers, and patients.

Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

1. H Bastian , P Glasziou , I Chalmers . Seventy-five trials and eleven systematic reviews a day: How will we ever keep up? PLoS Med. 2010;7:e1000326.

3. RP Ceulen , A Sommer , K Vernooy . Microembolism during foam sclerotherapy of varicose veins. N Engl J Med. 2008;358:15251526.

4.EVAR trial participants. Endovascular aneurysm repair and outcome in patients unfit for open repair of abdominal aortic aneurysm (EVAR trial 2): Randomised controlled trial. Lancet. 2005;365:21872192.

5.EVAR trial participants. Endovascular aneurysm repair versus open repair in patients with abdominal aortic aneurysm (EVAR trial 1): Randomised controlled trial. Lancet. 2005;365:21792186.

6. SD French , S McDonald , JE McKenzie , SE Green . Investing in updating: How do conclusions change when Cochrane systematic reviews are updated? BMC Med Res Method. 2005;5:33.

7. C Garritty , A Tsertsvadze , AC Tricco , M Sampson , D Moher . Updating systematic reviews: An International Survey. PLoS ONE. 2010;5:e9914. doi:10.1371/journal.pone.0009914

9. RD Lopes , GE Hafley , KB Allen , Endoscopic versus open vein-graft harvesting in coronary-artery bypass surgery. N Engl J Med. 2009;361:235244.

14. M Sampson , KG Shojania , J McGowan , Surveillance search techniques identified the need to update systematic reviews. J Clin Epidemiol. 2008;61:755762.

16. PG Shekelle , E Ortiz , S Rhodes , Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: How quickly do guidelines become outdated? JAMA. 2001;286:14611467.

17. KG Shojania , M Sampson , MT Ansari , How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147:224233.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

International Journal of Technology Assessment in Health Care
  • ISSN: 0266-4623
  • EISSN: 1471-6348
  • URL: /core/journals/international-journal-of-technology-assessment-in-health-care
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary Materials

Lyratzopoulos Online Supplement
Lyratzopoulos Online Supplement

 Word (47 KB)
47 KB


Altmetric attention score

Full text views

Total number of HTML views: 1
Total number of PDF views: 14 *
Loading metrics...

Abstract views

Total abstract views: 111 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 27th June 2017. This data will be updated every 24 hours.