Hostname: page-component-8448b6f56d-xtgtn Total loading time: 0 Render date: 2024-04-16T23:20:23.341Z Has data issue: false hasContentIssue false

PERFORMANCE OF OVID MEDLINE SEARCH FILTERS TO IDENTIFY HEALTH STATE UTILITY STUDIES

Published online by Cambridge University Press:  25 October 2017

Mick Arber
Affiliation:
York Health Economics Consortiummick.arber@york.ac.uk
Sonia Garcia
Affiliation:
York Health Economics Consortium
Thomas Veale
Affiliation:
York Health Economics Consortium
Mary Edwards
Affiliation:
York Health Economics Consortium
Alison Shaw
Affiliation:
York Health Economics Consortium
Julie M. Glanville
Affiliation:
York Health Economics Consortium

Abstract

Objectives: This study was designed to assess the sensitivity of three Ovid MEDLINE search filters developed to identify studies reporting health state utility values (HSUVs), to improve the performance of the best performing filter, and to validate resulting search filters.

Methods: Three quasi-gold standard sets (QGS1, QGS2, QGS3) of relevant studies were harvested from reviews of studies reporting HSUVs. The performance of three initial filters was assessed by measuring their relative recall of studies in QGS1. The best performing filter was then developed further using QGS2. This resulted in three final search filters (FSF1, FSF2, and FSF3), which were validated using QGS3.

Results: FSF1 (sensitivity maximizing) retrieved 132/139 records (sensitivity: 95 percent) in the QGS3 validation set. FSF1 had a number needed to read (NNR) of 842. FSF2 (balancing sensitivity and precision) retrieved 128/139 records (sensitivity: 92 percent) with a NNR of 502. FSF3 (precision maximizing) retrieved 123/139 records (sensitivity: 88 percent) with a NNR of 383.

Conclusions: We have developed and validated a search filter (FSF1) to identify studies reporting HSUVs with high sensitivity (95 percent) and two other search filters (FSF2 and FSF3) with reasonably high sensitivity (92 percent and 88 percent) but greater precision, resulting in a lower NNR. These seem to be the first validated filters available for HSUVs. The availability of filters with a range of sensitivity and precision options enables researchers to choose the filter which is most appropriate to the resources available for their specific research.

Type
Methods
Copyright
Copyright © Cambridge University Press 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

1. Phillips, C, Thompson, G. What is a QALY? [What is. . .? series, Second edition, supported by Sanofi-Aventis]. Newmarket: Hayward Medical Communications, 2009 http://www.medicine.ox.ac.uk/bandolier/painres/download/whatis/qaly.pdf (accessed June 16, 2016).Google Scholar
2. Tolley, K. What are health utilities? [What is. . .? series, Second edition, supported by Sanofi-Aventis]. Newmarket: Hayward Medical Communications, 2009 http://www.medicine.ox.ac.uk/bandolier/painres/download/whatis/Health-util.pdf (accessed June 16, 2016).Google Scholar
3. The University of Sheffield, National Institute for Health Research. ScHARRHUD [database]. Sheffield: School of Health and Related Research; 2016. http://www.scharrhud.org/ (accessed June 16, 2016).Google Scholar
4. The Center for the Evaluation of Value and Risk in Health. CEA: Cost-Effectiveness Analysis Registry [database]. Boston, MA: Tufts Medical Center; 2016. https://research.tufts-nemc.org/cear4/ (accessed June 16, 2016).Google Scholar
5. Centre for Reviews and Dissemination. NHS EED [database]. York: Centre for Reviews and Dissemination; 2016. http://www.crd.york.ac.uk/CRDWeb/ (accessed June 16, 2016).Google Scholar
6. Papaioannou, D, Brazier, J, Paisley, S. NICE DSU technical support document 9: The identification, review and synthesis of health state utility values from the literature. report by the decision support unit. Sheffield: School of Health and Related Research, 2010. http://www.nicedsu.org.uk/TSD9%20HSUV%20values_FINAL.pdf (accessed June 16, 2016).Google Scholar
7. Paisley, S. Identification of evidence for key parameters in decision-analytic models of cost effectiveness: A description of sources and a recommended minimum search requirement. Pharmacoeconomics. 2016;34:597608.CrossRefGoogle Scholar
8. Papaioannou, D, Brazier, J, Paisley, S. Systematic searching and selection of health state utility values from the literature. Value Health. 2013;16:686695.Google Scholar
9. Glanville, J, Lefebvre, C, Wright, K. ISSG search filters resource [webpage]. York: InterTASC Information Specialists' Sub-Group (ISSG); 2016. https://sites.google.com/a/york.ac.uk/issg-search-filters-resource/home (accessed June 16, 2016).Google Scholar
10. Filters, Flinders. Flinders filters: Research solutions to searching problems [webpage]. Adelaide: Flinders Centre for Clinical Change & Health Care Research; 2016. http://www.flinders.edu.au/clinical-change/research/flinders-filters/ (accessed June 16, 2016).Google Scholar
11. McMaster Health Knowledge Refinery (HKR) Projects. Hedges Project [webpage]. Hamilton: Health Information Research Unit, McMaster University; 2016. http://hiru.mcmaster.ca/hiru/HIRU_Hedges_home.aspx (accessed June 16, 2016).Google Scholar
12. Urbaniak, GC, Plous, S. Research Randomizer [Version 4.0] [Computer software]. 2013. https://www.randomizer.org (accessed June 16, 2016).Google Scholar
13. PubReMiner, Koster J. [webpage]. 2014. http://hgserver2.amc.nl/cgi-bin/miner/miner2.cgi (accessed June 16, 2016).Google Scholar
14. The National Centre for Text Mining. TerMine [webpage]. Manchester: University of Manchester; 2014. http://www.nactem.ac.uk/software/termine/ (accessed June 16, 2016).Google Scholar
15. Glanville, JM, Lefebvre, C, Miles, JN, Camosso-Stefinovic, J. How to identify randomized controlled trials in MEDLINE: Ten years on [Erratum: J Med Libr Assoc. 2006;94:354]. J Med Libr Assoc. 2006;94:130136.Google Scholar
16. Jenkins, M. Evaluation of methodological search filters–a review. Health Info Libr J. 2004;21:148163.Google Scholar
Supplementary material: File

Arber et al supplementary material

Tables S1-S5

Download Arber et al supplementary material(File)
File 27.6 KB