Hostname: page-component-848d4c4894-ndmmz Total loading time: 0 Render date: 2024-05-14T10:37:41.563Z Has data issue: false hasContentIssue false

Review of real-world evidence studies in type 2 diabetes mellitus: Lack of good practices

Published online by Cambridge University Press:  24 June 2020

Véronique Lambert-Obry*
Affiliation:
The Faculty of Pharmacy, Université de Montréal, 2940, Chemin de Polytechnique, Montréal, QuébecH3T 1J4, Canada
Jean-Philippe Lafrance
Affiliation:
The Faculty of Medicine, Université de Montréal, 2900, Boulevard Édouard-Montpetit, Montréal, QuébecH3T 1J4, Canada
Michelle Savoie
Affiliation:
The Faculty of Pharmacy, Université de Montréal, 2940, Chemin de Polytechnique, Montréal, QuébecH3T 1J4, Canada
Sandrine Henri
Affiliation:
The Faculty of Pharmacy, Université de Montréal, 2940, Chemin de Polytechnique, Montréal, QuébecH3T 1J4, Canada
Jean Lachaine
Affiliation:
The Faculty of Pharmacy, Université de Montréal, 2940, Chemin de Polytechnique, Montréal, QuébecH3T 1J4, Canada
*
Author for correspondence: Veronique Lambert-Obry, E-mail: veronique.lambert-obry@umontreal.ca

Abstract

Objectives

Unlike randomized controlled trials, lack of methodological rigor is a concern about real-world evidence (RWE) studies. The objective of this study was to characterize methodological practices of studies collecting pharmacoeconomic data in a real-world setting for the management of type 2 diabetes mellitus (T2DM).

Methods

A systematic literature review was performed using the PICO framework: population consisted of T2DM patients, interventions and comparators were any intervention for T2DM care or absence of intervention, and outcomes were resource utilization, productivity loss or utility. Only RWE studies were included, defined as studies that were not clinical trials and that collected de novo data (no retrospective analysis).

Results

The literature search identified 1,158 potentially relevant studies, among which sixty were included in the literature review. Many studies showed a lack of transparency by not mentioning the source for outcome and exposure measurement, source for patient selection, number of study sites, recruitment duration, sample size calculation, sampling method, missing data, approbation by an ethics committee, obtaining patient's consent, conflicts of interest, and funding. A significant proportion of studies had poor quality scores and was at high risk of bias.

Conclusions

RWE from T2DM studies lacks transparency and credibility. There is a need for good procedural practices that can increase confidence in RWE studies. Standardized methodologies specifically adapted for RWE studies collecting pharmacoeconomic data for the management of T2DM could help future reimbursement decision making in this major public health problem.

Type
Assessment
Copyright
Copyright © The Author(s), 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Garrison, LP Jr, Neumann, PJ, Erickson, P, Marshall, D, Mullins, CD. Using real-world data for coverage and payment decisions: The ISPOR Real-World Data Task Force report. Value Health. 2007;10:326–35.CrossRefGoogle ScholarPubMed
Makady, A, de Boer, A, Hillege, H, Klungel, O, Goettsch, W. What is real-world data? A review of definitions based on literature and stakeholder interviews. Value Health. 2017;20:858–65.Google Scholar
Berger, ML, Sox, H, Willke, RJ, Brixner, DL, Eichler, H-G, Goettsch, W, et al. Good practices for real-world data studies of treatment and/or comparative effectiveness: Recommendations from the joint ISPOR-ISPE special task force on real-world evidence in health care decision making. Value Health. 2017;20:1003–08.CrossRefGoogle ScholarPubMed
Greenfield, S. Making real-world evidence more useful for decision making. Value Health. 2017;20:1023–24.CrossRefGoogle ScholarPubMed
Wang, SV, Schneeweiss, S, Berger, ML, Brown, J, de Vries, F, Douglas, I, et al. Reporting to improve reproducibility and facilitate validity assessment for healthcare database studies V1.0. Value Health. 2017;20:1009–22.Google ScholarPubMed
World Health Organization (WHO). Global report on diabetes. Geneva: WHO; 2016.Google Scholar
Sterne, JAC, Hernan, MA, Reeves, BC, Savović, J, Berkman, ND, Viswanathan, M, et al. ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. Br Med J. 2016;355:i4919.CrossRefGoogle ScholarPubMed
Lockwood, C, Sfetcu, R, Oh, EG. Synthesizing quantitative evidence. Lippincott Williams & Wilkins; 2011. Australia: Wolters Kluwer.Google Scholar
McGuinness, LA. robvis: An R package and web application for visualizing risk-of-bias assessments [cited 2020 Apr 26]; 2019. Available from: https://github.com/mcguinlu/robvis.CrossRefGoogle Scholar
Ioannidis, JPA. Why most published research findings are false. PLoS Med. 2005;2:e124.CrossRefGoogle ScholarPubMed
Sherman, RE, Anderson, SA, Dal Pan, GJ, Gray, GW, Gross, T, Hunter, NL, et al. Real-world evidence—what is it and what can it tell us? N Engl J Med. 2016;375:2293–97.CrossRefGoogle ScholarPubMed
Patient-Centered Outcomes Research Institute (PCORI). Methodology standards [cited 2020 Apr 26]; 2019. Available from: https://www.pcori.org/sites/default/files/PCORI-Methodology-Standards.pdf.Google Scholar
Patient-Centered Outcomes Research Institute (PCORI). Our questions, our decisions: standards for patient-centered outcomes research [cited 2020 Apr 26]; 2012. Available from: https://www.pcori.org/assets/Methodology-Report-072312.pdf.Google Scholar
Agency for Healthcare Research and Quality (AHRQ). 21st century patient registries—registries for evaluating patient outcomes: A user's guide 3rd Edition, Addendum [cited 2020 Apr 26]; 2018. Available from: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/registries-guide-3rd-ed-addendum-research-2018-revised_0.pdf.Google Scholar
Berger, ML, Dreyer, N, Anderson, F, Towse, A, Sedrakyan, A, Normand, SL. Prospective observational studies to assess comparative effectiveness: The ISPOR good research practices task force report. Value Health. 2012;15:217–30.Google ScholarPubMed
Agency for Healthcare Research and Quality (AHRQ). Developing a protocol for observational comparative effectiveness research: A user's guide [cited 2020 Apr 26]; 2013. Available from: https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/observational-cer-protocol_research.pdf.Google Scholar
Bell, H, Wailoo, AJ, Hernandez, M, Grieve, R, Faria, R, Gibson, L, et al. The use of real world data for the estimation of treatment effects in NICE decision making [cited 2020 Apr 26]; 2016. Available from: http://nicedsu.org.uk/wp-content/uploads/2018/05/RWD-DSU-REPORT-Updated-DECEMBER-2016.pdf.Google Scholar
International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Guideline index for outcomes research and use in health care decision making [cited 2020 Apr 26]; 2020. Available from: https://www.ispor.org/heor-resources/more-heor-resources/outcomes-research-guidelines-index.Google Scholar
Berger, ML, Martin, BC, Husereau, D, Worley, K, Allen, JD, Yang, W, et al. A questionnaire to assess the relevance and credibility of observational studies to inform health care decision making: An ISPOR-AMCP-NPC Good Practice Task Force report. Value Health. 2014;17:143–56.CrossRefGoogle ScholarPubMed
Supplementary material: File

Lambert-Obry et al. supplementary material

Lambert-Obry et al. supplementary material 1

Download Lambert-Obry et al. supplementary material(File)
File 77.5 KB
Supplementary material: File

Lambert-Obry et al. supplementary material

Lambert-Obry et al. supplementary material 2

Download Lambert-Obry et al. supplementary material(File)
File 77.2 KB
Supplementary material: File

Lambert-Obry et al. supplementary material

Lambert-Obry et al. supplementary material 3

Download Lambert-Obry et al. supplementary material(File)
File 41.1 KB
Supplementary material: Image

Lambert-Obry et al. supplementary material

Lambert-Obry et al. supplementary material 4

Download Lambert-Obry et al. supplementary material(Image)
Image 117.4 KB