Hostname: page-component-848d4c4894-p2v8j Total loading time: 0.001 Render date: 2024-06-01T06:21:06.026Z Has data issue: false hasContentIssue false
  • English
  • Français

Validation of the SHEA/IDSA severity criteria to predict poor outcomes among inpatients and outpatients with Clostridioides difficile infection

Published online by Cambridge University Press:  30 January 2020

Vanessa W. Stevens Open the ORCID record for Vanessa W. Stevens [Opens in a new window] ,
Holly E. Shoemaker ,
Makoto M. Jones ,
Barbara E. Jones ,
Richard E. Nelson ,
Karim Khader ,
Matthew H. Samore  and
Michael A. Rubin
Vanessa W. Stevens*
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Division of Epidemiology, Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah
Holly E. Shoemaker
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Department of Population Health Sciences, University of Utah School of Medicine, Salt Lake City, Utah
Makoto M. Jones
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Division of Epidemiology, Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah
Barbara E. Jones
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Division of Pulmonary Medicine, Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah
Richard E. Nelson
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Division of Epidemiology, Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah
Karim Khader
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Division of Epidemiology, Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah
Matthew H. Samore
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Division of Epidemiology, Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah
Michael A. Rubin
Affiliation:
IDEAS Center of Innovation, Veterans’ Affairs Salt Lake City Health Care System, Salt Lake City, Utah Division of Epidemiology, Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah
*
Author for correspondence: Vanessa Stevens, PhD, 500 Foothill Drive, Salt Lake City, UT 84148. E-mail: vanessa.stevens@hsc.utah.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective:

To determine whether the Society for Healthcare Epidemiology of America (SHEA) and the Infectious Diseases Society of America (IDSA) Clostridioides difficile infection (CDI) severity criteria adequately predicts poor outcomes.

Design:

Retrospective validation study.

Setting and participants:

Patients with CDI in the Veterans’ Affairs Health System from January 1, 2006, to December 31, 2016.

Methods:

For the 2010 criteria, patients with leukocytosis or a serum creatinine (SCr) value ≥1.5 times the baseline were classified as severe. For the 2018 criteria, patients with leukocytosis or a SCr value ≥1.5 mg/dL were classified as severe. Poor outcomes were defined as hospital or intensive care admission within 7 days of diagnosis, colectomy within 14 days, or 30-day all-cause mortality; they were modeled as a function of the 2010 and 2018 criteria separately using logistic regression.

Results:

We analyzed data from 86,112 episodes of CDI. Severity was unclassifiable in a large proportion of episodes diagnosed in subacute care (2010, 58.8%; 2018, 49.2%). Sensitivity ranged from 0.48 for subacute care using 2010 criteria to 0.73 for acute care using 2018 criteria. Areas under the curve were poor and similar (0.60 for subacute care and 0.57 for acute care) for both versions, but negative predictive values were >0.80.

Conclusions:

Model performances across care settings and criteria versions were generally poor but had reasonably high negative predictive value. Many patients in the subacute-care setting, an increasing fraction of CDI cases, could not be classified. More work is needed to develop criteria to identify patients at risk of poor outcomes.

Type
Original Article
Information
Infection Control & Hospital Epidemiology , Volume 41 , Issue 5 , May 2020 , pp. 510 - 516
Creative Commons
Creative Common License - CCCreative Common License - BY
This work is classified, for copyright purposes, as a work of the U.S. Government and is not subject to copyright protection within the United States.
Copyright
© 2020 by The Society for Healthcare Epidemiology of America. All rights reserved

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

PREVIOUS PRESENTATION: Selected results from this manuscript were presented as a poster at IDWeek 2018 on October 4, 2018, in San Francisco, California.

References

Miller, BA, Chen, LF, Sexton, DJ, Anderson, DJ. Comparison of the burdens of hospital-onset, healthcare facility–associated Clostridium difficile infection and of healthcare-associated infection due to methicillin-resistant Staphylococcus aureus in community hospitals. Infect Control Hosp Epidemiol 2011;32:387–390.CrossRefGoogle ScholarPubMed
Dubberke, ER, Olsen, MA. Burden of Clostridium difficile on the healthcare system. Clin Infect Dis 2012;55:S88–S92.CrossRefGoogle ScholarPubMed
Lessa, FC, Winston, LG, McDonald, LC. Burden of Clostridium difficile infection in the United States. N Engl J Med 2015;372:2369–2370.CrossRefGoogle ScholarPubMed
Antibiotic resistance threats in the United States. Centers for Disease Control and Prevention website. https://www.cdc.gov/drugresistance/pdf/ar-threats-2013-508.pdf. Published 2013. Accessed January 14, 2020.Google Scholar
Ma, GK, Brensinger, CM, Wu, Q, Lewis, JD. Increasing incidence of multiply recurrent Clostridium difficile infection in the United States. Ann Intern Med 2017;167:152.CrossRefGoogle ScholarPubMed
Zilberberg, MD, Shorr, AF, Kollef, MH. Increase in adult Clostridium difficile–related hospitalizations and case-fatality rate, United States, 2000–2005. Emerg Infect Dis 2008;14:929–931.CrossRefGoogle ScholarPubMed
Pépin, J, Alary, M-E, Valiquette, L, et al. Increasing risk of relapse after treatment of Clostridium difficile colitis in Quebec, Canada. Clin Infect Dis 2005;40:1591–1597.CrossRefGoogle ScholarPubMed
Pépin, J, Saheb, N, Coulombe, M, et al. Emergence of fluoroquinolones as the predominant risk factor for Clostridium difficile–associated diarrhea: a cohort study during an epidemic in Quebec. Clin Infect Dis 2005;41:1254–1260.CrossRefGoogle ScholarPubMed
Guillemin, I, Marrel, A, Lambert, J, et al. Patients’ experience and perception of hospital-treated Clostridium difficile infections: a qualitative study. Patient 2014;7:97–105.CrossRefGoogle ScholarPubMed
Heinrich, K, Harnett, J, Vietri, J, Chambers, R, Yu, H, Zilberberg, M. Impaired quality of life, work, and activities among adults with Clostridium difficile infection: a multinational survey. Dig Dis Sci 2018;63:2864–2873.CrossRefGoogle ScholarPubMed
Zhang, D, Prabhu, VS, Marcella, SW. Attributable healthcare resource utilization and costs for patients with primary and recurrent Clostridium difficile infection in the United States. Clin Infect Dis 2018;66:1326–1332.CrossRefGoogle ScholarPubMed
Reilly, BM, Evans, AT. Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med 2006;144:201.CrossRefGoogle ScholarPubMed
Cohen, SH, Gerding, DN, Johnson, S, et al. Clinical practice guidelines for Clostridium difficile infection in adults: 2010 update by the Society for Healthcare Epidemiology of America (SHEA) and the Infectious Diseases Society of America (IDSA). Infect Control Hosp Epidemiol 2010;31:431–455.CrossRefGoogle Scholar
McDonald, LC, Gerding, DN, Johnson, S, et al. Clinical practice guidelines for Clostridium difficile infection in adults and children: 2017 update by the Infectious Diseases Society of America (IDSA) and Society for Healthcare Epidemiology of America (SHEA). Clin Infect Dis 2018;66(7):e1–e48.CrossRefGoogle Scholar
Reveles, KR, Pugh, MJV, Lawson, KA, et al. Shift to community-onset Clostridium difficile infection in the national Veterans’ Health Administration, 2003–2014. Am J Infect Control 2018;46:431–435.CrossRefGoogle Scholar
Russo, EM, Kuntz, J, Yu, H, et al. Incidence of Clostridioides difficile infections among young and middle-aged adults: Veteran’s Health Administration. Infect Control Hosp Epidemiol 2019;40:997–1005.CrossRefGoogle Scholar
McDonald, LC, Coignard, B, Dubberke, E, et al. Recommendations for surveillance of Clostridium difficile–associated disease. Infect Control Hosp Epidemiol 2007;28:140–145.CrossRefGoogle ScholarPubMed
Stevens, VW, Nelson, RE, Schwab-Daugherty, EM, et al. Comparative effectiveness of vancomycin and metronidazole for the prevention of recurrence and death in patients with clostridium difficile infection. JAMA Intern Med 2017;177:546–553.CrossRefGoogle ScholarPubMed
Chitnis, AS, Holzbauer, SM, Belflower, RM, et al. Epidemiology of community-associated Clostridium difficile infection, 2009 through 2011. JAMA Intern Med 2013;173:1359.CrossRefGoogle ScholarPubMed
Khanna, S, Pardi, DS, Aronson, SL, Kammer, PP, Baddour, LM. Outcomes in community-acquired Clostridium difficile infection. Aliment Pharmacol Ther 2012;35:613–618.CrossRefGoogle ScholarPubMed
Wenisch, JM, Schmid, D, Kuo, H-W, et al. Hospital-acquired Clostridium difficile infection: determinants for severe disease. Eur J Clin Microbiol Infect Dis 2012;31:1923–1930.CrossRefGoogle ScholarPubMed
Steyerberg, EW, Vickers, AJ, Cook, NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010;21:128–138.CrossRefGoogle ScholarPubMed
Steyerberg, EW, Uno, H, Ioannidis, JPA, et al. Poor performance of clinical prediction models: the harm of commonly applied methods. J Clin Epidemiol. 2018;98:133–143.CrossRefGoogle ScholarPubMed
Collins, GS, Ogundimu, EO, Cook, JA, Manach, YL, Altman, DG. Quantifying the impact of different approaches for handling continuous predictors on the performance of a prognostic model. Stat Med 2016;35:4124–4135.CrossRefGoogle ScholarPubMed
Kundu, S, Aulchenko, YS, van Duijn, CM, Janssens, ACJW. PredictABEL: an R package for the assessment of risk prediction models. Eur J Epidemiol 2011;26:261–264.CrossRefGoogle Scholar
Fabre, V, Dzintars, K, Avdic, E, Cosgrove, SE. Role of metronidazole in mild Clostridium difficile infections. Clin Infect Dis 2018;67:1956–1958.Google ScholarPubMed
McDonald, LC, Johnson, S, Bakken, JS, Garey, KW, Kelly, C, Gerding, DN. Reply to Fabre et al. Clin Infect Dis 2018;67:1958–1959.Google ScholarPubMed
Appaneal, HJ, Caffrey, AR, LaPlante, KL. What is the role for metronidazole in the treatment of Clostridium difficile infection? Results from a national cohort study of veterans with initial mild disease. Clin Infect Dis 2019;69:1288–1295.CrossRefGoogle ScholarPubMed
Kassam, Z, Cribb Fabersunne, C, Smith, MB, et al. Clostridium difficile–associated risk of death score (CARDS): a novel severity score to predict mortality among hospitalised patients with C. difficile infection. Aliment Pharmacol Ther 2016;43:725–733.CrossRefGoogle ScholarPubMed
Arora, V, Kachroo, S, Ghantoji, SS, DuPont, HL, Garey, KW. High Horn’s index score predicts poor outcomes in patients with Clostridium difficile infection. J Hosp Infect 2011;79:23–26.CrossRefGoogle ScholarPubMed
Lungulescu, OA, Cao, W, Gatskevich, E, Tlhabano, L, Stratidis, JG. CSI: a severity index for Clostridium difficile infection at the time of admission. J Hosp Infect 2011;79:151–154.CrossRefGoogle ScholarPubMed
Fujitani, S, George, WL, Murthy, AR. Comparison of clinical severity score indices for Clostridium difficile infection. Infect Control Hosp Epidemiol 2011;32:220–228.CrossRefGoogle ScholarPubMed
Velazquez-Gomez, I, Rocha-Rodriguez, R, Toro, DH, Gutierrez-Nuñez, JJ, Gonzalez, G, Saavedra, S. A severity score index for Clostridium difficile infection. Infect Dis Clin Pract 2008;16:376–378.CrossRefGoogle Scholar
Miller, MA, Louie, T, Mullane, K, et al. Derivation and validation of a simple clinical bedside score (ATLAS) for Clostridium difficile infection which predicts response to therapy. BMC Infect Dis 2013;13:148.CrossRefGoogle ScholarPubMed
Welfare, MR, Lalayiannis, LC, Martin, KE, Corbett, S, Marshall, B, Sarma, JB. Comorbidities as predictors of mortality in Clostridium difficile infection and derivation of the ARC predictive score. J Hosp Infect 2011;79:359–363.CrossRefGoogle ScholarPubMed
Khan, A, Elashery, A, Kapadia, S, Chandra, S. Performance of severity of illness classification for Clostridium difficile infection to predict need-for-colectomy or inpatient death. J Community Hosp Intern Med Perspect 2014;4(3). doi: 10.3402/jchimp.v4.24711.Google ScholarPubMed
Li, BY, Oh, J, Young, VB, Rao, K, Wiens, J. Using machine learning and the electronic health record to predict complicated Clostridium difficile infection. Open Forum Infect Dis 2019;6(5):ofz186. doi: 10.1093/ofid/ofz186.CrossRefGoogle ScholarPubMed
Gomez-Simmonds, A, Kubin, CJ, Furuya, EY. Comparison of 3 severity criteria for Clostridium difficile infection. Infect Control Hosp Epidemiol 2014;35:196–199.CrossRefGoogle ScholarPubMed
Mulherin, DW, Hutchison, AM, Thomas, GJ, Hansen, RA, Childress, DT. Concordance of the SHEA-IDSA severity classification for Clostridium difficile infection and the ATLAS bedside scoring system in hospitalized adult patients. Infection 2014;42:999–1005.CrossRefGoogle ScholarPubMed
Chiang, H-Y, Huang, H-C, Chung, C-W, et al. Risk prediction for 30-day mortality among patients with Clostridium difficile infections: a retrospective cohort study. Antimicrob Resist Infect Control 2019;8:175.CrossRefGoogle ScholarPubMed
Patel, I, Wungjiranirun, M, Theethira, T, et al. Lack of adherence to SHEA-IDSA treatment guidelines for Clostridium difficile infection is associated with increased mortality. J Antimicrob Chemother 2017;72:574–581.CrossRefGoogle ScholarPubMed
Crowell, KT, Julian, KG, Katzman, M, et al. Compliance with Clostridium difficile treatment guidelines: effect on patient outcomes. Epidemiol Infect 2017;145:2185–2192.CrossRefGoogle ScholarPubMed
Caetano, SJ, Sonpavde, G, Pond, GR. C-statistic: a brief explanation of its construction, interpretation and limitations. Eur J Cancer 2018;90:130–132.CrossRefGoogle ScholarPubMed
Brehaut, JC, Graham, ID, Wood, TJ, et al. Measuring acceptability of clinical decision rules: validation of the ottawa acceptability of decision rules instrument (OADRI) in four countries. Med Decis Making 2010;30:398–408.CrossRefGoogle ScholarPubMed
Evans, ME, Kralovic, SM, Simbartl, LA, Jain, R, Roselle, GA. Effect of a Clostridium difficile infection prevention initiative in Veterans’ Affairs acute-care facilities. Infect Control Hosp Epidemiol 2016;37:720–722.CrossRefGoogle Scholar
Reeves, JS, Evans, ME, Simbartl, LA, et al. Clostridium difficile infections in Veterans’ Health Administration long-term care facilities. Infect Control Hosp Epidemiol 2015;37:295–300.CrossRefGoogle Scholar
Supplementary material: File

Stevens et al. supplementary material

Stevens et al. supplementary material

Download Stevens et al. supplementary material(File)
File