Hostname: page-component-848d4c4894-wg55d Total loading time: 0 Render date: 2024-05-31T11:17:58.431Z Has data issue: false hasContentIssue false
  • English
  • Français

Multicenter Evaluation of Computer Automated versus Traditional Surveillance of Hospital-Acquired Bloodstream Infections

Published online by Cambridge University Press:  10 May 2016

Michael Y. Lin ,
Keith F. Woeltje ,
Yosef M. Khan ,
Bala Hota ,
Joshua A. Doherty ,
Tara B. Borlawsky ,
Kurt B. Stevenson ,
Scott K. Fridkin ,
Robert A. Weinstein  and
William E. Trick
Michael Y. Lin*
Affiliation:
Department of Medicine, Rush University Medical Center, Chicago, Illinois
Keith F. Woeltje
Affiliation:
Department of Medicine, Washington University School of Medicine, St Louis, Missouri
Yosef M. Khan
Affiliation:
Department of Medicine, Ohio State University Medical Center, Columbus, Ohio Present affiliation: Division of Quality and Health Information Technology, American Heart Association–National Center, Dallas Texas
Bala Hota
Affiliation:
Department of Medicine, Rush University Medical Center, Chicago, Illinois Department of Medicine, Cook County Health and Hospitals System, Chicago, Illinois
Joshua A. Doherty
Affiliation:
Department of Medicine, Washington University School of Medicine, St Louis, Missouri
Tara B. Borlawsky
Affiliation:
Department of Medicine, Ohio State University Medical Center, Columbus, Ohio
Kurt B. Stevenson
Affiliation:
Department of Medicine, Ohio State University Medical Center, Columbus, Ohio
Scott K. Fridkin
Affiliation:
Centers for Disease Control and Prevention, Atlanta, Georgia
Robert A. Weinstein
Affiliation:
Department of Medicine, Rush University Medical Center, Chicago, Illinois Department of Medicine, Cook County Health and Hospitals System, Chicago, Illinois
William E. Trick
Affiliation:
Department of Medicine, Rush University Medical Center, Chicago, Illinois Department of Medicine, Cook County Health and Hospitals System, Chicago, Illinois
*
600 South Paulina Street, Suite 143, Chicago, IL 60612 (michael_lin@rush.edu).
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective.

Central line–associated bloodstream infection (BSI) rates are a key quality metric for comparing hospital quality and safety. Traditional BSI surveillance may be limited by interrater variability. We assessed whether a computer-automated method of central line–associated BSI detection can improve the validity of surveillance.

Design.

Retrospective cohort study.

Setting.

Eight medical and surgical intensive care units (ICUs) in 4 academic medical centers.

Methods.

Traditional surveillance (by hospital staff) and computer algorithm surveillance were each compared against a retrospective audit review using a random sample of blood culture episodes during the period 2004–2007 from which an organism was recovered. Episode-level agreement with audit review was measured with κ statistics, and differences were assessed using the test of equal κ coefficients. Linear regression was used to assess the relationship between surveillance performance (κ) and surveillance-reported BSI rates (BSIs per 1,000 central line–days).

Results.

We evaluated 664 blood culture episodes. Agreement with audit review was significantly lower for traditional surveillance (κ [95% confidence interval (CI)] = 0.44 [0.37–0.51]) than computer algorithm surveillance (κ [95% CI] [0.52–0.64]; P = .001). Agreement between traditional surveillance and audit review was heterogeneous across ICUs (P = .001); furthermore, traditional surveillance performed worse among ICUs reporting lower (better) BSI rates (P = .001). In contrast, computer algorithm performance was consistent across ICUs and across the range of computer-reported central line–associated BSI rates.

Conclusions.

Compared with traditional surveillance of bloodstream infections, computer automated surveillance improves accuracy and reliability, making interfacility performance comparisons more valid.

Infect Control Hosp Epidemiol 2014;35(12):1483–1490

Type
Original Article
Information
Infection Control & Hospital Epidemiology , Volume 35 , Issue 12 , December 2014 , pp. 1483 - 1490
Copyright
© 2014 by The Society for Healthcare Epidemiology of America. All rights reserved.

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1. Pronovost, P, Needham, D, Berenholtz, S, et al. An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med 2006;355(26):2725–2732.Google Scholar
2. Klevens, RM, Edwards, JR, Richards, CL Jr, et al. Estimating health care-associated infections and deaths in U.S. hospitals, 2002. Public Health Rep 2007;122(2):160–166.CrossRefGoogle ScholarPubMed
3. Kahn, KL, Weinberg, DA, Leuschner, KJ, Gall, EM, Siegel, S, Mendel, P. The national response for preventing healthcare-associated infections: data and monitoring. Med Care 2014;52(2 suppl 1):S25–S32.Google Scholar
4. Centers for Medicare and Medicaid Services (CMS) Media Relations (press release). CMS gives consumers access to more details about infection rates at America’s hospitals. Baltimore, MD: CMS, 2012. http://www.cms.gov/Newsroom/MediaReleaseDatabase/Press-releases/2012-Press-releases-items/2012-02-07.html. Accessed February 25, 2014.Google Scholar
5. Medicare program; hospital inpatient prospective payment systems for acute care hospitals and the long-term care hospital prospective payment system and fiscal year 2014 rates; quality reporting requirements for specific providers; hospital conditions of participation; payment policies related to patient status. Fed Regist 2013;78:50495.Google Scholar
6. Centers for Disease Control and Prevention. National Healthcare Safety Network (NHSN) Manual, Patient Safety Component Protocol. Atlanta, GA: Division of Healthcare Quality Promotion, Centers for Disease Control and Prevention, 2008:13.Google Scholar
7. Mayer, J, Greene, T, Howell, J, et al. Agreement in classifying bloodstream infections among multiple reviewers conducting surveillance. Clin Infect Dis 2012;55(3):364–370.CrossRefGoogle ScholarPubMed
8. McBryde, ES, Brett, J, Russo, PL, Worth, LJ, Bull, AL, Richards, MJ. Validation of statewide surveillance system data on central line–associated bloodstream infection in intensive care units in Australia. Infect Control Hosp Epidemiol 2009;30(11):1045–1049.CrossRefGoogle ScholarPubMed
9. Lin, MY, Hota, B, Khan, YM, et al. Quality of traditional surveillance for public reporting of nosocomial bloodstream infection rates. JAMA 2010;304(18):2035–2041.CrossRefGoogle ScholarPubMed
10. Centers for Disease Control and Prevention. National Healthcare Safety Network (NHSN) validation guidance and toolkit 2012: validation for central line–associated bloodstream infection (CLABSI) in ICUs. http://www.cdc.gov/nhsn/toolkit/validation-clabsi/index.html. Accessed February 25, 2014.Google Scholar
11. Hota, B, Lin, M, Doherty, JA, et al. Formulation of a model for automating infection surveillance: algorithmic detection of central-line associated bloodstream infection. J Am Med Inform Assoc 2010;17(1):42–48.Google Scholar
12. Rubin, MA, Mayer, J, Greene, T, et al. An agent-based model for evaluating surveillance methods for catheter-related bloodstream infection. AMIA Annu Symp Proc 2008:631–635.Google Scholar
13. Trick, WE, Zagorski, BM, Tokars, JI, et al. Computer algorithms to detect bloodstream infections. Emerg Infect Dis 2004;10(9):1612–1620.CrossRefGoogle ScholarPubMed
14. Worth, LJ, Brett, J, Bull, AL, McBryde, ES, Russo, PL, Richards, MJ. Impact of revising the National Nosocomial Infection Surveillance System definition for catheter-related bloodstream infection in ICU: reproducibility of the National Healthcare Safety Network case definition in an Australian cohort of infection control professionals. Am J Infect Control 2009;37(8):643–648.Google Scholar
15. Stone, PW, Dick, A, Pogorzelska, M, Horan, TC, Furuya, EY, Larson, E. Staffing and structure of infection prevention and control programs. Am J Infect Control 2009;37(5):351–357.Google Scholar
16. Dixon-Woods, M, Leslie, M, Bion, J, Tarrant, C. What counts? an ethnographic study of infection data reported to a patient safety program. Milbank Q 2012;90(3):548–591.Google Scholar
17. Fraser, TG, Gordon, SM. CLABSI rates in immunocompromised patients: a valuable patient centered outcome? Clin Infect Dis 2011;52(12):1446–1450.Google Scholar
18. Backman, LA, Melchreit, R, Rodriguez, R. Validation of the surveillance and reporting of central line–associated bloodstream infection data to a state health department. Am J Infect Control 2010;38(10):832–838.Google Scholar
19. Sexton, DJ, Chen, LF, Anderson, DJ. Current definitions of central line–associated bloodstream infection: is the emperor wearing clothes? Infect Control Hosp Epidemiol 2010;31(12):1286–1289.Google Scholar
20. Fridkin, SK, Olmsted, RN. Meaningful measure of performance: a foundation built on valid, reproducible findings from surveillance of health care-associated infections. Am J Infect Control 2011;39(2):87–90.Google Scholar
21. Kainer, M, Mitchell, J, Frost, B, Soe, M. Validation of central line associated bloodstream Infection data submitted to the National Healthcare Safety Network—a pilot study by the Tennessee Department of Health. In: Program and abstracts of Fifth Decennial International Conference on Healthcare-Associated Infections. Atlanta, GA: Centers for Disease Control and Prevention, 2010.Google Scholar
22. Woeltje, K, McMullen, K, Butler, AM, Goris, A, Doherty, J. Electronic surveillance for healthcare-associated central line–associated bloodstream infections outside the intensive care unit. Infect Control Hospital Epidemiol 2011;32(11):1086–1090.CrossRefGoogle ScholarPubMed
23. Grove, WM, Zald, DH, Lebow, BS, Snitz, BE, Nelson, C. Clinical versus mechanical prediction: a meta-analysis. Psychol Assess 2000;12:19–30.Google Scholar
24. Wright, MO, Fisher, A, John, M, Reynolds, K, Peterson, LR, Robicsek, A. The electronic medical record as a tool for infection surveillance: successful automation of device-days. Am J Infect Control 2009;37(5):364–370.Google Scholar
25. National Healthcare Safety Network. Central line–associated bloodstream infection (CLABSI) event. 2013. http://www.cdc.gov/nhsn/PDFs/pscManual/4PSC_CLABScurrent.pdf. Accessed May 6, 2013.Google Scholar