Skip to main content Accessibility help
×
Home

Validation of an Automated Surveillance Approach for Drain-Related Meningitis: A Multicenter Study

Published online by Cambridge University Press:  05 January 2015


Maaike S. M. van Mourik
Affiliation:
Department of Medical Microbiology, University Medical Center Utrecht, The Netherlands
Annet Troelstra
Affiliation:
Department of Medical Microbiology, University Medical Center Utrecht, The Netherlands
Jan Willem Berkelbach van der Sprenkel
Affiliation:
Department of Neurosurgery, University Medical Center Utrecht, The Netherlands
Marischka C. E. van der Jagt-Zwetsloot
Affiliation:
Department of Hospital Hygiene and Infection Prevention, University Medical Center Utrecht, The Netherlands
Jolande H. Nelson
Affiliation:
Department of Infection Control and Prevention, St. Elisabeth Ziekenhuis, Tilburg, The Netherlands
Piet Vos
Affiliation:
Department of Intensive Care, St. Elisabeth Ziekenhuis, Tilburg, The Netherlands
Mark P. Arts
Affiliation:
Department of Neurosurgery, Medisch Centrum Haaglanden, The Hague, The Netherlands
Paul J. W. Dennesen
Affiliation:
Department of Intensive Care, Medisch Centrum Haaglanden, The Hague, The Netherlands
Karel G. M. Moons
Affiliation:
Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, The Netherlands
Marc J. M. Bonten
Affiliation:
Department of Medical Microbiology, University Medical Center Utrecht, The Netherlands Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, The Netherlands
Corresponding

Abstract

OBJECTIVE

Manual surveillance of healthcare-associated infections is cumbersome and vulnerable to subjective interpretation. Automated systems are under development to improve efficiency and reliability of surveillance, for example by selecting high-risk patients requiring manual chart review. In this study, we aimed to validate a previously developed multivariable prediction modeling approach for detecting drain-related meningitis (DRM) in neurosurgical patients and to assess its merits compared to conventional methods of automated surveillance.

METHODS

Prospective cohort study in 3 hospitals assessing the accuracy and efficiency of 2 automated surveillance methods for detecting DRM, the multivariable prediction model and a classification algorithm, using manual chart review as the reference standard. All 3 methods of surveillance were performed independently. Patients receiving cerebrospinal fluid drains were included (2012–2013), except children, and patients deceased within 24 hours or with pre-existing meningitis. Data required by automated surveillance methods were extracted from routine care clinical data warehouses.

RESULTS

In total, DRM occurred in 37 of 366 external cerebrospinal fluid drainage episodes (12.3/1000 drain days at risk). The multivariable prediction model had good discriminatory power (area under the ROC curve 0.91–1.00 by hospital), had adequate overall calibration, and could identify high-risk patients requiring manual confirmation with 97.3% sensitivity and 52.2% positive predictive value, decreasing the workload for manual surveillance by 81%. The multivariable approach was more efficient than classification algorithms in 2 of 3 hospitals.

CONCLUSIONS

Automated surveillance of DRM using a multivariable prediction model in multiple hospitals considerably reduced the burden for manual chart review at near-perfect sensitivity.

Infect Control Hosp Epidemiol 2015;36(1): 65–75


Type
Original Articles
Copyright
© 2015 by The Society for Healthcare Epidemiology of America. All rights reserved 

Access options

Get access to the full version of this content by using one of the access options below.

References

1.Freeman, R, Moore, LS, Garcia, AL, Charlett, A, Holmes, A. Advances in electronic surveillance for healthcare-associated infections in the 21st century: a systematic review. J Hosp Infect 2013;84:106119.CrossRefGoogle ScholarPubMed
2.van Mourik, MS, Troelstra, A, van Solinge, WW, Moons, KG, Bonten, MJ. Automated surveillance for healthcare-associated infections: opportunities for improvement. Clin Infect Dis 2013;57:8593.CrossRefGoogle Scholar
3.Trick, WE. Decision making during healthcare-associated infection surveillance: a rationale for automation. Clin Infect Dis 2013;57:434440.CrossRefGoogle ScholarPubMed
4.Tokars, JI, Richards, C, Andrus, M, et al. The changing face of surveillance for health care-associated infections. Clin Infect Dis 2004;39:13471352.CrossRefGoogle ScholarPubMed
5.Haley, RW, Culver, DH, White, JW, et al. The efficacy of infection surveillance and control programs in preventing nosocomial infections in US hospitals. Am J Epidemiol 1985;121:182205.CrossRefGoogle ScholarPubMed
6.Haustein, T, Gastmeier, P, Holmes, A, et al. Use of benchmarking and public reporting for infection control in four high-income countries. Lancet Infect Dis 2011;11:471481.CrossRefGoogle ScholarPubMed
7.Geubbels, EL, Nagelkerke, NJ, Mintjes-De Groot, AJ, Vandenbroucke-Grauls, CM, Grobbee, DE, De Boer, AS. Reduced risk of surgical site infections through surveillance in a network. Int J Qual Health Care 2006;18:127133.CrossRefGoogle ScholarPubMed
8.Lin, MY, Hota, B, Khan, YM, et al. Quality of traditional surveillance for public reporting of nosocomial bloodstream infection rates. JAMA 2010;304:20352041.CrossRefGoogle ScholarPubMed
9.Klompas, M. Interobserver variability in ventilator-associated pneumonia surveillance. Am J Infect Control 2010;38:237239.CrossRefGoogle ScholarPubMed
10.Mayer, J, Greene, T, Howell, J, et al. Agreement in classifying bloodstream infections among multiple reviewers conducting surveillance. Clin Infect Dis 2012;55:364370.CrossRefGoogle ScholarPubMed
11.Klompas, M. Eight initiatives that misleadingly lower ventilator-associated pneumonia rates. Am J Infect Control 2012;40:408410.CrossRefGoogle ScholarPubMed
12.Woeltje, KF. Moving into the future: electronic surveillance for healthcare-associated infections. J Hosp Infect 2013;84:103105.CrossRefGoogle ScholarPubMed
13.Klompas, M, Yokoe, DS. Automated surveillance of health care-associated infections. Clin Infect Dis 2009;48:12681275.CrossRefGoogle ScholarPubMed
14.van Mourik, MS, Moons, KG, van Solinge, WW, et al. Automated detection of healthcare associated infections: external validation and updating of a model for surveillance of drain-related meningitis. PLoS ONE 2012;7:e51509.CrossRefGoogle ScholarPubMed
15.Lozier, AP, Sciacca, RR, Romagnoli, MF, Connolly, ES Jr.Ventriculostomy-related infections: a critical review of the literature. Neurosurgery 2002;51:170181.CrossRefGoogle ScholarPubMed
16.Scheithauer, S, Burgel, U, Bickenbach, J, et al. External ventricular and lumbar drainage-associated meningoventriculitis: prospective analysis of time-dependent infection rates and risk factor analysis. Infection 2010;38:205209.CrossRefGoogle ScholarPubMed
17.Lyke, KE, Obasanjo, OO, Williams, MA, O'Brien, M, Chotani, R, Perl, TM. Ventriculitis complicating use of intraventricular catheters in adult neurosurgical patients. Clin Infect Dis 2001;33:20282033.CrossRefGoogle ScholarPubMed
18.Leverstein-Van Hall, MA, Hopmans, TEM, Van Der Sprenkel, JWB, et al. A bundle approach to reduce the incidence of external ventricular and lumbar drain-related infections: Clinical article. J Neurosurg 2010;112:345353.CrossRefGoogle Scholar
19.Horan, TC, Andrus, M, Dudeck, MA. CDC/NHSN surveillance definition of health care-associated infection and criteria for specific types of infections in the acute care setting. Am J Infect Control 2008;36:309332.CrossRefGoogle ScholarPubMed
20.Altman, DG, Vergouwe, Y, Royston, P, Moons, KG. Prognosis and prognostic research: validating a prognostic model. BMJ 2009;338:b605.CrossRefGoogle ScholarPubMed
21.Justice, AC, Covinsky, KE, Berlin, JA. Assessing the generalizability of prognostic information. Ann Intern Med 1999;130:515524.CrossRefGoogle ScholarPubMed
22.ten Berg, MJ, Huisman, A, van den Bemt, PM, Schobben, AF, Egberts, AC, van Solinge, WW. Linking laboratory and medication data: new opportunities for pharmacoepidemiological research. Clin Chem Lab Med 2007;45:1319.CrossRefGoogle ScholarPubMed
23.van Mourik, MS, Groenwold, RH, Berkelbach van der Sprenkel, JW, van Solinge, WW, Troelstra, A, Bonten, MJ. Automated detection of external ventricular and lumbar drain-related meningitis using laboratory and microbiology results and medication data. PLoS One 2011;6:e22846.CrossRefGoogle ScholarPubMed
24.Donders, AR, van der Heijden, GJ, Stijnen, T, Moons, KG. Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 2006;59:10871091.CrossRefGoogle ScholarPubMed
25.Sterne, JA, White, IR, Carlin, JB, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ 2009;338:b2393.CrossRefGoogle ScholarPubMed
26.Steyerberg, EW. Clinical Prediction Models: A practical approach to development, validation, and updating. New York: Springer, 2009.CrossRefGoogle Scholar
27.Keller, SC, Linkin, DR, Fishman, NO, Lautenbach, E. Variations in identification of healthcare-associated infections. Infect Control Hosp Epidemiol 2013;34:678686.CrossRefGoogle ScholarPubMed
28.Dixon-Woods, M, Leslie, M, Bion, J, Tarrant, C. What counts? An ethnographic study of infection data reported to a patient safety program. Milbank Q 2012;90:548591.CrossRefGoogle ScholarPubMed
29.Trick, WE. Building a data warehouse for infection control. Am J Infect Control 2008;36:S75S81.CrossRefGoogle Scholar
30.Tejedor, SC, Garrett, G, Jacob, JT, et al. Electronic documentation of central venous catheter-days: validation is essential. Infect Control Hosp Epidemiol 2013;34:900907.CrossRefGoogle ScholarPubMed
31.Wright, MO, Fisher, A, John, M, Reynolds, K, Peterson, LR, Robicsek, A. The electronic medical record as a tool for infection surveillance: successful automation of device-days. Am J Infect Control 2009;37:364370.CrossRefGoogle ScholarPubMed
32.Janssen, KJ, Vergouwe, Y, Donders, AR, et al. Dealing with missing predictor values when applying clinical prediction models. Clin Chem 2009;55:9941001.CrossRefGoogle ScholarPubMed
33.Lin, MY, Bonten, MJ. The Dilemma of Assessment Bias in Infection Control Research. Clin Infect Dis 2012;54:13421347.CrossRefGoogle ScholarPubMed
34.De Bruin, JS, Blacky, A, Koller, W, Adlassnig, KP. Validation of fuzzy sets in an automated detection system for intensive-care-unit-acquired central-venous-catheter-related infections. Stud Health Technol Inform 2013;192:215218.Google Scholar

Altmetric attention score


Full text views

Full text views reflects PDF downloads, PDFs sent to Google Drive, Dropbox and Kindle and HTML full text views.

Total number of HTML views: 4
Total number of PDF views: 70 *
View data table for this chart

* Views captured on Cambridge Core between September 2016 - 4th December 2020. This data will be updated every 24 hours.

Hostname: page-component-b4dcdd7-xrv4g Total loading time: 14.148 Render date: 2020-12-04T18:36:48.436Z Query parameters: { "hasAccess": "0", "openAccess": "0", "isLogged": "0", "lang": "en" } Feature Flags last update: Fri Dec 04 2020 17:59:48 GMT+0000 (Coordinated Universal Time) Feature Flags: { "metrics": true, "metricsAbstractViews": false, "peerReview": true, "crossMark": true, "comments": true, "relatedCommentaries": true, "subject": true, "clr": false, "languageSwitch": true }

Send article to Kindle

To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Validation of an Automated Surveillance Approach for Drain-Related Meningitis: A Multicenter Study
Available formats
×

Send article to Dropbox

To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

Validation of an Automated Surveillance Approach for Drain-Related Meningitis: A Multicenter Study
Available formats
×

Send article to Google Drive

To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

Validation of an Automated Surveillance Approach for Drain-Related Meningitis: A Multicenter Study
Available formats
×
×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *