The Centers for Disease Control and Prevention (CDC) National Healthcare Safety Network (NHSN) has developed modules for collecting healthcare institutional data on antibiotic use (AU) and antibiotic resistance (AR) across the United States. 1 These data can provide important, actionable feedback to antimicrobial stewardship (AMS) programs. Reference Van Santen, Edwards and Webb2 Specifically, AUR data allow AMS programs to assess the impact of local AMS interventions and to benchmark facility-level antimicrobial consumption and resistance rates for comparison with other US facilities. Increasing the number of hospitals that report to the NHSN AUR modules would improve the quantity and richness of these national data for the benefit of US AMS programs. In a recent report, approximately one-third of hospitals enrolled in the NHSN had reported at least 1 month of AU data. Reference O’Leary, Van Santen and Edwards3,Reference O’Leary, Edwards and Srinivasan4 Although the number of hospitals reporting to AUR modules is increasing, AUR reporting is not yet universal; there are technological challenges associated with AUR participation. Reference Walsh, Hou and Vyas5 Some facilities have encountered these or other barriers in the reporting process. To better understand the experiences of those reporting to the AU and AR modules, we surveyed members of the Society of Infectious Diseases Pharmacists (SIDP) and the Society of Healthcare Epidemiology of America (SHEA) Research Network. The survey objectives were (1) to identify characteristics of US health systems and AMS personnel who report AUR data, (2) to determine how NHSN AUR data are used by health systems, and (3) to identify barriers to AUR reporting.
Methods
This survey was developed by infectious diseases clinicians and academics with input from stewardship practitioners and other relevant stakeholders from SIDP and SHEA. The initial draft was pilot tested by a small group of end users and was updated based on their feedback on clarity, scope, flow, content validity, and response time. The survey was reviewed by the University of Washington Institutional Review Board and was determined to be exempt from federal human-subject research regulations.
This anonymous survey was posted on Survey Monkey from January 21, 2020, to February 21, 2020, and links were e-mailed to SIDP and SHEA Research Network members (https://www.surveymonkey.com/r/WH69HT2). No exclusion criteria were applied. After the initial survey via e-mail, 2 reminder e-mails were sent: one after the first week and another after the third week. Additionally, links to the survey were posted on Twitter by SIDP after the first and third week. The branching logic survey contained 43 elements, and respondents were asked 21–35 questions, depending on their responses. The survey included questions regarding respondent and healthcare facility demographics as well as (1) use of AUR, including how and with what frequency they engage with AUR; (2) perceptions of AUR, including barriers to AUR use and potential solutions to overcome those barriers; and (3) comfort with AUR reporting. Responses were captured using a 4-point Likert scale. Potential barriers included time, salary support, information technology support, perception of benefit, institutional support, confidence in data accuracy and/or integrity, and data privacy concerns to name a few. Data from Survey Monkey were exported to Microsoft Excel (Microsoft, Redmond, WA) and were analyzed in Microsoft Excel, R Studio (R Foundation for Statistical Computing, Vienna, Austria), or GraphPad Prism software (GraphPad, San Diego, CA). Respondent and hospital data were reported as frequencies and percentages. We used the Fisher exact test to compare survey responses between 2 groups (eg, NHSN AUR reporters and nonreporters).
Results
We received responses from 238 individuals across 43 states among 1,218 domestic SIDP and 66 SHEA Research Network members who received the survey (n = 1,284 potential participants), for an 18.5% response rate. Although 238 individuals responded to our survey, not all participants responded to all questions. Respondent demographics are summarized in Table 1 according to AU and AR data submission status. Respondents were primarily pharmacists (84%), from urban areas (44%), from nonprofit medical centers (81%), and from hospitals with >250 beds (72%). Also, 62% reported data to the AU module and 19% reported data to the AR module. The characteristics of AU and AR reporters are described in Table 2. Moreover, 43 respondents (18%) reported to both AU and AR modules, whereas 87 respondents (37%) reported to neither AU nor AR modules. Among the 118 AU and 37 AR reporters who answered questions about software use, 41% of AU reporters and 54% of AR reporters used clinical decision support software (CDSS) to compile data for upload; 54% of AU reporters and 38% of AR reporters used their electronic health record (EHR); and 5% of AU reporters and 8% of AR reporters used another method. Furthermore, 56% of AU reporters and 51% of AR reporters uploaded these data to the NHSN manually. Also, 67.8% of the 118 AU reporters and 52.6% of the 38 AR reporters answered the question about challenges reported previous or ongoing challenges to reporting to either module. Conversely, 23% and 29% responded that reporting to the AU or AR modules was easy. Specifically regarding AU reporting, common challenges included lack of information technology support (reported by 46.2%), lack of time or salary support (reported by 39.9%), and data formatting issues (reported by 33.6%). In AR reporting, common challenges included lack of information technology support (reported by 52.4%), lack of time or salary support (reported by 47.6%), and data formatting issues (reported by 37.4%). Regular use of the NHSN data analysis tools was reported by 36% of those reporting AU data and by 9% of those reporting AR data. However, 96.6% of AU reporters and 82.6% of AR reporters acknowledged some benefit to reporting, such as benchmarking or evaluating stewardship initiatives.
Demographics of Those Reporting and Not Reporting to the Antibiotic Use (AU) Module and the Antibiotic Resistance (AR) Module
Note. CPRS, computerized patient record system; NHSN, National Health Safety Network.
a Percentages do not add to 100% due to multiple selections.
Characteristics of Those Reporting to the Antibiotic Use (AU) Module and the Antibiotic Resistance (AR) Module
Note. ASP, antimicrobial stewardship program; AUR, antibiotic use and resistance; NHSN, National Health Safety Network.
The characteristics and perceptions of AU and AR nonreporters are summarized in Table 3. Among nonreporters, increased institutional pressure to report and local availability of software that streamlines data compilation and submission were the most commonly identified means to increase reporting. The most common barriers to reporting to either the AU or AR modules were related to lack of dedicated information technology support, lack of time or salary support, and data formatting issues. Very few respondents (1.2%) expressed concerns about data privacy or security issues, which accounted for 0.5% of barriers reported. When asked about their experiences, 40% of respondents not reporting to the AU module said that they planned to begin within the next year, compared to only 25% of those not reporting to the AR module. Among nonreporters to AU and AR respectively, 15% and 10% indicated that they were unable to report, and 12% and 5% tried reporting but encountered barriers. Furthermore, >30% of AU nonreporters and >50% of AR nonreporters had not attempted reporting. Only a small number of respondents cited a need for more or better AUR module training than what is currently available to end users from the CDC. 6–8
Perceptions Among Those Who Do Not Report Data to the Antibiotic Use (AU) Module and the Antibiotic Resistance (AR) Module
Note. CDC, Centers for Disease Control and Prevention.
Respondents already using software for local AU or AR tracking were more likely than those not using software for local tracking to report to the AU module (19% vs 64%) and the AR module (2% vs 30%; P < .001 for both).
Discussion
Measuring antimicrobial consumption and antibiotic resistance locally are indispensable to track and tailor AMS programs and are recommended by the CDC core elements of antimicrobial stewardship. Reference Pollack and Srinivasan9 In addition, the NHSN AUR module aggregates data to create benchmarks and to guide a national AMS strategy. 1 Importantly, national data from the CDC Emerging Infection Program were used to help establish national targets to reduce inappropriate antibiotic prescribing. Reference Murray, Hyun and Olshan10,Reference Magill, O’Leary and Ray11 The number of healthcare facilities participating in AUR reporting is increasing. Our results suggest that participation in AU reporting may continue to increase; nearly half of survey respondents not reporting AU data stated that they planned to start submitting data to NHSN AU within the next year. However, only 25% of respondents stated that they were submitting AR data to the NHSN, and of those not reporting AR data, only 25% intended to do so in the next year. This finding may be related to differential access to pharmacotherapeutic data compared with infection prevention and microbiology data by pharmacists, which accounted for 84% of our survey respondents. In our study, a plurality of respondents indicated that pharmacists were responsible for reporting AR data at their institutions, even though AR data are outside the domain of pharmacy information. Collaboration between AMS clinicians and local clinical microbiology and infection prevention partners might facilitate greater participation in AR reporting, or perhaps AR reporting duties should be delegated to the departments that maintain these data. Nevertheless, increasing participation in the NHSN AUR module could advance AMS practices. Trends in antimicrobial resistance, compared to antimicrobial use, are a clearer representation of the importance and the impact of antimicrobial stewardship both among practicing clinicians and the communities in which their institutions reside. In our small study, we were not able to identify significant differences among health systems that report or do not report to the AUR modules with confidence. However, we did uncover 2 main opportunities to increase NHSN AUR participation: information technology or software solutions and increasing local submission expectations or incentives.
Improved information technology for enhancing participation in AUR reporting is somewhat self-evident and has a clear solution. The easier it is for AMS clinicians to submit their data, the more likely they will be to do so. The CDC endorses systematic and standardized AUR data collection practices while advocating for the automation of data submission to minimize time spent on reporting by AMS clinicians. 1 However, technological challenges to AUR participation have been well described. Reference O’Leary, Edwards and Srinivasan4 Given the numerous EHR systems in use within the United States (Table 1), it is not surprising that information technology or software issues were cited by respondents as the largest barrier to NHSN AUR submission. Interestingly, we observed differences in the number of respondents submitting to AUR modules based on the EHR or CDSS used at their facility. Certain EHR or CDSS platforms may interface better with the AUR module than others. It will be important for CDC, AMS clinicians, EHR and CDSS vendors, and other stakeholders to ascertain which aspects of certain EHR or CDSS platforms facilitate better AUR data submission. Very few respondents had concerns with data privacy related to AUR data submission. More than half of those reporting to the AU or AR module manually scheduled their clinical data architecture file (CDA) file uploads, and others used software that automatically compiled and uploaded these files, reducing workload. Manual scheduling of these file uploads adds to the workload for AMS clinicians and may create data integrity issues; thus, the CDC advocates direct data submission. 1 EHR and CDSS software companies and the CDC must collaborate on solutions that allow all AMS clinicians in the United States to compile and submit data to the AUR modules directly. This private–public sector collaboration, or additional federal funding to support the NHSN, would reduce the reporting burden on an already strained AMS workforce and would increase the quantity, richness, and generalizability of AUR data.
The latter opportunity, increasing local submission expectations, is less straightforward. Respondents indicated that added institutional pressure to submit data to the AUR modules would increase their likelihood of submission. Many reported low institutional priority for AUR data submission; particularly for AR data. Thus, increased institutional and organizational expectations for AUR data submission may be needed to increase reporting. Our findings indicate that the implementation of these efforts would be sufficient for many AMS clinicians not currently submitting AUR data. These clinicians are surely advocating for AUR submission at their facility; many respondents reported trying to submit data but then giving up due to submission barriers. A corollary is that the voluntary reporting of medical errors leaves unknown the true number of medical errors in the United States. Reference Meyer12 Efforts are needed by the CDC and other healthcare regulatory bodies (eg, The Joint Commission) that adjudicate whether facilities meet AMS standards to incentivize institutions to submit AUR data. Or perhaps regulatory bodies should require AUR data submission in their AMS standards. The adoption of the National Quality Forum (NQF)–endorsed standardized antimicrobial administration ratio (SAAR) metric from the CDC as a required benchmark for hospitals under the Centers for Medicare & Medicaid Services conditions of participation would likely increase reporting substantially. However, the use of the SAAR as a neutral benchmark and not a specific goal would need to be emphasized, given that this metric does not adjudicate antibiotic appropriateness. Without a multipronged approach to incentivizing healthcare institutions and their leaders to prioritize AUR data submission, it is unlikely to happen. Notably, currently pending legislation may help prioritize AUR data submission for healthcare systems. The DISARM and PASTEUR acts aim to reimburse higher-cost antimicrobials outside the capitated diagnosis-related group (DRG) payment. However, this legislation includes a requirement for eligible hospitals to submit their AUR data to the NHSN. 13 Healthcare facilities can also exert pressure on EHR software providers to help develop solutions for AUR data submission.
A final opportunity may be to increase either the utility or accessibility of AUR analytics tools. Only ∼20% of respondents thought that making the AUR data more useful was an important barrier to AUR reporting. However, regular AUR tool use in the NHSN was reported by only 36% and 9% of those reporting AU and AR data, respectively, indicating that most users have never or have only rarely used these tools. We did not survey respondents in detail regarding their use of these analytics tools, so the best intervention to increase the use of AUR tools remains unclear. But if users valued the tools highly, then they would have greater incentive to report. Perhaps redesigning these analytic tools and/or promoting their utility to current and potential reporters would increase the number of facilities reporting AUR data. One example that surfaced in discussion with current users is that the antibiogram in the NHSN reports shows the percentage resistant rather than the percentage susceptible, which, is an uncommon style of antibiogram reporting and requires transformation to adapt to end-user purposes.
Many of the barriers reported in this survey are outside the control of AMS clinicians. This lack of agency toward something AMS clinicians wish to do may have led to the unfavorable sentiment that many respondents felt toward AUR data submission. Interestingly, those not reporting AU data were less likely to think that their colleagues encountered barriers than those who are active reporters. Our results also indicate that productive conversations and resource sharing among AMS colleagues about NHSN AUR reporting are relatively uncommon.
Our survey is the first to describe AMS clinician use of, perceptions of, and comfort with the NHSN AUR module. Our results offer insights into end-users’ understanding of the AUR modules across a diverse cross section of US health systems, and we have identified clear opportunities to increase the number of facilities that submit data to the AUR modules. More complete AUR data could help propel AMS research, but implementation efforts are needed.
This study had several limitations. The survey had a low response rate, and the proportion of AU responders was much higher than that of AR responders or nonresponders, specifically pharmacists. Our results are mainly descriptive results, based on a small cohort of potential AUR users in the United States. Because we only sampled hospitals affiliated with an SIDP member of the SHEA Research Network, hospitals with less antimicrobial stewardship resources and staff, including critical access and/or rural hospitals, which are probably unlikely to be submitting antibiotic data to the AUR, were likely underrepresented in this study. Despite oversampling those familiar with the intent of AUR and the motivation to submit, we detected substantial discontent and/or disinterest in submitting data to the AUR modules, largely because of the challenges with submission and the perceived limited utility of the data and its tools. Since our survey was conducted, some of the updates to NHSN AUR data visualization tools may have improved the user experience or usefulness of the tools. Thus, future surveys should attempt to secure AUR feedback from all possible users to reflect changes to the platforms. Additionally, future AUR research should include capturing end-user feedback, enhancing adoption of software solutions, and facilitating coordination between end users, healthcare regulatory bodies, and the CDC to set expectations for AUR data submissions. Routine CDC AU and AR module user calls, which create a forum to share experiences between facilities using the product and capture end-user feedback, are in place; however, the perception of respondents was that these opportunities are not used enough and could be bolstered.
In conclusion, our survey results reveal opportunities to increase the number of facilities reporting AUR data to the NHSN. Efforts should focus on finding software solutions and increasing institutional expectations to report these data. Increasing the utility of AUR analytical tools may also incentivize more institutions to participate. The lower rates of AR reporting compared to AU reporting may suggest a need for future interventions specifically targeting the AR module.
Acknowledgments
We thank the SIDP Policy and Government Affairs Committee, the SIDP Board, SIDP members and members of the SHEA research network. We also thank Dr. Kerry LaPlante for her help designing and building the survey instrument.
Financial support
Effort on this project was financially supported by each author’s institution.
Conflicts of interest
The authors have no relevant conflicts of interest to disclose.
Open access
