Background
Excessive medical radiation in the USA, particularly to children, was highlighted in 2001 [Reference Mettler, Wiest, Locken and Kelsey1,Reference Wiest, Locken, Heintz and Mettler2]. Between 1998 and 2005, Computerized Tomography (CT) scan utilization grew at a rate of 10% annually [Reference Mettler, Wiest, Locken and Kelsey1,Reference Fernandes, Levin, Miller, Schoenfeld and Amis3–Reference Schauer and Linton5]. Among children, the rise in CT utilization was due to CT scan diagnostic efficacy, increased traumatic brain injury awareness, increased Emergency Department (ED) visits particularly following sports injuries, and patient/provider demand [Reference Griffey and Sodickson4,Reference Chong, Grant, Ahmed, Thomas, Connolly and Greenberg6]. Great strides have been made since the Alliance for Radiation Safety in Pediatric Imaging (The Alliance) made radiation safety a priority for children [Reference Palmer7,Reference Goske, Applegate and Bell8]. The Alliance created adult and pediatric radiation protocols through collaboration with government, non-governmental agencies, vendors, and manufacturers of CT equipment [Reference Palmer7].
The American Association of Physicists in Medicine (AAPM) Task Group designed the national guidelines on radiopharmaceutical dose for children [Reference Schauer and Linton5]. Children’s hospitals including pediatric trauma centers (PTCs) have adopted the pediatric CT scan protocols using minimal radiation doses with optimal image quality [Reference Nabaweesi, Ramakrishnaiah and Aitken9–Reference Nabaweesi, Ramakrishnaiah and Rettiganti12]. However, 90% of pediatric emergency room CT scans are done in adult-focused hospitals [Reference Graves, Kanal, Vavilala, Applegate, Jarvik and Rivara13,Reference Kharbanda, Flood, Blumberg and Kreykes14]. Hospitals, especially those in the poor rural states, may not have the financial resources to update their CT scan equipment on a regular enough basis to keep up with manufacturers’ updates on in-built protocols and optimal functioning. Additionally, there is a lack of standardized CT equipment nomenclature used by radiologists, physicists, and CT manufacturers [Reference Goske, Applegate and Bulas15].
External change agents, such as Agency for Healthcare Research and Quality and Institute for Healthcare Improvement, may be effective at introducing innovation into healthcare systems to produce desirable, direct, and anticipated quality improvement [Reference Alagoz, Chih, Hitchcock, Brown and Quanbeck16]. These external change agents can play an essential role in healthcare organizational change efforts particularly in multifaceted interventions. One such agent in our state is AFMC, a not-for-profit organization whose mission is to help healthcare providers deliver the best quality of care at the lowest cost and empower patients to take control of their (families’) health.
Intervention
In 2013, AFMC conducted a statewide educational campaign targeting CT scan utilization across all Arkansas EDs including the Arkansas Trauma System. Improvement team (advisors) conducted outreach visits to EDs using CT scan educational brochures [Reference Golden17] to promote CT scan appropriateness guidelines set by the American College of Emergency Physicians (ACEP), the American College of Radiology (ACR), and the Joint Commission. ED providers (faculty and staff) were educated on appropriate CT imaging utilization to reduce unnecessary medical radiation exposure, especially to children. The imaging protocol focused on radiation exposure awareness, cumulative radiation dose, and patients’ rights of imaging [Reference Griffey and Sodickson4,Reference Boutis, Fischer, Freedman and Thomas18,Reference Brenner and Hall19]. Additionally, AFMC outreach staff educated providers about following recommendations: (i) routinely check medical records for previous imaging studies; (ii) routinely question patients about other imaging workups; and (iii) remember radiation dose is cumulative, given that significant radiation doses to children are associated with an increased lifetime risk of cancer [Reference Golden17]. ED providers were educated about the five patients’ rights of imaging: (1) the right study; (2) the right order; (3) the right way; with (4) the right report; and (5) the right action. The patients’ rights incorporate the concepts of image overuse, underuse, and misuse. Implementation of patients’ rights is a difficult, complicated task that requires communication, cooperation, and collaboration among ED physicians, radiologists, radiology technologists, physicists, and trauma surgeons.
AFMC Quality Improvement team used CT scan practice guidelines from Joint Commission, American College of Radiology and the FDA to develop laminated brochures describing appropriate CT scan use, procedures to avoid unnecessary CT scans and radiation, and the risks associated with over use for providers. A variation of laminated patient CT educational brochures was availed to EDs for patient education and distribution using teach back. Patient families were also educated about the importance of providing imaging history to minimize cumulative radiation risk for cancer. Clinician providers were educated about strategies for CT scan utilization success using CT scan protocols developed by the American College of Radiology, ACEP, and Joint Commission. The protocol guidelines are summarized in Table 1.
Summary of CT scan guidelines clinicians received during educational campaign
The goal of this study is to determine the impact of this statewide CT scan educational campaign conducted to educate clinician providers about appropriate CT scan utilization, cumulative radiation risk, and the importance of eliciting imaging history. We studied CT scans’ effective radiation dose (ERD) and repeat rates among injured children transferred to a level I PTC before and after educational campaign.
Methods
Data Sources
We used a data set compiled for our two previous publications evaluating the impact of a Web-Based Image repository and comparing the ERD that children received at PTC vs adult trauma centers (ATCs). We conducted a cross-sectional study using administrative data from the pediatric trauma registry and clinical data from the Picture Archiving Communication System (PACS). All children who met the state trauma system’s definition of a traumatic injury (trauma team activation, penetrating injuries, and ED deaths) were included in the registry. The only Level I PTC in the state houses the trauma registry. The PTC receives injured children from 64 accredited trauma system facilities that utilize a centralized web-based image repository. A dedicated trauma team manages the pediatric trauma registry to ensure timeliness, accuracy, and data completeness.
The Arkansas state trauma system is composed of trauma enters, the trauma call center, and the Trauma Advisory Council. At baseline, there were 64 trauma centers, 6 of these were level Is, 5 level IIs, 18 Level IIIs, and 35 level IVs [Reference Graves, Kanal, Vavilala, Applegate, Jarvik and Rivara13], serving 62 EDs. The system includes two PTCs and one burn center. As of March 12, 2019, our trauma system composed of 56 trauma centers, two level Is, five level IIs, sixteen level IIIs, and thirty-three level IVs. Four out of state, level I trauma centers were excluded from this analysis. Since 2015 (post-campaign period), we have had more hospitals receive the state’s trauma designation including, one level II, two level IIIs, and 8 level IVs.
Patient and Variable Selection
All injured children under 17 years of age who met the trauma criteria, underwent CT imaging, and were transferred to the PTC from an outlying hospital during calendar year 2010, 2011, 2012, 2013 (pre-campaign), and 2015 (post-intervention) were included. AFMC outreach staff conducted the education campaign in 2014. We assigned radiographic studies to one of the two categories defined here, outside or in-house studies. Outside studies were defined as CT imaging performed at an ATC and transmitted to the PACS. In-house studies were CT imaging performed at the PTC. All children transferred to the PTC arrived in the ED where additional imaging, if required, is typically performed before the child is discharged to intensive care unit, operating room (OR), admitting floor, or home.
Independent patient level factors studied as potential covariates included age, race, gender, mode of transportation, Injury Severity Score (ISS), and ED disposition. The independent hospital level factor was the transferring facility Trauma Center level. Hospital level factors studied included the region of the state, hospital type (urban, rural, critical care access, or community), hospital size (large, medium, and small), and location of radiology services (in house or out sourced). Hospital size was based on the Healthcare Utilization Project definition and was nested in location and teaching status [Reference Thomas and Wang20]. Our primary outcomes of interest were CT scan ERD and repeat rate.
Statistical Analysis
We summarized data using frequency and percentages for categorical variables and median (interquartile range) for continuous variables. We matched scans done in ATC and PTC by body regions for each patient. Effective radiation dosage was calculated for each scan with DLP and age information [21]. Scans that did not have radiation dosage were excluded. ERD was stratified by body region (head, neck, chest, and abdomen), race, age, gender, transportation, ED disposition, ISS [Reference Baker, O’Neill, Haddon and Long22], and trauma center level. Median ERD was compared between pre-campaign and post-campaign observations using the Wilcoxon Rank Sum Test. ISS was categorized by convention as mild (1–8), moderate (9–16), severe (17–25), or life threatening (>26). P values less than or equal to 0.05 were considered to be statistically significant. Statistical analysis was performed using the SAS™ software version 9.4 (SAS Institute Inc., Cary, NC, USA). The study was approved by the University’s Institutional Review Board.
Results
Data were available on 251 injured children from 2010 to 2013 (pre-campaign) and 134 injured children during 2015 (post-campaign) who were transferred to a Level I pediatric center from ATCs within our state. There was a total of 45 and 48 ATCs transferring children during pre-campaign and post-campaign, respectively. Children who received a CT scan of the abdomen, chest, head, or neck were included in the study. The PACS had 951 and 558 CT scans in the pre- and post-campaign periods, respectively. During the pre-campaign period, 482 (50.7%) CT scans were eligible for the study, while 398 (71.3%) CT scans were eligible post-campaign. To assess the impact of the educational campaign on ERD, CT scans done at the Level I PTC and/or repeated CT scans at the PTC were eliminated because our previous published study [Reference Nabaweesi, Ramakrishnaiah and Rettiganti12] demonstrated that PTC ERD was lower than ACR and AAPM recommended pediatric doses. The final data set composed of 394 CT scans during pre-campaign and 220 CT scans during the post-campaign periods as displayed in Fig. 1.
Data flow diagram.
For both periods, most hospitals are located in the Arkansas Valley and South West regions (Table 2). Of the 45 and 48 transferring hospitals assessed during the pre-/post-campaign periods, majority (44% and 42%, respectively) were urban, followed by rural (29%) and critical area hospitals (33%). Large hospitals [21] comprised the majority of transferring hospitals. Among the known radiological services, most CT scans were taken in house and most children were transferred from level IV Trauma centers. Demographic characteristics were comparable across pre-post campaign periods. In the post-campaign period, majority of children in the study were white (83.6%), male (61%), and had a median injury severity score of 9.0 (Table 3). While patient demographics were similar between pre- and post-campaigns, ground transportation increased from 60% to 79%, median ED length of stay increased from 3.6 h to 4.1 h, ED disposition to ICU/OR decreased from 30.3% to 23.1%.
Hospital characteristics (N = 93 hospitals)
* Hospital Bed Size Based on Healthcare Cost Utilization Project (HCUP) is embedded in location and teaching status.
Patient characteristics (N = 385)
* Interquartile range.
† Emergency Department.
‡ Length of Stay.
§ Intensive Care Unit.
|| Operating Room.
¶ Floor and Home.
Following the statewide CT scan educational campaign the overall, median ERD at transferring hospitals significantly decreased from 3.80 to 2.80 (Table 4). Post-campaign median ERD was reduced across all independent factors except for female gender, age >15 years, children transported by air, discharged to the OR or ICU, and suffered severe or life-threatening injury. The odds of a child receiving a repeat CT scan on arrival at the PTC ED post-campaign was significantly reduced in children who arrived by air, with moderate and life-threatening injuries, transferred from Level II and Level III trauma centers and discharged to ICU, operating room, and all dispositions (Table 5).
Children’s effective radiation dose when scanned at transferring hospitals
* Emergency Department.
† Intensive Care Unit.
‡ Operating Room.
§ Floor and Home.
|| Computed Tomography.
Frequencies and odds ratios of repeated CT scans at pediatric trauma center
* Emergency Department.
† Intensive Care Unit.
‡ Operating Room.
§ Floor and Home.
|| Injury Severity Score.
Discussion
We sought to evaluate the impact of a statewide CT scan educational campaign in a low-resourced rural southern state. We determined that Medicare-funded educational intervention contributed to children receiving lower ERDs from CT scans and experienced markedly reduced rates of repeat CT scans once they arrived at the level I PTC. There are not many studies published on statewide academic detailing for the As Low as Reasonably Allowable (ALARA) campaign. Most studies evaluate educational interventions conducted at single institutions or healthcare systems. Fernandes and colleagues evaluated the impact of an Image Wisely and Image Gently campaign on adult and pediatric CT scans across a multihospital healthcare system [Reference Fernandes, Levin, Miller, Schoenfeld and Amis3] and demonstrated results similar to ours for their pediatric population. In addition to a reduction in radiation dose per study, their campaign resulted in a reduction in CT utilization and a compensatory rise in ultrasound use.
The pre-post radiation dose difference among older children was not significant perhaps because the body habitus of older children resembles the body habitus of the adult.
Limitations
We conducted a retrospective analysis limited to the merged clinical and administrative data sets. Tapping into hospital association registries could potentially reveal factors illustrating facility infrastructure variability and provide us more granular results. The retrospective analysis did not allow us to account for externalities such as providers accessing ALARA principles on their own and the impact of a concurrently implemented web-based image repository.
We did not study mechanisms of action that caused the change in radiation dose, and since we did not conduct a pretest and post-test, we are not on solid footing in attributing our findings to the educational intervention. For instance, we did not take into consideration the effect of parents refusing CT scans for their children.
Another limitation of the study was not taking into account CT scan inventory to determine the age, manufacturer, and number of equipment available to small and large trauma centers. This could account for varying results across geographic regions and hospital sizes.
Similar to our previously published studies [Reference Nabaweesi, Ramakrishnaiah and Aitken9,Reference Nabaweesi, Ramakrishnaiah and Rettiganti12], we did not identify clinically indicated repeat CT scans to exclude them from unwarranted repeated CTs. The failure to exclude clinically indicated repeat scans may have conservatively biased our findings toward a weaker campaign impact.
Conclusion
A statewide educational campaign contributed to the ERD decline among injured children transferred to a PTC. This indicates that state-level interventions are feasible and can be effective and that further interventions/studies using audit feedback, education, and policy change are warranted.
Acknowledgements
The following individuals are acknowledged for their contribution to the manuscript in overseeing the databases that data were generated from, and conducting the statewide educational campaign. Dr. Maxson oversees pediatric trauma database accuracy and timeliness as director of the Pediatric Trauma Center. Dr. Rodgers and Dr. Golden as director of AFMC and Medicaid, respectively, oversaw the intervention and guided the corresponding description in the manuscript. Ms. Michelle Murtha led the statewide educational campaign. Drs. Nabaweesi, Aitken, Ramakrishnaiah, and Kenney substantially contributed to study conceptualization, study design, and writing the manuscript. Dr. Akmyradov analyzed the data and interpreted the results. All authors contributed to data interpretation, revising the manuscript, and are accountable for all the work. All authors approved the final version of manuscript. The author(s) declare(s) that they had full access to all of the data in this study and the author(s) take(s) complete responsibility for the integrity of the data and the accuracy of the data analysis.
Funding was provided by the Marion B. Lyon Career Development Award - Institutional.
Disclosures
The authors have no conflicts of interest to declare.
Open access
