Background
Research agendas provide a roadmap and strategic direction to improve the quantity and quality of research production and application, and can identify areas in most need of research attention. Several countries have developed emergency medical services (EMS) research agendas, including the United States, Ireland, Australia, and, most recently, Canada.Reference Sayre, White and Brown 1 - Reference Dainty, Jensen and Bigham 5 Research agendas also exist for specific topics within EMS, including pediatrics and community paramedicine.Reference Foltin, Dayan and Tunik 6 , Reference Patterson and Skillman 7 Nineteen recommendations for the future of Canadian EMS research were generated in the Canadian National EMS Research Agenda published in 2013 (Figure 1).Reference Jensen, Bigham and Blanchard 4 Some of these Canadian recommendations were similar to those from other locations, including the development of research careers in EMS and the need for further funding.Reference Blanchard, Brown and Jensen 8 In addition, some are known to have now been implemented, such as the National Registry of Emergency Medical Technicians Research Fellowship in the United States.
Recommendations matrix: impact X feasibility.
While developing research agendas can be important, what is more important are the changes that result from such an initiative, and the effect of those changes. The U.S. EMS Research Agenda published an implementation plan putting forth eight implementation-focused recommendations.Reference Sayre, White and Brown 9 , Reference Sayre, White and Brown 10 However, outcomes of agenda recommendations have not been reported from any of these. The impact of EMS research agendas on improving the quantity or quality of research performed or applied is unknown.
As described by Graham, knowledge must be both created and then subsequently applied.Reference Graham, Logan and Harrison 11 Part of effectively applying the results of research to a given setting is identifying which knowledge is most important (i.e., adapting knowledge to the context) and identifying barriers to its use, or what is required to put it to action.Reference Graham, Logan and Harrison 11 Although Canadian National EMS Research Agenda generated nineteen recommendations for improving EMS research conducted and used in Canada, it, too, requires a focused and purposeful implementation strategy for real change to occur.
The purpose of this implementation study was to determine the anticipated impact and feasibility of the Canadian EMS Research Agenda recommendations. The specific objectives are to develop an actionable implementation strategy for the Canadian EMS Research Agenda through: 1) ranking each of the nineteen recommendations on its a) potential impact (i.e., could it make a difference?) and b) feasibility of implementation, and 2) identifying and cataloguing a) existing or planned initiatives from across Canada that relate to each recommendation and b) the resources required for implementation.
Methods
This study was a cross-sectional electronic online survey of EMS research stakeholders in Canada. The survey was open from December 1 to December 20, 2012, and was approved by the Capital District Health Authority Research Ethics Board in Halifax.
The sample included past participants from the Canadian National EMS Research Agenda study,Reference Jensen, Blanchard and Bigham 12 as well as other EMS research stakeholders identified through investigator knowledge and snowball sampling of the participant group.Reference Heckathorn 13 Sampling was purposeful, from locations across the country and in a variety of EMS system types, to ensure a mix of participants who work in various clinical and research roles in EMS. Participation was voluntary, and consent was implied by partial or full completion and submission of the online survey. The survey was delivered using an electronic survey tool (Opinio version 6.5.2, Objectplanet, Oslo, Norway). The survey was sent via email to the email address identified for each participant during snowball sampling. Reminder emails were sent out every 5 days to nonrespondents for a maximum total of three times.
Participants were asked to score each of the nineteen recommendations using a five-point Likert scale regarding whether the recommendation was anticipated to make a difference (impact score) and the anticipated ease or difficulty of implementation (feasibility score). Results were analysed descriptively and, where applicable, reported as medians with interquartile ranges (IQR). Recommendations were also plotted on a matrix of impact score by feasibility score.
Participants were also asked to provide free-text responses describing any planned or ongoing initiatives that related to the recommendations, and asked to report on the resources that were required, or the resources they anticipate would be required to implement each recommendation. Two investigators (JJ and RB) reviewed any reported initiatives and resources to align them with the most appropriate recommendation. For each recommendation, the number of unique ongoing or planned initiatives and required resources was reported descriptively. The survey can be found in Appendix A.
Results
Participants
Of 131 people invited to participate, 94 (71.8%) responded. Participants reported a median of 19.0 years of experience in EMS (IQR 12.5–25.0). The participant group represented a mixture of roles across a spectrum of organization types and provinces and territories. Study participant characteristics are provided in Table 1.
Study participant characteristics.
* = One respondent chose Other and wrote “EMS medical director”;
† = one respondent chose Other and wrote “paramedic training and QA”;
‡ = two respondents chose Other and wrote “base hospital administrator” and “health ministry”;
§ = one respondent chose Other and wrote “EMS provider and researcher.
Impact and feasibility of the recommendations
The median survey responses for the anticipated impact and feasibility of each recommendation are plotted on a matrix (see Figure 1) and listed in a tabular format (Table 2). The median scores for the impact and feasibility of each recommendation are plotted on a matrix in Figure 1 and listed in a tabular format in Table 2. Eight recommendations had a median impact of 5, with a median feasibility of 3, indicating that survey participants felt that these recommendations would make a big difference, and that they could be accomplished with some additional effort or resources. These recommendations were the following:
-
∙ Strengthen research partnerships between EMS academic centers, systems, regulators, educators, and national associations (#2).
-
∙ Increase funding opportunities for EMS research infrastructure and studies (#3).
-
∙ Universities should consider EMS providers with graduate training for academic appointments, so they can engage in academic EMS research (#4).
-
∙ Create opportunities for EMS providers to work in research positions. Review collective agreements if necessary (#5).
-
∙ Integrate research literacy and research competencies into EMS providers’, managers’, and EMS physicians’ foundational and continuing education (#6).
-
∙ EMS systems administrators should budget for research projects during annual strategic planning (#11).
-
∙ Evidence-based decision-making should be encouraged in EMS systems. If evidence is lacking, further research should be undertaken (#13).
-
∙ EMS data should be linked with hospital and other datasets (#17).
Anticipated impact and feasibility of recommendations.
Four of these recommendations (#2, 3, 4, and 5) were related to time, opportunities, and funding for EMS research.Reference Jensen, Bigham and Blanchard 4
There were two recommendations with a median impact score of 4 and median feasibility score of 4 (#8 and #16), suggesting that the perceived impact of these recommendations was less than the eight highest-impact recommendations, but that they would be somewhat easier to implement with existing—or only minimal additional—resources.
The remaining nine recommendations also had a median impact score of 4, but a median feasibility score of 3, suggesting that participants felt these recommendations could make a difference for EMS, but they would require some additional effort or resources to implement. Four of these nine recommendations related to the culture of research and collaboration for EMS research (#1, 9, 10, 14).
Initiatives related to the recommendations and resources required
In total, the participants reported 70 unique ongoing or established initiatives relevant to the research agenda recommendations. A range of 0–9 initiatives was reported per recommendation. The recommendation with the most ongoing initiatives was #2: Strengthen research partnerships between EMS academic centers, systems, regulators, educators, and national associations. The recommendation with the least ongoing or established initiatives reported was #16: Highlight EMS research in special issues or sections of the Canadian Journal of Emergency Medicine.
Respondents also identified a total of 71 distinct resources they felt to be required to implement the research agenda recommendations, with a range of 1–11 resources required per recommendation. The recommendations with the fewest resources deemed to be required were #13: Evidence-based decision-making should be encouraged in EMS systems. If evidence is lacking, further research should be undertaken; and #18: Create a national EMS data dictionary of operational and clinical terms, each with one resource identified. The recommendation with the most resources deemed to be required was #19: The EMS Research Agenda needs to be viewed as an ongoing project. An implementation, evaluation, and renewal plan should be designed and this process should include mapping gaps in EMS research.
The initiatives and resources required for each recommendation are listed in Appendix B.
Discussion
This implementation study provides an understanding of what has already been accomplished and what remains needed for the recommendations of the Canadian National EMS Research Agenda to be implemented. Prior to this investigation, which recommendations were perceived to have the greatest impact and their ease of implementation were unknown. Participants indicated that they felt all of the recommendations could make a difference and were possible to implement. Many ongoing and planned initiatives related to the recommendations were also identified.
A finding of this work of relevance to policymakers is that none of the recommendations had a median feasibility score of 5, and only two recommendations attained a median feasibility score of 4. This suggests that a full implementation of the Canadian EMS Research Agenda cannot be achieved without additional resources.
Arguably, one of the most important benefits of a research agenda is the discussion and engagement that must occur among stakeholders for such a report to be produced. The results of our impact and feasibility study are anticipated to further these local and national discussions, by providing guidelines on which recommendations for change are perceived to have the highest impact and be the most feasible and which require targeted investment in resources and leadership. Participants of the Canadian EMS Research Agenda clearly indicated that the findings of the agenda needed to be acted upon, and not simply reported.Reference Dainty, Jensen and Bigham 5 Our hope is that by studying the anticipated impact and feasibility of implementing these previously generated recommendations, our findings will facilitate EMS research and strategic planning.
A limitation of this study is that a selection bias may have arisen from our sampling strategy. The sample consisted of individuals who were generally interested in or invested in EMS research. This may have overestimated the impact and underestimated the feasibility of various recommendations compared to a sample randomly selected from all EMS personnel across Canada. While we attempted to recruit participants from a diverse range of EMS services and locations, some were likely not represented. Our results represent the responses of participants and their perceptions regarding the anticipated impact and feasibility of implementing each of the recommendations. Prospective evaluation would be required to determine the actual implementation impact and feasibility. There may be other ongoing initiatives that relate to the EMS research agenda recommendations that were not captured, and, similarly, resources may exist that are necessary for implementation that we failed to identify. The distribution of respondents did not mirror the population density, and, as such, impact or implementation issues that are province-dependant may not have been appropriately identified. Finally, although our results pertain to the Canadian setting, they may lack generalizability to other nations.
Conclusions
For most of the 12 previously generated recommendations of the Canadian National EMS Research Agenda, the anticipated impact is deemed to be higher than the feasibility to implement by EMS research stakeholders. There are ongoing or planned initiatives pertaining to all recommendations, except one; however, all require additional resources to implement. The implementation of the National EMS Research Agenda recommendations is anticipated to make important improvements in EMS research but perceived to require dedication, resources, and collaboration across planned and ongoing initiatives to achieve. Dedicated resources are required to thoroughly implement the Canadian National EMS Research Agenda.
Author contributions
JLJ, IEB, and BLB developed the research concept and plan. JLJ obtained research ethics approval. JLJ, IEB, and BLB obtained funding. JLJ, IEB, BLB, and RB recruited and enrolled participants. All authors contributed substantially to the design and methodology of this study and to the writing and critical editing of this manuscript, and intend to remain significantly involved in the study until completion. All authors have read and approved the final manuscript.
Acknowledgements: The authors wish to thank all who completed the study survey.
Competing interests: None declared.
Supplementary material
To view supplementary material for this article, please visit http://dx.doi.org/10.1017/cem.2015.29
