CAEP 2014 ACADEMIC SYMPOSIUM
The 2014 Academic Symposium was entitled, “How to Make Research Succeed in Your Department.” The current landscape and best practices to improve Canadian emergency medicine research at academic units (whether an official department, division, section, or unspecified) were identified by convening three panels to develop practical recommendations on how to make academic research succeed. Each panel was chaired by an experienced Canadian emergency medicine researcher and included at least six other emergency medicine physician-scientists from across Canada. The panels were responsible for thoroughly researching their topics, which included 1) promoting excellence in Canadian emergency medicine resident research, 2) how to develop and train career researchers in emergency medicine, and 3) how to fund emergency medicine research programs. Each panel used mixed methods and presented their recommendations at the CAEP 2014 Academic Symposium on May 31, 2014, in Ottawa, Ontario. Dynamic discussions and suggestions provided at the symposium (which had 80 attendees, including physician-scientists, educators, administrators, clinicians, and residents) augmented and refined the recommendations, which are summarized herein and will be presented in detail in the next three CJEM issues.1,2,3
Promoting Excellence in Canadian Emergency Medicine Resident Research
This panel (chaired by Dr. Lisa Calder) identified sparse literature describing the current state of Canadian emergency medicine resident research. As a foundational step, they proposed a concise definition for a scholarly project that allowed for diverse types of academic inquiries, such as empiric research, educational projects, and quality improvement. Second, they specifically defined the three levels of research competence: critical appraiser of research, research contributor, and research producer. Finally, they delineated the unique circumstances within the Canadian dual-college training system, which includes their different philosophies toward research training and their training capacities. These distinctions were carefully considered by the panel as part of the recommendations.
From data gathered through a systematic review of the literature and survey of all of the program directors from both colleges, the panel iteratively developed recommendations by group consensus. In addition to vetting at the CAEP 2014 Academic Symposium, these recommendations were also distributed to stakeholders for feedback, including the Specialty Committee of the Royal College of Physicians and Surgeons of Canada (RCPSC), the Emergency Medicine Interest Focused Practice Committee of the College of Family Physicians of Canada (CFPC), and the CAEP Resident Section.
The recommendations focused on addressing Canada-wide variability, including specifics directed at both colleges to clarify expectations and to academic units to provide supports conducive to fostering excellence in resident research (Box 1).
Box 1 Summary of recommendations: promoting excellence in Canadian emergency medicine resident research
Recommendations to the two national colleges
Specific clarification is recommended around the goals and exit competencies for emergency medicine residents from both colleges, so they are clearly aligned with the college training objectives. The desired competency outcome (i.e., critical appraiser, research contributor, and/or research producer) and an explicit definition for “scholarly project” should be declared.
For the RCPSC emergency medicine programs, a range of research opportunities should be available to meet all competency outcomes, including a stream for advanced research training (e.g., MSc or PhD).
For the CFPC emergency medicine programs, a clear path for those interested in further research training should be defined.
The RCPSC should address the variability across its programs and consider the advantages of a structured research training curriculum offered early to provide residents more research opportunities.
Given the two family medicine years plus one emergency medicine year in CFPC emergency medicine training, the CFPC should identify specific research training elements necessary to supplement the family medicine research training curriculum.
Recommendations for local programs
RCPSC programs should develop a research training curriculum for their residents matched to desired competency outcomes.
All residency programs should assess individual resident research projects as well as evaluate their resident research programs as a whole.
All programs should consider using a resident research coordinator to facilitate research ethics board application, project management, publication, and program evaluations.
Resident research programs should link to existing infrastructure (in other programs or medical departments) to assist residents with scholarly project design and statistical analysis.
All programs should dedicate research funding support toward resident research.
All programs should consider matching residents with research mentors (who can provide methodological and pragmatic support). This can also occur outside of the program and/or the institution.
All residency programs should encourage their residents to broadly disseminate project results (whether by traditional publication or other peer-reviewed venues), including manuscript preparation by RCPSC residents and abstract presentation by all residents (at least locally, but ideally nationally).
Resident research abstracts and manuscript publications should be tracked as a metric for the evaluation of academic productivity.
How to Develop and Train Career Researchers in Emergency Medicine
This panel (chaired by Dr. Jeffrey Perry) addressed the best practices for training and developing emergency medicine career researchers by identifying the enablers and barriers. They conducted a systematic review and survey of all Canadian emergency medicine researchers. The expert research panelists also studied the Society for Academic Emergency Medicine (SAEM) research fellowship program. Recommendations based on this methodology were presented at the CAEP 2014 Academic Symposium and refined from attendee feedback.
A survey of physicians who were self-defined as a clinical researcher (i.e., physicians who spend a significant portion of their career conducting research) was conducted. Respondents felt that salary support, research training, mentorship, and infrastructure positively impact the success of a clinical research career. Review of the SAEM research fellowship identified specific core competencies for researchers, as well as mandatory manuscript preparation and submission of a large grant proposal for peer review as integral to a successful research training program.
The panel’s work culminated into the recommendation of a structured research training program, which would consist of two phases: formal fellowship/graduate training (2 years) and research consolidation (1 to 3 years) (Box 2).
Box 2 Summary of recommendations: how to develop and train career researchers in emergency medicine
Required elements of a CAEP Academic Section endorsed training programs
Training should consist of two phases: Phase I: Research Fellowship/Graduate Training (2 years) and Phase II: Research Consolidation (1–3 years).
Phase I should comprise both an advanced research degree (e.g., MSc Epidemiology) and practical mentorship covering the 15 domains of clinical research (see 2.3).
Phase II should focus on intense mentoring to consolidate the 15 domains of clinical research and develop expertise in research outputs (e.g., abstracts, manuscripts, and grants).
Training centres are encouraged to formalize links with other centres to cover areas of expertise that are not well established in their own centres.
Trainees in both Phase I and Phase II require protected time away from clinical, educational, and administrative duties.
A research salary/stipend is essential during both phases of this training.
Work space, including appropriate infrastructure (i.e., computer, Internet access, reference software, statistical software, administrative support), needs to be provided to both Phase I and Phase II trainees.
Process to become a CAEP Academic Section endorsed training program
Ensure that a plan exists on how to provide training in all 15 domains of clinical research.
Apply to the CAEP Academic Section to receive endorsement for research training of candidates for Phase I, Phase II, or both.
Provide updates every 5 years to the CAEP Academic Section on the number of trainees per phase and an updated plan on how training is provided in the 15 domains of clinical research.
Domains of clinical research for Phase I and Phase II training
Identification of research focus within emergency medicine
Data collection methods
Data monitoring and interim data analysis
Presentation of research
Manuscript preparation, submission, and revision
Ethical aspects of medical research
Additional requirements for Phase II training
Submit and present two or more scientific abstracts per year.
Submit at least two full manuscripts as first author per year.
Obtain at least one grant from a provincial or national peer-review organization, including preparation, submission, and revision.
Consolidate 15 domains of clinical research Phase I.
How to Fund Emergency Medicine Research Programs
This panel (chaired by Dr. Christian Vaillancourt) outlined research funding strategies, including tactics to fund research projects, salaries, infrastructure, and stipends. By interviewing other research leaders using a standardized questionnaire of open-ended questions, local research funding strategies from across Canada were characterized. Examples of commonly used funding opportunities were also compiled at the provincial, national, and international levels. By iterative consensus, practical recommendations about improving research funding at the academic level were developed and refined following discussions at the CAEP 2014 Academic Symposium.
They identified four local research funding models that included 1) an investigator-dependent model, 2) practice plans, 3) generous benefactors, and 4) a mixed-funding model. Expert-led discussions of the advantages and challenges of these models resulted in recommendations specific to individual researchers and organizations, including those for research contributors and producers, local academic leaders, and national emergency medicine bodies (Box 3).
Box 3 Summary of recommendations: how to fund emergency medicine research programs
Recommendations for research contributors and producers, including learners, faculty members without research training, young investigators, and mid-career and senior investigators
Researchers should obtain research training.
Learners should collaborate with and be mentored by trained investigators and/or methodologists in all grant applications.
If such mentorship is not available within the emergency medicine academic community, efforts should be made to collaborate with investigators from other disciplines, including nonclinician methodologists.
Faculty members without research training can start as co-supervisor/collaborator on other learner/faculty member small projects, seek support from an institutional method centre, or collaborate with investigators from other disciplines.
Young investigators should be mentored by mid-career/senior investigators, be provided with protected research time in order to increase productivity, and give careful consideration to the timing of their first academic appointment in order to remain eligible for new investigator salary awards.
Mid-career/senior investigators should develop research programs leading to large grant opportunities and collaboration with research networks.
Mid-career/senior investigators should include funding for trainees, including MSc/PhD students and post-doctoral fellows when applying for all operating grants.
Recommendations for local academic leaders
Academic centres should foster a culture of research among their trainees and faculty and reward both participation and excellence.
Efforts should be made to train, recruit, and retain investigators interested and dedicated to emergency medicine.
Local/institutional funding for research activities should be encouraged at all levels of training.
Academic centres should strive to implement a mixed-funding model or, at the least, institute a practice plan in order to support research activities.
Departments and research groups should consider “funding-contingent” positions, where the outside funding used to support a university full-time research position comes from the potential clinician scientist (i.e., clinical income), and this is leveraged by matching dollars or supplements from the faculty or academic department.
Recommendations for national organizations
CAEP should maintain and expand its current offering of small grants, and consider larger grants programs such as training grants.
CAEP researchers should advocate for emergency medicine representation by qualified investigators among national funding agencies such as the Canadian Institute for Health Research (CIHR).
CAEP and emergency medicine researchers should advocate for an emergency-medicine-specific funding stream such as, for example, a CIHR emergency medicine institute.
The CAEP Academic Section Executive supports these recommendations to improve emergency medicine research in Canada. Working with stakeholders, including the colleges, program directors, emergency medicine physician-scientists, academic leaders, and CAEP as a whole, the CAEP Academic Section will assist local emergency medicine units to learn and improve from these recommendations. One improvement process recently endorsed by the CAEP Board of Directors will be the offer of expert consultations to each university emergency medicine unit for research programs, as well as for the other academic domains of education scholarship and governance/funding. We hope that the 2014 research recommendations will help the Canadian emergency medicine community create high-quality evidence to improve care of our patients.
All of the recommendations from the CAEP 2015 Academic Symposium are published in the above summary and the articles from each panel.1,2,3 The authors of the CAEP 2014 Academic Symposium would like to thank all of the panelists: Riyad Abu-Laban, Barbara Blackie, Bijon Das, Marcel Émond, Jason Frank, Rob Green, Corinne Hohl, Judd Hollander, Brian Holroyd, Grant Innes, Natalie Le Sage, Shelley McLeod, Laurie Morrison, Brian Rowe, Carolyn Snider, Venkatesh Thiruganasambandamoorthy, and Rob Woods, as well as Sedigheh Shaeri, who assisted with the career researcher literature review.