To address the increasing demand for the use of simulation for assessment, our objective was to review the literature pertaining to simulation-based assessment and develop a set of consensus-based expert-informed recommendations on the use of simulation-based assessment as presented at the 2019 Canadian Association of Emergency Physicians (CAEP) Academic Symposium on Education.

A panel of Emergency Medicine (EM) physicians from across Canada, with leadership roles in simulation and/or assessment, was formed to develop the recommendations. An initial scoping literature review was conducted to extract principles of simulation-based assessment. These principles were refined via thematic analysis, and then used to derive a set of recommendations for the use of simulation-based assessment, organized by the Consensus Framework for Good Assessment. This was reviewed and revised via a national stakeholder survey, and then the recommendations were presented and revised at the consensus conference to generate a final set of recommendations on the use of simulation-based assessment in EM.

We developed a set of recommendations for simulation-based assessment, using consensus-based expert-informed methods, across the domains of validity, reproducibility, feasibility, educational and catalytic effects, acceptability, and programmatic assessment. While the precise role of simulation-based assessment will be a subject of continued debate, we propose that these recommendations be used to assist educators and program leaders as they incorporate simulation-based assessment into their programs of assessment.

Simulation plays an integral role in the Canadian healthcare system with applications in quality improvement, systems development, and medical education. High-quality, simulation-based research will ensure its effective use. This study sought to summarize simulation-based research activity and its facilitators and barriers, as well as establish priorities for simulation-based research in Canadian emergency medicine (EM).

Simulation-leads from Canadian departments or divisions of EM associated with a general FRCP-EM training program surveyed and documented active EM simulation-based research at their institutions and identified the perceived facilitators and barriers. Priorities for simulation-based research were generated by simulation-leads via a second survey; these were grouped into themes and finally endorsed by consensus during an in-person meeting of simulation leads. Priority themes were also reviewed by senior simulation educators.

Twenty simulation-leads representing all 14 invited institutions participated in the study between February and May, 2018. Sixty-two active, simulation-based research projects were identified (median per institution = 4.5, IQR 4), as well as six common facilitators and five barriers. Forty-nine priorities for simulation-based research were reported and summarized into eight themes: simulation in competency-based medical education, simulation for inter-professional learning, simulation for summative assessment, simulation for continuing professional development, national curricular development, best practices in simulation-based education, simulation-based education outcomes, and simulation as an investigative methodology.

This study summarized simulation-based research activity in EM in Canada, identified its perceived facilitators and barriers, and built national consensus on priority research themes. This represents the first step in the development of a simulation-based research agenda specific to Canadian EM.

A cricothyroidotomy is a life-saving procedure, performed as a final option to emergency airway algorithms, and is essential for all clinicians who perform emergency airway management. The bougie-assisted cricothyroidotomy (BAC) is a novel technique that may be performed faster and with fewer complications than other traditional approaches. There is no established standard set of steps to guide the instruction of BAC performance. This study sought to systematically develop a BAC checklist for novice instruction using a modified Delphi methodology and international airway experts.

A literature review informed the creation of a preliminary BAC checklist. A three round, modified Delphi method was used to establish a BAC checklist intended for novice-level instruction. The consensus level for each step and the final checklist were predefined at 80%. Participants were international airway experts identified by study personnel and snowball sampling.

Fourteen international airway experts across six acute care specialities participated in the study. The checklist was refined using a seven-point rating scale for each item and participant comments. A 17-item checklist was developed with expert consensus achieved after three rounds. Internal consistency, measured with Cronbach’s α, was 0.855 (95% confidence interval 0.73-0.94).

This modified Delphi-derived checklist is the first systematically developed list of essential steps for guiding BAC instruction for novice learners. This tool serves to standardize BAC skill instruction and provide learners with a structured and consistent set of steps for deliberate practice.

Simulation-based education (SBE) is an important training strategy in emergency medicine (EM) postgraduate programs. This study sought to characterize the use of simulation in FRCPC-EM residency programs across Canada.

A national survey was administered to residents and knowledgeable program representatives (PRs) at all Canadian FRCPC-EM programs. Survey question themes included simulation program characteristics, the frequency of resident participation, the location and administration of SBE, institutional barriers, interprofessional involvement, content, assessment strategies, and attitudes about SBE.

Resident and PR response rates were 63% (203/321) and 100% (16/16), respectively. Residents reported a median of 20 (range 0–150) hours of annual simulation training, with 52% of residents indicating that the time dedicated to simulation training met their needs. PRs reported the frequency of SBE sessions ranging from weekly to every 6 months, with 15 (94%) programs having an established simulation curriculum. Two (13%) of the programs used simulation for resident assessment, although 15 (94%) of PRs indicated that they would be comfortable with simulation-based assessment. The most common PR-identified barriers to administering simulation were a lack of protected faculty time (75%) and a lack of faculty experience with simulation (56%). Interprofessional involvement in simulation was strongly valued by both residents and PRs.

SBE is frequently used by Canadian FRCPC-EM residency programs. However, there exists considerable variability in the structure, frequency, and timing of simulation-based activities. As programs transition to competency-based medical education, national organizations and collaborations should consider the variability in how SBE is administered.

Postthrombotic syndrome (PTS) is a complication of deep vein thrombosis (DVT) characterized by chronic pain, swelling, and heaviness, and may result in ulceration. Elastic compression stockings (ECS) worn daily after DVT have been shown to reduce the incidence and severity of PTS. The aim of our study was to investigate practices and perceptions of physicians regarding adjunct therapies to anticoagulation in patients diagnosed with lower extremity DVT.

A national online survey was conducted of Canadian emergency medicine staff physicians and residents (n=471) to investigate their attitudes toward the prescription of ECS post-diagnosis of DVT. A paper survey of patients in a thrombosis clinic (n=58) was also administered to better understand the patient experiences with ECS.

The majority of staff physician (62%) and resident (69%) respondents were unsure of whether ECS were effective in preventing PTS and managing venous symptoms. Only 6% of staff physicians and 7% of residents routinely prescribed ECS for above-knee DVTs. More than 78% of respondents were unsure about the optimal timing of initiation of ECS and duration of therapy. Although all patients noted symptomatic relief with ECS, only 50% were prescribed stockings by an emergency or family doctor, and 69% of those patients wore the stockings on a daily basis. Staff physicians most frequently identified poor fit as the reason for lack of patient compliance, whereas patients most frequently cited cost.

Our findings suggest that there is variability in practice among Canadian emergency medicine physicians and trainees and a need for widespread education regarding the latest evidence of the benefit of ECS after DVT.

This study sought to establish the current state of procedural skills training in Canadian Royal College emergency medicine (EM) residencies.

A national Web-based survey was administered to residents and program directors of all 13 Canadian-accredited Royal College EM residency programs. Programdirectors rated the importance and experience required for competence of 45 EM procedural skills. EM residents reported their experience and comfort in performing the same procedural skills.

Thirteen program directors and 86 residents responded to the survey (response rate of 100% and 37%, respectively). Thirty-two (70%) procedures were considered important by > 70% of program directors, including all resuscitation and lifesaving airway procedures. Four procedures deemed important by program directors, including cricothyroidotomy, pericardiocentesis, posterior nasal pack for epistaxis, and paraphimosis reduction, had never been performed by the majority of senior residents. Program director opinion was used to categorize each procedure based on performance frequency to achieve competence. Overall, procedural experience correlated positively with comfort levels as indicated by residents.

We established an updated needs assessment of procedural skills training for Canadian Royal College EM residency programs. This included program director opinion of important procedures and the performance frequency needed to achieve competence. However, we identified several important procedures that were never performed by most senior residents despite program director opinion regarding the experience needed for competence. Further study is required to better define objective measures for resident competence in procedural skills.