2 results
LO41: Competency-based learning of pediatric musculoskeletal radiographs
- K. Boutis, M. Lee, M. Pusic, M. Pecarcic, B. Carrier, A. Dixon, J. Stimec
-
- Journal:
- Canadian Journal of Emergency Medicine / Volume 20 / Issue S1 / May 2018
- Published online by Cambridge University Press:
- 11 May 2018, p. S21
- Print publication:
- May 2018
-
- Article
-
- You have access Access
- Export citation
-
Introduction: Pediatric musculoskeletal (MSK) image interpretation has been identified as a knowledge gap among emergency medicine trainees. The main objective of this study was to implement a validated on-line pediatric MSK radiograph interpretation system with a performance-based competency endpoint into pediatric emergency fellowship programs and examine the number of cases needed to achieve a competency threshold of 80% accuracy, sensitivity and specificity. We further determined proportion who successfully achieved competency in a given module and the change in accuracy from baseline to competency. Methods: This was a prospective cohort multi-centre study. There were seven MSK radiograph modules, each containing 200-400 cases (demo-https://imagesim.com/course-information/demo/). Thirty-seven pediatric emergency medicine fellows participated for 12 months. Participants did cases until they reached competency, defined as at least 80% accuracy, sensitivity and specificity. We calculated the overall and per module median number of cases required to achieve competency, proportion of participants who achieved competency, median time on case, and the mean change in accuracy from baseline to competency. Results: Overall, the median number of cases required to achieve competency was 76 (min 54, max 756). Between different body parts, there was a significant difference in the median number of cases needed to achieve competency, p <0.0001, with ankle and knee being among the most challenging modules. Proportions of those who started a module and completed it to competency varied significantly, and ranged from 32.4% in the ankle module to 97.1% in the forearm/hand, p<0.0001. The overall median time on each case was 34.1 (min 7.6, max 89.5) seconds. The overall change in accuracy from baseline to 80% competency was 13.5% (95% CI 12.1, 14.8), with the respective Cohens effect size of 1.98. The change in accuracy was different between modules, p=0.001, with post-hoc analyses demonstrating that the ankle/foot radiograph module had a greater increase in accuracy relative to elbow (p=0.009) and pelvis/femur (p=0.006). Conclusion: It was feasible for pediatric emergency medicine fellows to complete each learning pediatric MSK learning module to competency within approximately one hour, with the exception of the ankle module. Learners who completed the modules to competency demonstrated very significant increases in interpretation skill.
LO44: Optimizing skill retention in radiograph interpretation: a multicentre randomized control trial
- K. Boutis, B. Carrier, J. Stimec, M. Pecarcic, A. Willan, M. Pusic
-
- Journal:
- Canadian Journal of Emergency Medicine / Volume 20 / Issue S1 / May 2018
- Published online by Cambridge University Press:
- 11 May 2018, p. S22
- Print publication:
- May 2018
-
- Article
-
- You have access Access
- Export citation
-
Introduction: Simulation-based education systems have increased physician skill in radiograph interpretation. However, the degree of skill retention and the factors that influence it are relatively unknown. The main objective of this research was to determine the rate and quantity of skill decay in post-graduate trainee physicians who completed a simulation-based learning intervention of radiograph interpretation. The impact of testing and refresher education on skill decay was also examined. Methods: This was a prospective, multicenter, analysis-blinded, four arm randomized control trial conducted from November 2014 to June 2016. Study interventions were administered using an on-line learning and measurement platform. Pediatric and emergency medicine residents in the United States and Canada were eligible for study participation. Participants were randomized to one of four groups. All participants completed an 80-case deliberately practiced learning set of pediatric elbow radiographs followed by an immediate 20-case post-test. Following this, Group 1 had no testing until 12 months; Groups 2, 3, and 4 had testing (20 cases without feedback) every 2 months until 12 months, but Group 3 also had refresher education (20 cases with feedback) at six months while Group 4 had refresher education at two, six, and ten months. The main outcome measure was accuracy at 12 months, adjusted for immediate post-test score, days to completion of 12 month test, and time on case. Based on prior data, we assumed the smallest important difference between groups in learning decay is 10%, a between-participant/within-group standard deviation of 17%, a type I error probability of 5%, a power of 80% and adjusted for three tests with a Bonferroni correction. For the primary analysis of Group 1 versus 2, 3, 4, this resulted in a minimal total sample size of 56, with 14 participants per group. Results: We enrolled 106 participants that completed all study interventions. The sample sizes in Groups 1, 2, 3, and 4 were 42, 22, 22, and 20 respectively. Overall, accuracy increased by 11.8% (95% CI 9.8, 13.8) with the 80-case learning set and then decreased by 5.5% (95% CI 2.5, 8.5) at 12 months. The difference in learning decay in Group 1 vs. Groups 2, 3, 4 was -8.1% (95% CI 2.5, 13.5), p=0.005. For Group 2 vs. Group 3 and 4, it was +0.8% (95% CI -7.2, 7.3), p=0.8, and between Group 3 vs. Group 4 it was +0.8% (95% CI -7.3, 10.1), p=0.8. Conclusion: Skill decay was significantly reduced by testing with 20 cases every two months. Refresher education had no additional effect to testing on reducing learning decay.