Correlating Simulation Training and Assessment With Clinical Performance: A Feasibility Study

• DOI: 10.1016/j.amj.2024.01.004
• Publication Date: 2024-02-02T20:37:07Z
• Authors: Victoria Myers; Meagan Slack; Mahvareh Ahghari; Brodie Nolan
• Keywords: Ontario; Male; Adult; Emergency Medical Services; Cohort Studies; Emergency Medical Technicians; Logistic Models; Intubation, Intratracheal; Humans; Feasibility Studies; Female; Clinical Competence; Airway Management; Simulation Training; Retrospective Studies

Simulation education and assessment are increasingly used in prehospital curriculums. The objective of this study was to assess the challenges and feasibility of correlating evaluation data from an airway management simulation assessment with clinical performance.This study was undertaken in Ontario, the most populous province in Canada, where 13 bases are distributed in geographically diverse areas, from urban to rural and remote locations. This is a retrospective cohort study of paramedics who had completed simulation education and assessment in rapid sequence intubation. Logistic regression was used to assess for correlation between assessment scores (ie, the global score and the overall score and the definitive airway sans hypoxia/hypotension on the first attempt [DASH-1A] success in the field).DASH-1A success when grouped by base varied from 25% to 100%. The odds of DASH-1A success increased for paramedics who had a higher overall score (odds ratio [OR]: 1.03; 95% confidence interval [CI], 0.96-1.11) and for paramedics who had a higher global rating (OR: 1.27; CI, 0.73-2.21) when accounting for base intubation frequency. The odds of DASH-1A success increased for paramedics who had a higher overall score (OR: 1.01; CI, 0.93-1.09) and decreased for paramedics who had a higher global rating (OR: 0.96; CI, 0.47-1.96) when accounting for base geography.Although this study lacked a sample size large enough to draw conclusions, it provides a foundation and areas to improve in future work exploring the relationship between simulation assessments and clinical performance.