Hostname: page-component-76d6cb85b7-lcgwf Total loading time: 0 Render date: 2026-07-18T06:52:29.276Z Has data issue: false hasContentIssue false

Applications and Performance of Machine Learning Algorithms in Emergency Medical Services: A Scoping Review

Published online by Cambridge University Press:  17 May 2024

Ahmad Alrawashdeh*
Affiliation:
Department of Allied Medical Sciences, Jordan University of Science and Technology, Irbid, Jordan
Saeed Alqahtani
Affiliation:
Department of Emergency Medical Services, Prince Sultan Military College for Health Sciences, Dhahran, Saudi Arabia
Zaid I. Alkhatib
Affiliation:
Department of Allied Medical Sciences, Jordan University of Science and Technology, Irbid, Jordan
Khalid Kheirallah
Affiliation:
Department of Public Health and Family Medicine, Faculty of Medicine, Jordan University of Science and Technology, Irbid, Jordan
Nebras Y. Melhem
Affiliation:
Department of Anatomy, Physiology and Biochemistry, Faculty of Medicine, The Hashemite University, Zarqa, Jordan
Mahmoud Alwidyan
Affiliation:
Department of Allied Medical Sciences, Jordan University of Science and Technology, Irbid, Jordan
Arwa M. Al-Dekah
Affiliation:
Kernel research and data analytics center, Irbid, Jordan
Talal Alshammari
Affiliation:
Department of Emergency Medical Care, College of Applied Medical Sciences, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
Ziad Nehme
Affiliation:
Ambulance Victoria, Doncaster, Victoria, Australia School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
*
Correspondence: Ahmad Alrawashdeh Department of Allied Medical Science Jordan University of Science and Technology Irbid 22110, Jordan E-mail: aaalrawashdeh@just.edu.jo
Rights & Permissions [Opens in a new window]

Abstract

Objective:

The aim of this study was to summarize the literature on the applications of machine learning (ML) and their performance in Emergency Medical Services (EMS).

Methods:

Four relevant electronic databases were searched (from inception through January 2024) for all original studies that employed EMS-guided ML algorithms to enhance the clinical and operational performance of EMS. Two reviewers screened the retrieved studies and extracted relevant data from the included studies. The characteristics of included studies, employed ML algorithms, and their performance were quantitively described across primary domains and subdomains.

Results:

This review included a total of 164 studies published from 2005 through 2024. Of those, 125 were clinical domain focused and 39 were operational. The characteristics of ML algorithms such as sample size, number and type of input features, and performance varied between and within domains and subdomains of applications. Clinical applications of ML algorithms involved triage or diagnosis classification (n = 62), treatment prediction (n = 12), or clinical outcome prediction (n = 50), mainly for out-of-hospital cardiac arrest/OHCA (n = 62), cardiovascular diseases/CVDs (n = 19), and trauma (n = 24). The performance of these ML algorithms varied, with a median area under the receiver operating characteristic curve (AUC) of 85.6%, accuracy of 88.1%, sensitivity of 86.05%, and specificity of 86.5%. Within the operational studies, the operational task of most ML algorithms was ambulance allocation (n = 21), followed by ambulance detection (n = 5), ambulance deployment (n = 5), route optimization (n = 5), and quality assurance (n = 3). The performance of all operational ML algorithms varied and had a median AUC of 96.1%, accuracy of 90.0%, sensitivity of 94.4%, and specificity of 87.7%. Generally, neural network and ensemble algorithms, to some degree, out-performed other ML algorithms.

Conclusion:

Triaging and managing different prehospital medical conditions and augmenting ambulance performance can be improved by ML algorithms. Future reports should focus on a specific clinical condition or operational task to improve the precision of the performance metrics of ML models.

Information

Type
Research Report
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press on behalf of World Association for Disaster and Emergency Medicine
Figure 0

Figure 1. PRISMA Flow Chart.Abbreviations: ML, machine learning; EMS, Emergency Medical Services; CAS, Computer & Applied Sciences.

Figure 1

Table 1. Baseline Characteristics of the Included Studies across the Two Domains

Figure 2

Figure 2. Distribution of the Included Studies Over the Years.Abbreviations: ML, machine learning; EMS, Emergency Medical Services.

Figure 3

Table 2. Characteristics of EMS-Guided ML Applications across Studies in Clinical Conditions

Figure 4

Figure 3. Median and Range of the Best Machine Learning (ML) Algorithm amid to Triage or Diagnose the Clinical Condition and Predict their Clinical Outcomes.Abbreviations: OHCA, out-of-hospital cardiac arrest; CVD, cardiovascular diseases; AUC, area under the receiver operating characteristic curve.

Figure 5

Table 3. Characteristics of EMS-Guided ML Applications across Studies in Operational Subdomains

Figure 6

Figure 4. Median and Range of the Best Machine Learning (ML) Algorithm Categorized by Operational Tasks and Algorithm Type.Abbreviation: AUC, area under the receiver operating characteristic curve.

Supplementary material: File

Alrawashdeh et al. supplementary material

Alrawashdeh et al. supplementary material
Download Alrawashdeh et al. supplementary material(File)
File 689.5 KB