Hostname: page-component-77c78cf97d-sp94z Total loading time: 0 Render date: 2026-04-23T12:54:41.819Z Has data issue: false hasContentIssue false

Formulating and evaluating time series algorithms to forecast daily asthma hospital admissions

Published online by Cambridge University Press:  30 July 2025

Stephen P. Colegate*
Affiliation:
Division of Biostatistics and Epidemiology, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Michael Seid
Affiliation:
Division of Pulmonary Medicine, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, USA James M. Anderson Center for Health Systems Excellence, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
David Hartley
Affiliation:
Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, USA James M. Anderson Center for Health Systems Excellence, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Aaron Flicker
Affiliation:
James M. Anderson Center for Health Systems Excellence, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Michael Fisher Child Health Equity Center, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Joseph Bruce
Affiliation:
James M. Anderson Center for Health Systems Excellence, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Michael Fisher Child Health Equity Center, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Joseph Michael
Affiliation:
James M. Anderson Center for Health Systems Excellence, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Michael Fisher Child Health Equity Center, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Mfonobong Udoko
Affiliation:
Division of Pulmonary Medicine, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, USA James M. Anderson Center for Health Systems Excellence, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Andrew F. Beck
Affiliation:
Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, USA James M. Anderson Center for Health Systems Excellence, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Michael Fisher Child Health Equity Center, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Division of General & Community Pediatrics, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Office of Population Health, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA
Cole Brokamp
Affiliation:
Division of Biostatistics and Epidemiology, Cincinnati Children’s Hospital Medical Center, Cincinnati, USA Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, USA
*
Corresponding author: S.P. Colegate; Email: stephen.colegate@cchmc.org
Rights & Permissions [Opens in a new window]

Abstract

Introduction:

Asthma exacerbations are frequent causes of pediatric hospital admissions. We sought to develop a time series algorithm to forecast next-day daily asthma hospitalizations.

Methods:

Daily hospitalizations for asthma were collected at Cincinnati Children’s from January 1, 2016, to December 31, 2023. We evaluated Autoregressive Integrated Moving Average (ARIMA), Exponential Smoothing (ETS), Prophet, and Ensemble models to forecast next-day asthma hospitalizations validated on 2023 data, considering varying historical training data lengths. Forecasts were calibrated to identify days exceeding a 5% high-risk threshold of historical totals and considered multiple validation years and years before and during the COVID-19 pandemic.

Results:

A total of 5,593 hospital admissions were recorded for asthma. Over 2,922 days, 166 days met the 5% high-risk threshold equating to 6 or more admissions. The Ensemble (Median Absolute Percentage Error (MAPE): 46.7%; Positive Predictive Value (PPV): 0.278; Negative Predictive Value (NPV): 0.942; Area Under the ROC Curve (AUC): 0.740; Sensitivity: 0.800; Specificity: 0.656) model achieved higher accuracy of high-risk days than ARIMA (MAPE: 46.5%; PPV: 0.278; NPV: 0.942; AUC: 0.709; Sensitivity: 0.760; Specificity: 0.571), ETS (MAPE: 47.2%; PPV: 0.222; NPV: 0.939; AUC: 0.711; Sensitivity: 0.800; Specificity: 0.668), and Prophet (MAPE: 48.9%; PPV: 0.444; NPV: 0.951; AUC: 0.732; Sensitivity: 0.680; Specificity: 0.741) models.

Conclusions:

Our Ensemble model of mean predictions from ARIMA, ETS, and Prophet models was the most accurate in forecasting future asthma hospitalizations. Integrating forecasting techniques with clinical operations could enable proactive prevention through enhanced population care management.

Information

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Association for Clinical and Translational Science
Figure 0

Figure 1. Daily asthma hospitalizations at Cincinnati Children’s Hospital Medical Center (CCHMC) between 2016 and 2023 on a log1p-scale. Dates are shaded whether the number of admissions was lower (blue), higher (red), or normal (white) relative to the median number of admissions.

Figure 1

Table 1. Asthma hospitalization cases and percentages (%) at Cincinnati Children’s Hospital Medical Center (CCHMC) between 2016 and 2023. Admissions are segmented by period for the training and validation sets. The number of cases and the frequency of cases per day are stated for each period

Figure 2

Figure 2. Comparison of model class prediction accuracy on 2023 asthma hospitalization admissions by length of training history. Median absolute percentage error is compared for varying sizes of training history, from 1 year (2022) to 7 years (2016 – 2022).

Figure 3

Table 2. Validation of 2023 hospitalizations by training period – median absolute percentage error (MAPE), 95% confidence interval coverage percentage (Cover %), positive predictive value (PPV), negative predictive value (NPV), sensitivity (Sens), specificity (Spec), area under the receiver operating characteristic curve (ROC) with 95% confidence interval (AUC + 95%CI)

Figure 4

Table 3. Validation of hospitalization predictions on two-year validation (Trained: 2016-2021; validated: 2022 – 2023), before COVID-19 (Trained: 2016 – 2018; validated: 2019) and during COVID-19 (Trained: 2020-2022; validated: 2023). – median absolute percentage error (MAPE), 95% confidence interval coverage percentage (Cover %), positive predictive value (PPV), negative predictive value (NPV), sensitivity (Sens), specificity (Spec), area under the receiver operating characteristic curve (ROC) with 95% confidence interval (AUC + 95%CI)