Introduction
The COVID-19 pandemic spurred rapid investigation to understand and predict the severity of disease among infected patients. Given the major gap in understanding of the clinical course and subsequent disease progression, the World Health Organization (WHO) emphasized daily clinical assessments of patients with COVID-19 [1]. Understanding the trajectory of rapidly progressing diseases might inform the timing of intervention, scientifically relevant endpoints for clinical trials, and help with resource capacity management such as hospital and intensive care unit (ICU) bed capacity [Reference Douin, Ward and Lindsell2].
Despite the potential advantages of full information on clinical trajectories, most trials have compared treatment groups at cross-sectional timepoints, e.g., 14 or 30 days after randomization, have used ordered summary measures like ventilator-free days, or time-to-event analyses (e.g., time to recovery). Such approaches do not consider the rich information content arising from the dynamic nature of disease. Statistical methods that model dynamic outcomes have been available for some time [Reference Peña3], and the current pandemic offers the opportunity to demonstrate their real-world application.
Here, we describe the use of a state transition model to evaluate the daily course of critically ill COVID-19 patients. Widely used as a modeling approach in decision analyses and economic evaluations, state transition models conceptualize a series of potential health states and the transitions that occur between them over time [Reference Siebert, Alagoz and Bayoumi4]. Such a transition model can be simplified in the four states (Fig. 1): one starting state, two transitional states, and one absorbing state. An absorbing state is one from which patients cannot subsequently transition. A sample trajectory could be represented as a critically ill patient requiring mechanical ventilation entering the model (Starting state). On Day 1, they recover and are placed on noninvasive ventilation (State 1). On Day 2, they remain in the same state, and on Day 3, they recover and no longer require noninvasive ventilation. On Day 4, they no longer require critical care and are discharged from the ICU (absorbing state). The multistate model assumes that there is an instantaneous risk of moving between states, as represented, respectively, in the transition intensities matrix Q (Fig. 1).
Simplified representation of a Markov transition model. Four states are represented: 1) starting state; 2) two transitional states; and 3) absorbing state. Arrows represent the direction of a transition. Circular arrows represent a transition to the same state. In the transition matrix (Q), the intensity reflects the frequency with which the specific transition is observed. For example, q12 represents the transition intensity (hazard) from state 1 to state 2 and covariates in the model change the magnitudes (hazard ratios) of these intensities (hazards).
Using this approach, we demonstrate how baseline demographic and clinical characteristics contribute to the trajectory of disease. We propose that such modeling approaches increase the efficiency with which information is derived from clinical research by better capturing dynamic changes in patient condition.
Methods
We collected data in real time through surveillance of patients with COVID-19 admitted to nine ICUs across the United States between March and July 2020 that were part of the CDC-funded Influenza and Other Viruses in the Acutely Ill (IVY) network [Reference Douin, Ward and Lindsell2,Reference Self, Tenforde and Stubblefield5,Reference Lytle, Collins and Feldstein6]. Patients were included if they tested positive for SARS-CoV-2 and were admitted to an ICU at any time during their index hospitalization. Through chart abstraction using standardized case report forms, baseline demographics and comorbidities were obtained, and a clinical status scale was assessed daily from ICU admission until either discharge from the ICU, death, or 28 days in the ICU. The five-level scale included 1) discharged alive from the ICU, 2) no supplemental oxygen but still in the ICU, or supplemental oxygen therapy by standard mask or nasal cannula but still in the ICU, 3) high-flow nasal cannula or noninvasive ventilation (continuous positive airway pressure or bilevel positive airway pressure ), 4) invasive mechanical ventilation or extracorporeal membrane oxygenation (ECMO) and 5) death. Patients were classified each calendar day based on the highest level reached for that day. A state transition was defined as movement on the five-level clinical scale from one day to the next consecutive day during the ICU admission. We excluded patients for whom ICU data were not available or who had an ICU length of stay of one day or less as no state transition could occur.
Statistical model
We constructed a multistate Markov transition model to describe the individual patient’s process of transition through the 5 ordinal states over a single ICU stay. Readmissions were treated as new ICU stays [Reference Jackson7]. Discharge from the ICU and death were considered absorbing states. For patients not in absorbing states there are three types of transitions: 1) disease progression, in which their daily status worsens (e.g., conventional supplemental oxygen to ECMO), 2) disease recovery, when a patient’s daily status improves (e.g., mechanical ventilation to supplemental oxygen), or 3) unchanged, when a patient’s clinical status is unchanged from the prior day. Throughout an ICU stay, multiple daily transitions were possible.
From chart review, we included the following covariates: sex, age group (18–49, 50–64, 65+ years), race-ethnicity group (non-Hispanic White, non-Hispanic Black, Hispanic, and Other), and presence of any of 10 comorbidities (asthma, chronic obstructive pulmonary disease, stroke, coronary artery disease, diabetes mellitus, obesity, hypertension, chronic kidney disease, heart failure, or immunosuppression). Each comorbidity was treated as a binary variable for the historical presence or absence of that condition prior to admission. To reduce the number of covariates in the multistate transition model, we applied a restrained proportional hazard model. While there was a unique base transition intensity for every transition between two states, we assume all covariates have the same effects (hazard ratios) on all progressive and recovery transitions. In other words, our model estimated one average hazard ratio for each covariate effect on either all progressive transitions or all recovery transitions. This parsimonious model would be most indicative of clinical decision-making about potential transition status (progression vs. recovery) for the next day. All analyses were conducted in R version 4.0.3 [Reference Team8], and the multistate model was applied using the msm package [Reference Jackson9]. This activity was reviewed by CDC and was conducted consistent with applicable federal law and CDC policy (see e.g., 45 C.F.R. part 46.102(l)(2), 21 C.F.R. part 56; 42 U.S.C. Sect. 241(d); 5 U.S.C. Sect. 552a; 44 U.S.C. Sect. 3501 et seq.).
Results
We included 514 patients representing 516 ICU admissions from March to July 2020. The two repeat ICU admissions were considered as independent events in the demonstration analysis; the lack of systematic capture of states after ICU discharge precluded inclusion of return to the ICU as a meaningful transition. The cohort is described in Table 1. There were between 1 and 152 cases at each of the nine sites. Participants had a median age of 61.7 (interquartile range [IQR] 50.2–71.3) years, 210 (41%) were aged 65 years or older, 166 (32%) were women, 169 (33%) were non-Hispanic White, 133 (26%) were non-Hispanic Black, and 158 (31%) were Hispanic of any race. Among the 516 admissions, 338 (66%) received mechanical ventilation and/or ECMO at some point during their ICU stay. Overall, 134 (26%) died during their ICU stay. The median ICU length of stay was 8 (IQR 3–17) days. We observed a total of 5,607 transitions. Among the three potential statuses for each transition (disease progression, disease recovery, and unchanged), there were 292 (5.2%) disease progressions from 222 unique patients, 469 (8.4%) recoveries from 351 unique patients, and the remainder were unchanged.
Demographics of the COVID-19 intensive care unit (ICU) stay cohort in nine participating hospitals, March–July 2020
* Categories presented are mutually exclusive and represent the most severe clinical state on 1 or more days during ICU admission, e.g., if patient died in the ICU but received invasive mechanical ventilation before death they are classified as “Death.”
† Transition states add up to > 100% as a patient could experience both recovery and progression transitions during ICU admission.
Proportional hazards for recovery or progression on any given day are shown in Fig. 2. In the multistate transition model, males and older persons had lower probabilities of recovery transition on any given day: (hazard ratio [HR] for males 0.78, 95% CI 0.63, 0.95); HR 0.68 (95% CI 0.54, 0.87) for the 50–64 years age group and HR 0.70 (95% CI 0.53, 0.91) in the ≥65 age group (reference group: 18- to 49-year-olds). Moreover, those in the oldest age group (65+ years) were more likely to progress (HR 1.97 95% CI 1.35, 2.86) than recover. Among the studied comorbidities, patients with COPD were more likely to progress on any given day compared with patients without COPD (HR 1.44 95% CI 1.00, 2.06). Extensions to this modeling strategy would allow the transition probabilities to vary over time within subgroups and for the introduction of intercurrent events that might even inform state transitions, such as the use of concomitant therapy.
Adjusted hazard ratios of progression and recovery from COVID-19 using a multistate transition model in ptients admitted to the intensive care units (ICUs) in nine participating hospitals, March–July 2020. Note: Adjusting variables included all of the following: sex, age group (18–49, 50–64, 65+ years), race-ethnicity group (non-Hispanic White, non-Hispanic Black, Hispanic, and Other), or the presence of any of 10 comorbidities (asthma, chronic obstructive pulmonary disease, stroke, coronary artery disease, diabetes mellitus, obesity, hypertension, chronic kidney disease, heart failure, or immunosuppression).
Discussion
This multisite analysis of data from nine academic ICUs models daily clinical trajectory for critically ill COVID-19 patients early in the pandemic. Our findings are consistent with prior research, showing that male sex [Reference Peckham, de Gruijter and Raine10] and older age [Reference Rosenthal, Cao, Gundrum, Sianis and Safo11] are risk factors for poor prognosis in critically ill patients with COVID-19. By showing how the probability of progressing or recovering on any given day depends on baseline covariates, we demonstrate that a multistate transition model based on daily assessments of an ordinal clinical state can offer additional information beyond studies that consider single times or events. This method could prove useful in understanding how therapies affect disease trajectory and may complement traditional clinical trials.
Through this report, we demonstrate how modeling daily assessments could improve our ability to understand the clinical course of critically ill patients with COVID. In the 516 admissions analyzed, we identified over 6,000 daily states reflecting over 5,600 possible state changes. State changes occurred frequently, underscoring the dynamic nature of critical illness in COVID-19. Incorporating temporal information could help to improve our understanding of factors that affect the need for respiratory support in the critical care setting for future pandemics. Further, evaluation of subgroups (e.g., patient demographics or clinical characteristics) is possible and could be pursued to elucidate potential implications for specific patient populations.
This report is intended as a demonstration that the use of transition state modeling provides utility in evaluating the transition of patients between different states of health during critical illness. As such, we have offered a reasonably simplistic treatment of the data. A more thorough treatment of these data would involve exploring the proportionality assumption, accounting for the within-subject and within-site correlation for the repeat admissions, allowing the effects of baseline covariates or treatments to differ depending on the level of the outcome (i.e., level on the clinical scale), to include time-varying covariates (e.g., clinical severity), including differential effects of each covariate, and to explore time by treatment interaction effects. The focus of this work is also restricted to events that occurred in the ICU; states that occurred during the remainder of hospitalizations were not included. A more systematic evaluation of health state after ICU discharge may have allowed us to model the risk of return to the ICU, or return of symptoms and would be recommended. Recognizing that worsening can occur after an improvement is a strength of longitudinal modeling strategies over methods that evaluate time to recovery.
We caution readers not to overinterpret our report; whether the current clinical trajectory of patients in ICUs remains similar is unknown as management practices have changed and additional therapeutic options have become available [Reference Beigel, Tomashek and Dodd12,13]. Such a phenomenon could be explored by considering the period of the pandemic as a covariate in the model We also note that our outcome scale is restricted to a subset of the WHO’s 11-point Clinical Progression Scale [1], which covers the entire spectrum of COVID-19 from undetectable viral levels through death. Given the challenge of obtaining daily observational surveillance data subsequent to ICU discharge, our outcome scale is only comparable to the WHO Clinical Progression Scale for inpatients. Finally, our simplifying assumption allows for the demonstration of this transition model. Removing this assumption could allow for a more thorough understanding of the relationship each covariate has on clinical progression or recovery. Despite the limitations in both the interpretation and scope of our demonstration model, we posit that this approach would be similarly informative if routine assessments were available in any patient setting and for any ordered scale that is reflective of patients’ experience. Indeed, the approach that we describe here is applicable to other diseases, specific subgroups within our current population, to future COVID-19 surges, and to future epidemics and pandemics.
Conclusions
Using a multistate model of daily assessments, we have demonstrated a method of modeling the dynamic nature of critical illness in COVID-19 patients as it relates to baseline covariates. Future use of methods such as these for modeling change over time could improve our understanding of how therapies and other interventions influence the clinical trajectory of all patients, not just critically ill patients with COVID-19.
Acknowledgments
Primary funding for this work was provided by the Centers for Disease Control and Prevention (contract 75D30120C07637). The data tools used in the study were supported by Clinical and Translational Science Award No. UL1 TR002243 from the National Center for Advancing Translational Sciences.
Disclaimer
The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
Disclosures
All authors have completed and submitted the International Committee of Medical Journal Editors form for disclosure of potential conflicts of interest. Dr Ginde reports grants from CDC, during the conduct of the study; grants from NIH, grants from Department of Defense, grants from AbbVie, grants from Faron Pharmaceuticals, outside the submitted work. Matthew C. Exline reports talks on nutrition in COVID pneumonia at APEN conference sponsored by Abbott Labs. Akram Khan reports grants from United Therapeutics, Johnson & Johnson, 4D Medical, Lung LLC, and Reata Pharmaceuticals. D. Clark Files reports consultant fees from Cytovale and membership on a Medpace Data Safety Monitoring Board (DSMB). Dr Rice reports grants from Centers for Disease Control (CDC), during the conduct of the study; personal fees from Cumberland Pharmaceuticals, Inc., personal fees from Cytovale, Inc., personal fees from Sanofi, Inc., outside the submitted work. Jonathan D. Casey reports a grant (N23HL153584) from the National Institutes of Health (NIH). Daniel J. Henning reports consulting fees from Cytovale and Opticyte. Samuel M. Brown reports fees from Hamilton for chairing a DSMB, and institutional fees from Faron, Sedana, and Janssen; grants from Sedana, Janssen, NIH, and the Department of Defense (DoD); book royalties from Oxford University and Brigham Young University; and personal fees from New York University for service on a DSMB. Wesley H. Self reports grant funding from CDC for this work; grants and consultant fees from Merck outside this work and consultant fees from Aerpio Pharmaceuticals outside this work. Christopher J. Lindsell reports grants from NIH, DoD, and the Marcus Foundation; organizational contract fees from bioMerieux, Endpoint LLC, and Entegrion, Inc.; and a patent issued to Cincinnati Children’s Hospital Medical Center for risk stratification in sepsis and septic shock. No other potential conflicts of interest were disclosed.
Open access
