Hostname: page-component-89b8bd64d-mmrw7 Total loading time: 0 Render date: 2026-05-08T00:38:28.157Z Has data issue: false hasContentIssue false

Development and external validation of a prognostic tool for nonsevere COVID-19 inpatients

Published online by Cambridge University Press:  19 May 2023

Ensi Luo*
Affiliation:
Department of Endocrinology, Binhaiwan Central Hospital of Dongguan, Dongguan, China
Qingyang Zhong
Affiliation:
Medical Department, The Ninth People’s Hospital of Dongguan, Dongguan, China
Yongtao Wen
Affiliation:
Department of Respiratory Medicine, Binhaiwan Central Hospital of Dongguan, Dongguan, China
Jie Cai
Affiliation:
Department of Respiratory Medicine, Binhaiwan Central Hospital of Dongguan, Dongguan, China
Xia Xie
Affiliation:
Pain Department, Binhaiwan Central Hospital of Dongguan, Dongguan, China
Lingjuan Zhou
Affiliation:
Nursing Department, Binhaiwan Central Hospital of Dongguan, Dongguan, China
*
Corresponding author: Ensi Luo; Email: luo_ensi@yeah.net
Rights & Permissions [Opens in a new window]

Abstract

To develop a machine learning model and nomogram to predict the probability of persistent virus shedding (PVS) in hospitalized patients with coronavirus disease 2019 (COVID-19), the clinical symptoms and signs, laboratory parameters, cytokines, and immune cell data of 429 patients with nonsevere COVID-19 were retrospectively reviewed. Two models were developed using the Akaike information criterion (AIC). The performance of these two models was analyzed and compared by the receiver operating characteristic (ROC) curve, calibration curve, net reclassification index (NRI), and integrated discrimination improvement (IDI). The final model included the following independent predictors of PVS: sex, C-reactive protein (CRP) level, interleukin-6 (IL-6) level, the neutrophil-lymphocyte ratio (NLR), monocyte count (MC), albumin (ALB) level, and serum potassium level. The model performed well in both the internal validation (corrected C-statistic = 0.748, corrected Brier score = 0.201) and external validation datasets (corrected C-statistic = 0.793, corrected Brier score = 0.190). The internal calibration was very good (corrected slope = 0.910). The model developed in this study showed high discriminant performance in predicting PVS in nonsevere COVID-19 patients. Because of the availability and accessibility of the model, the nomogram designed in this study could provide a useful prognostic tool for clinicians and medical decision-makers.

Information

Type
Original Paper
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - SA
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike licence (http://creativecommons.org/licenses/by-nc-sa/4.0), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the same Creative Commons licence is used to distribute the re-used or adapted article and the original article is properly cited. The written permission of Cambridge University Press must be obtained prior to any commercial use.
Copyright
© The Author(s), 2023. Published by Cambridge University Press
Figure 0

Figure 1. Patient screening and enrollment process.

Figure 1

Table 1. Clinical characteristics of the patients

Figure 2

Table 2. Differences in demographics between COVID-19 patients with a duration of viral shedding ≤14 days and > 14 days in the developmental and validation datasets

Figure 3

Table 3. Model 1 for the odds ratios and beta coefficients in the development dataset

Figure 4

Table 4. Model 1 for the odds ratios and beta coefficients in the development dataset

Figure 5

Figure 2. Receiver operating characteristic (ROC) curve of Model 1 (C-statistic = 0.766, Brier score = 0.192, slope = 1).

Figure 6

Figure 3. Decision curve analysis of Model 1. The DCA plot indicates a better clinical net benefit probability in patients with PVS as predicted using Model 1.

Figure 7

Figure 4. Nomogram of Model 1. Predicting the probability of the development of PVS in patients with COVID-19.

Figure 8

Figure 5. Risk prediction for individual patients. For example, a 46-year-old female patient with an NLR value of 0.86, a CRP level of 4.4 mg/L, an IL-6 level of 5.53 μg/mL, an ALB level of 40.4 g/L, a K+ level of 3.5 mmol/L, and an MC of 0.48 × 109/L had a total score of 319. The probability of a DVS > 14 days in this patient was 69.3%.

Figure 9

Table 5. Internal and external validation of Model 1

Figure 10

Figure 6. Calibration curve of Model 1 (corrected C-statistic = 0.748, corrected Brier score = 0.201, corrected slope = 0.910, Hosmer–Lemeshow test P > 0.05).

Figure 11

Figure 7. Calibration curve for the external validation of Model 1. Model 1 performed well in the external validation dataset, with a C-statistic = 0.845, Brier score = 0.155, and slope = 1. It was verified by the bootstrap method with a corrected C-statistic = 0.793, corrected Brier score = 0.190, and corrected slope = 0.672.

Supplementary material: File

Luo et al. supplementary material
Download undefined(File)
File 12.6 KB