Hostname: page-component-76fb5796d-5g6vh Total loading time: 0 Render date: 2024-04-26T03:29:46.169Z Has data issue: false hasContentIssue false

Biases in COVID-19 Case and Death Definitions: Potential Causes and Consequences

Published online by Cambridge University Press:  12 December 2022

Ronald B. Brown*
Affiliation:
School of Public Health Sciences, University of Waterloo, Waterloo, ON, Canada
*
Corresponding author: Ronald B. Brown, Email: r26brown@uwaterloo.ca.
Rights & Permissions [Opens in a new window]

Abstract

This paper investigates three controversies involving potential causes and consequences of information bias in case and death definitions during the coronavirus disease (COVID-19) pandemic. First, evidence suggests China’s surveillance data were biased and misinterpreted by the World Health Organization (WHO), prompting the WHO to advise nations to copy China’s lockdowns. China appeared to use narrow diagnostic definitions that undercounted cases and deaths. Second, novel genomic data disseminated during the pandemic without adequate guidance from rigorous epidemiologic studies biased infection control policies in many countries. A novel genomic sequence of a virus is insufficient to declare new cases of a novel disease. Third, media reports of COVID-19 surveillance data in many nations appeared to be biased. Broadened surveillance definitions captured additional information, but unadjusted surveillance data disseminated to the public are not true cases and deaths. Recommendations include clarification of the proper use of diagnostic and surveillance case and death definitions to avoid information bias.

Type
Policy Analysis
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of Society for Disaster Medicine and Public Health, Inc.

Information bias is systematic error during the collection, analysis, interpretation, and publication of data, leading to false conclusions about the relationship between exposures and diseases. Reference Tripepi, Jager, Dekker and Zoccali1 The present policy analysis investigates potential causes and consequences of information bias in coronavirus disease (COVID-19) case and death definitions, focusing on three controversies. The first controversy involves the World Health Organization’s (WHO) potential misinterpretation of China’s underreported surveillance case and death data, which may have misled the WHO into prompting nations to copy China’s lockdowns. The second controversy examines the activation of measures by nations to contain COVID-19 based on novel genomic sequencing data, without interpreting data from rigorous epidemiologic studies. The final controversy implicates media dissemination of unadjusted surveillance data that do not properly contextualize true COVID-19 cases and deaths. Errors in infection and disease nomenclature that occurred during the pandemic are also reviewed.

Grounded theory was used as a method to rigorously review the evidence in this paper. Reference Wolfswinkel, Furtmueller and Wilderom2 Findings were searched and selected from relevant public health documentation using Google, Google Scholar, PubMed, and other sources from the University of Waterloo Library. Current periodicals and credible international news media also provided information as pandemic events occurred in real time. Reviewed evidence was formed into themes and synthesized into a coherent narrative grounded in evidence.

CHINA’S Novel Coronavirus Case Definitions

Within two years, from April 17, 2020, through April 16, 2022, China reported only six COVID-19 deaths and approximately 96 000 cases. 3 During the same period, approximately 81.6 million US novel coronavirus cases with approximately 979 000 COVID-19 deaths were reported. 4 Furthermore, after a 76-day lockdown was lifted in Wuhan, China, on April 8, 2020, Reference Qian and Hanser5 China remained free from lockdowns for the next year, with the exception of two cities near Beijing in January, 2021. Reference Slotkin6 The WHO defines lockdowns as “large scale physical distancing measures and movement restrictions” that “can slow COVID-19 transmission by limiting contact between people." 7 However, evidence suggests that China’s exceedingly narrow case definitions played a significant role in reducing China’s case and mortality statistics.

“A case definition is a set of standard criteria for classifying whether a person has a particular disease, syndrome, or other health condition.” Reference Dicker, Coronado, Koo and Parrish8 Moreover, “using an inaccurate case definition may lead to misclassification bias,” Reference Pham, Cummings and Lindeman9 a form of information bias. The WHO explained that case definitions should balance specificity and sensitivity for disease surveillance purposes. 10 That is, overly narrow case definitions with inaccurate specificity exclude true cases, and overly broad case definitions with inaccurate sensitivity include false cases. The WHO emphasized that “a surveillance case definition is not intended to be used for diagnostic purposes, or for treating influenza or influenza-like illnesses.” 10 Nevertheless, China reported COVID-19 surveillance cases and deaths that appeared to use diagnostic definitions.

Citing China’s 80% decline in cases during February 2020, a WHO-China Joint Mission on COVID-19 advised nations to do what China has done to “save lives and prevent thousands of cases of what is a very difficult disease.” 11 Nations complied and copied China’s “unprecedented” lockdown measures to contain the virus. Reference Cyranoski12 By February 22, 2020, China’s National Health Commission adopted the term novel coronavirus pneumonia (NCP) as China’s official disease name during the pandemic. 13 To avoid an association with the previous SARS pandemic, China named the new virus, 2019-novel Coronavirus (2019-nCoV). Reference Jiang, Shi and Shu14 Moreover, the National Health Commission’s policy tested for the virus exclusively in pneumonia patients, Reference Branswell15 passing over less severe and asymptomatic respiratory infections and lowering case numbers. Additionally, patients without pneumonia were potentially less likely to be tested and confirmed as novel coronavirus cases, even if patients had a severe acute respiratory illness or condition known to be associated with SARS-CoV-2 and COVID-19, including respiratory syncytial virus, Reference Alvares16 tuberculosis, Reference Yang and Lu17 bronchiolitis, Reference Huang, Sun and Tay18 and patients with mucociliary dysfunction—a condition that affects smell and taste. Reference Koparal, Kurt, Altuntas and Dogan19

China’s National Health Commission listed NCP case definitions—“Moderate cases showing fever and respiratory symptoms with radiological findings of pneumonia”—including differential diagnosis criteria, in which “COVID-19 is mainly distinguished from other known viral pneumonia and mycoplasma [bacterial] pneumoniae infections.” 20 Differential diagnosis further narrowed China’s case definitions by including only COVID-19 patients without coinfections. Of relevance, 1 study found that as many as 86% of patients infected with SARS-CoV-2 in March and April 2020 were coinfected with additional respiratory pathogens, Reference Massey, Jayathilake and Meltzer21 but that this high rate may be due to selective testing of more severe cases in early 2020. A more recent worldwide meta-analysis found 20.97% bacterial, 12.58% viral, and 12.60% fungal coinfections in COVID-19 patients. Reference Pakzad, Malekifar and Shateri22 Failure to recognize information bias in China’s exceedingly narrow diagnostic case definitions may have misled the WHO into prompting other nations to reduce cases and deaths by following China’s lockdowns. Eventually, the WHO admitted that lockdowns were not having the same level of success in other countries, and, at a May 13, 2020, briefing, WHO officials reluctantly declared, “This virus may never go away.” Reference Farge and Shields23 Recently, the WHO’s Director-General claimed that China’s zero-COVID policy is not “sustainable.” Reference Rigby and Mason24 With more widespread testing now compared to February 2020, it is much more apparent that lockdowns aren’t containing the spread of COVID-19.

Genomic Epidemiology

Over approximately the last 15 years, the identification of novel viral species accelerated with the development of genome-sequencing technology. Reference Mallapaty25 However, a newly discovered genomic sequence of a virus is insufficient to declare new cases of a novel disease without more rigorous human studies. Reference de Jesús26 Epidemiology is not keeping pace with advances in genomic sequencing technologies to “bridge the gap between genomic epidemiology and real-life infection control.” Reference Tang, Croxen and Hasan27 Large cohort studies are needed to evaluate the association of emerging viruses and variants with epidemiological factors such as demographic characteristics, socioeconomic data, and predisposing comorbidities. Reference Lechien and Saussez28

Based on a newly discovered genomic sequence, the WHO notified nations in February 2020 that the unknown virus of concern “is not SARS and this is not influenza.” 11 Lacking data from epidemiologic studies for guidance, the WHO warned countries to “activate and scale up your emergency response mechanisms” and “take urgent and aggressive action.” 29 In response, Stanford University epidemiologist John Ioannidis warned that “we are making decisions without reliable data.” Reference Ioannidis30

In the meantime, the preliminary evaluation expert group that discovered the genomic sequence of the novel coronavirus from Wuhan acknowledged that further steps were needed “to combine etiological research, epidemiological investigation and clinical manifestations for expert research and judgment.” Reference Yingchun31 Although Wuhan cases were initially identified as viral pneumonia of unknown etiology, Reference Li32 cases may not have been as novel as implied by China’s dysfunctional surveillance system for detecting pneumonia of unknown etiology (PUE). A 2016 survey from Chinese and US Centers for Disease Control and Prevention (CDC) showed that China’s PUE system used a very broad case definition that could lead to “hundreds of thousands” of cases a year. Reference Xiang, Song and Wang33 The survey noted that national PUE training had been lacking in China since 2008, and “most clinicians have limited awareness of and are not reporting to the PUE system,” suggesting that many cases similar to the Wuhan cases remained unreported.

WHO Surveillance Case and Death Definitions

A common error in the medical subspecialty of infectious diseases assumes that “infection is synonymous with disease.” 34 But infection alone, the multiplication of microbes within the body, may be insufficient to lead to disease without signs and symptoms of illness or cell damage from the infection. Reference Drexler35 The WHO appeared to commit a nomenclature error by naming the pandemic disease novel coronavirus disease 2019 (COVID-19), which is synonymous with the WHO’s original name for the virus, 2019-novel coronavirus (2019-nCoV). 36 The WHO’s initial avoidance of the virus name SARS-CoV-2 appears to have been motivated by the desire to disassociate the pandemic from the SARS 2003 pandemic, which burdened China’s economy. 37

The WHO defined a confirmed case in March 2020 as “a person with laboratory confirmation of COVID-19 infection, irrespective of clinical signs and symptoms.” 38 Medical experts objected to the absence of disease or injury in the WHO’s surveillance definitions, Reference James39 and the conflation of the viral infection with the disease was considered “an unforgiveable breach of a first rule in infectiology.” Reference Reiss and Bhakdi40 Such confusion may arise if public health authorities fail to convey to the public that the use of surveillance case definitions is intended to collect data across the full range of cases and infections (severe, moderate, mild, and asymptomatic) and is not intended for diagnostic purposes.

The WHO defined a COVID-19 death in August 2020 as “a death resulting from a clinically compatible illness in a probable or confirmed COVID-19 case, unless there is a clear alternative cause of death that cannot be related to COVID-19 disease (e.g. trauma).” 41 In contrast with China’s narrow definitions, the WHO’s definition increased surveillance sensitivity to include many more deaths beyond the boundaries of severe acute respiratory illness, as evidenced by the CDC’s report listing unrelated conditions contributing to US death certificates for COVID-19. Reference Gundlapalli, Lavery and Boehmer42

Tsang et al. reported that broadened COVID-19 case definitions helped gather additional information about the extent of the infection, “particularly milder cases and those without epidemiological links.” Reference Tsang, Wu and Lin43 The researchers advised that broadened case definitions should be adjusted “to avoid bias” when estimating the true epidemic growth rate and infection rate. Nevertheless, many nations failed to adjust data accordingly, and biased COVID-19 cases and death rates were reported in the media that did not properly “contextualize” true cases and deaths. Reference Koh and Geller44,Reference Mach, Salas Reyes and Pentz45

Summary

Figure 1 summarizes information bias in COVID-19 case and death definitions discussed in this paper. China appeared to use narrow diagnostic case definitions to underreport novel coronavirus cases and deaths as surveillance data, which prompted the WHO to recommend that other nations adopt China’s unprecedented lockdowns. Public health responses to contain the novel coronavirus and variants were based on genomic surveillance data without sufficient guidance from data of epidemiologic studies. The WHO’s surveillance case definitions conflated disease and infection nomenclature by assigning the disease a name synonymous with the virus, and laboratory-confirmed infections were sufficient to confirm disease cases. In contrast with China’s narrow diagnostic data, broad surveillance data disseminated by the media in other nations were not adjusted to represent true cases and deaths. The present paper recommends greater clarification in the proper use of diagnostic and surveillance case and death definitions to avoid information bias. More studies are needed to examine additional evidence and quantitative analyses of COVID-19 cases and deaths in nations across the globe.

Figure 1. Bias in COVID-19 case and death definitions.

References

Tripepi, G, Jager, KJ, Dekker, FW, Zoccali, C. Selection bias and information bias in clinical research. Nephron Clin Pract. 2010;115(2):c94-c99.CrossRefGoogle ScholarPubMed
Wolfswinkel, JF, Furtmueller, E, Wilderom, CPM. Using grounded theory as a method for rigorously reviewing literature. Eur J Inform Syst. 2013;22(1):45-55.CrossRefGoogle Scholar
China. Worldometer Website. worldometers.info. Updated September 9, 2022. Accessed September 9, 2022. https://www.worldometers.info/coronavirus/country/china/ Google Scholar
United States. Worldometer Website. worldometers.info. Updated September 9, 2022. Accessed September 9, 2022. https://www.worldometers.info/coronavirus/country/us/ Google Scholar
Qian, Y, Hanser, A. How did Wuhan residents cope with a 76-day lockdown? Chin Sociol Rev. 2021;53(1):55-86.CrossRefGoogle Scholar
Slotkin, J. Millions in China under new restrictions amid COVID-19 spike near Beijing. npr.org Website. Published January 9, 2021. Accessed August 27, 2021. https://www.npr.org/sections/coronavirus-live-updates/2021/01/09/955298826/millions-in-china-under-new-restrictions-amid-covid-19-spike-near-beijing Google Scholar
Coronavirus Disease (COVID-19): Herd Immunity, Lockdowns and COVID-19. World Health Organization Website. Published December 31, 2020. Accessed December 10, 2021. https://www.who.int/news-room/questions-and-answers/item/herd-immunity-lockdowns-and-covid-19 Google Scholar
Dicker, R, Coronado, F, Koo, D, Parrish, RG. Principles of epidemiology in public health practice. US Department of Health and Human Services; 2006.Google Scholar
Pham, A, Cummings, M, Lindeman, C, et al. Recognizing misclassification bias in research and medical practice. Fam Pract. 2019;36(6):804-807.Google ScholarPubMed
Global Epidemiological Surveillance Standards for Influenza. World Health Organization Website. Published August 9, 2013. Accessed July 4, 2021. https://www.who.int/publications/i/item/9789241506601 Google Scholar
Subject: Press Conference of WHO-China Joint Commission on COVID-19. World Health Organization. Published February 24, 2020. Accessed March 28, 2021. https://www.who.int/docs/default-source/coronaviruse/transcripts/joint-mission-press-conference-script-english-final.pdf?sfvrsn=51c90b9e_2 Google Scholar
Cyranoski, D. What China’s coronavirus response can teach the rest of the world. Nature. 2020;579(7800):479-481.CrossRefGoogle ScholarPubMed
China Adopts COVID-19 as Official English Name for Disease. China Daily Hong Kong Website. Published February 22, 2020. Accessed October 3, 2020. https://www.chinadailyhk.com/article/122047 Google Scholar
Jiang, S, Shi, Z, Shu, Y, et al. A distinct name is needed for the new coronavirus. Lancet (London, England). 2020;395(10228):949.CrossRefGoogle ScholarPubMed
Branswell, H. Experts say confusion over coronavrius case count in China muddying picture of spread. STAT Website. Published February 20, 2020. Accessed October 17, 2020. https://www.statnews.com/2020/02/20/experts-say-confusion-over-coronavirus-case-count-in-china-is-muddying-picture-of-spread/ Google Scholar
Alvares, PA. SARS-CoV-2 and respiratory syncytial virus coinfection in hospitalized pediatric patients. Pediatr Infect Dis J. 2021;40(4):e164-e166.CrossRefGoogle ScholarPubMed
Yang, H, Lu, S. COVID-19 and tuberculosis. J Transl Int Med. 2020;8(2):59-65.Google ScholarPubMed
Huang, C-F, Sun, P-T, Tay, CK. Bronchiolitis and potential pathophysiological implications in coronavirus disease 2019 acute respiratory distress syndrome patients with near-normal respiratory compliance. Crit Care Med. 2020;48(10):e993-e994.Google ScholarPubMed
Koparal, M, Kurt, E, Altuntas, EE, Dogan, F. Assessment of mucociliary clearance as an indicator of nasal function in patients with COVID-19: a cross-sectional study. Eur Arch Otorhinolaryngol. 2021;278(6):1863-1868.CrossRefGoogle ScholarPubMed
National Health Commission. Diagnosis and treatment protocol for novel coronavirus pneumonia (Trial Version 7). Chin Med J (Engl). 2020;133(9):1087-1095.Google Scholar
Massey, BW, Jayathilake, K, Meltzer, HY. Respiratory microbial co-infection with SARS-CoV-2. Front Microbiol. 2020;11(2079):1-7.CrossRefGoogle ScholarPubMed
Pakzad, R, Malekifar, P, Shateri, Z, et al. Worldwide prevalence of microbial agents’ coinfection among COVID-19 patients: a comprehensive updated systematic review and meta-analysis. J Clin Lab Anal. 2022;36(1):e24151.CrossRefGoogle ScholarPubMed
Farge, E, Shields, M. “This virus may never go away,” WHO says. Reuters Website. Published May 13, 2020. Accessed August 7, 2020. https://www.reuters.com/article/us-health-coronavirus-who-briefing/this-virus-may-never-go-away-who-says-idUSKBN22P2IJ Google Scholar
Rigby, J, Mason, J. WHO chief says China’s zero-COVID policy not “sustainable.” Reuters Website. Published May 10, 2022. Accessed September 11, 2022. https://www.reuters.com/world/china/who-chief-says-chinas-zero-covid-policy-not-sustainable-2022-05-10/ Google Scholar
Mallapaty, S. Should virus-naming rules change during a pandemic? The question divides virologists. Nature. 2020;584(7819):19-20.Google ScholarPubMed
de Jesús, EG. Is the coronavirus mutating? Yes. But here’s why you don’t need to panic. Science News Website. Published May 26, 2020. Accessed August 28, 2020. https://www.sciencenews.org/article/coronavirus-covid19-mutations-strains-variants Google Scholar
Tang, P, Croxen, MA, Hasan, MR, et al. Infection control in the new age of genomic epidemiology. Am J Infect Control. 2017;45(2):170-179.Google ScholarPubMed
Lechien, JR, Saussez, S. Importance of epidemiological factors in the evaluation of transmissibility and clinical severity of SARS-CoV-2 variants. Lancet Infect Dis. 2021;22(1):2-3.CrossRefGoogle ScholarPubMed
WHO Director-General’s Opening Remarks at the Media Briefing on COVID-19—11 March 2020. World Health Organization Website. Published 2020. Accessed December 27, 2021. https://www.who.int/director-general/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020 Google Scholar
Ioannidis, JP. A fiasco in the making? As the coronavirus pandemic takes hold, we are making decisions without reliable data. Stat Website. Published 2020. Accessed March 17, 2020. https://www.statnews.com/2020/03/17/a-fiasco-in-the-making-as-the-coronavirus-pandemic-takes-hold-we-are-making-decisions-without-reliable-data/ Google Scholar
Yingchun, S. Wuhan pneumonia: The pathogen of the epidemic was preliminarily determined to be the new coronavirus. Sina News Website. Published January 9, 2020. Accessed January 31, 2023. https://news.sina.cn/gn/2020-01-09/detail-iihnzhha1262297.d.html?from=groupmessage&isappinstalled=0&scene=1&clicktime=1578530857&enterid… Google Scholar
Li, Q. An outbreak of NCIP (2019-nCoV) infection in China—Wuhan, Hubei Province, 2019−2020. China CDC Wkly. 2020;2(5):79-80.CrossRefGoogle Scholar
Xiang, N, Song, Y, Wang, Y, et al. Lessons from an active surveillance pilot to assess the pneumonia of unknown etiology surveillance system in China, 2016: the need to increase clinician participation in the detection and reporting of emerging respiratory infectious diseases. BMC Infect Dis. 2019;19(1):770.CrossRefGoogle ScholarPubMed
Companion Guide to Infectious Diseases of Mice and Rats. National Research Council (US) Committee on Infectious Diseases of Mice and Rats. Published 1991. Accessed September 27, 2020. https://www.ncbi.nlm.nih.gov/books/NBK235412/ Google Scholar
Drexler, M. Institute of Medicine. How infection works. In: What You Need to Know About Infectious Disease. National Academies Press (US); 2010.Google ScholarPubMed
Novel Coronavirus (2019-nCoV) Situation Report 22. World Health Organization Website. Published February 11, 2020. Accessed September 16, 2020. https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200211-sitrep-22-ncov.pdf?sfvrsn=fb6d49b1_2 Google Scholar
Naming the Coronavirus Disease (COVID-19) and the Virus that Causes It. World Health Organization Website. Published 2020. Accessed October 2, 2020. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/naming-the-coronavirus-disease-(covid-2019)-and-the-virus-that-causes-it Google Scholar
Coronavirus Disease 2019 (COVID-19) Situation Report - 43. World Health Organization Website. Published March 3, 2020. Accessed October 28, 2020. https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200303-sitrep-43-covid-19.pdf?sfvrsn=76e425ed_2 Google Scholar
James, JJ. From COVID-19 to COVID-20: one virus, two diseases. Disaster Med Public Health Prep. 2020;14(6):e18-e20.CrossRefGoogle ScholarPubMed
Reiss, K, Bhakdi, S. Corona, false alarm? Facts and figures. Chelsea Green; 2020.Google Scholar
Public Health Surveillance for COVID-19: Interim Guidance. World Health Organization Website. Published August 7, 2020. Accessed October 15, 2020. https://www.who.int/publications/i/item/who-2019-nCoV-surveillanceguidance-2020.7 Google Scholar
Gundlapalli, AV, Lavery, AM, Boehmer, TK, et al. Death certificate-based ICD-10 diagnosis codes for COVID-19 mortality surveillance—United States, January-December 2020. MMWR Morb Mortal Wkly Rep. 2021;70(14):523-527.Google ScholarPubMed
Tsang, TK, Wu, P, Lin, Y, et al. Effect of changing case definitions for COVID-19 on the epidemic curve and transmission parameters in mainland China: a modelling study. Lancet Public Health. 2020;5(5):e289-e296.Google ScholarPubMed
Koh, HK, Geller, AC, VanderWeele TJ. Deaths from COVID-19. JAMA. 2021;325(2):133-134.Google ScholarPubMed
Mach, KJ, Salas Reyes, R, Pentz, B, et al. News media coverage of COVID-19 public health and policy information. Human Soc Sci Commun. 2021;8(1):220.CrossRefGoogle Scholar
Figure 0

Figure 1. Bias in COVID-19 case and death definitions.