Vaccination with currently available vaccines for coronavirus disease 2019 (COVID-19) was associated in clinical trials with substantial local and systemic side effects. Reference Oliver, Gargano and Marin1,Reference Oliver, Gargano and Marin2 Overlap symptoms including fever, headache, fatigue, myalgias, or arthralgias, which may indicate vaccine reactogenicity or infection with severe acute respiratory coronavirus virus 2 (SARS-CoV-2), present distinct challenges for workforce preservation for healthcare facilities that routinely restrict healthcare personnel (HCP) from working with any symptom consistent with SARS-CoV-2 in accordance with public health guidance. Reference Polack, Thomas and Kitchin3,Reference Baden, El Sahly and Essink4 Mass General Brigham (MGB), a large integrated healthcare system and the largest employer in Massachusetts (with >87,000 employees) began vaccination of healthcare personnel (HCP) on December 16, 2020. To support evaluation and management of postvaccination reactions and symptoms, MGB developed a policy aligned with guidance from the Centers for Disease Control and Prevention (CDC) 5 and the Massachusetts Department of Public Health (MDPH) 6 to categorize and manage post-vaccination systemic overlap symptoms. To provide decision support for HCP postvaccination, HCP were actively surveyed in the 3 days after vaccination to categorize postvaccination symptoms and to provide guidance to HCP regarding management and exclusion from work when required.
We describe postvaccination survey compliance, reported systemic overlap symptoms as well as typical COVID-19 symptoms, and results of SARS-CoV-2 testing. We assessed differences in outcomes across HCP demographic characteristics as well as prior known infection with SARS-CoV-2. We additionally report on approaches to implementing this strategy in employees with limited computer skills as well as those with limited English proficiency and access to ensure equity in implementation.
Methods
Study setting and design
The Mass General Brigham (MGB) system is a large, integrated healthcare network operating in Massachusetts and New Hampshire with >87,000 HCP. Vaccination of HCP began across the MGB system on December 16, 2020, initially with Pfizer-BioNTech vaccine and the following week with the Moderna COVID-19 vaccine. The Employee COVID-19 Vaccination Program operated 13 clinics across the enterprise and was completed on March 14, 2021. All 13 clinics followed the same MGB procedures and policies for HCP vaccination. After this time, HCP requesting vaccination were directed to patient vaccination clinics, and they were not included in this analysis. The Johnson & Johnson/Janssen COVID-19 vaccine was introduced in limited supply on March 4, 2021; the results for HCP vaccinated with this product were excluded from the analysis. The activities studied here were considered routine infection control and occupational health procedures and not human subjects research by the Massachusetts General Brigham Institutional Review Board.
COVID-19 employee vaccination policy
The Centers for Disease Control and Prevention (CDC) and the Massachusetts Department of Public Health (MDPH) recommendations for HCP restrictions from work after vaccination base testing and exclusion from work on the type and severity of symptoms experienced after vaccination. 5,6 The MGB employee vaccination policy described postvaccination symptoms and requirements for employees experiencing those symptoms with respect to testing for SARS-CoV-2 and return to work restrictions. “Overlap” symptoms included fever, fatigue, myalgias, arthralgias, or headache. “Typical” COVID-19 symptoms included sore throat, cough, nasal congestion or rhinorrhea, shortness of breath, and anosmia or ageusia. Over the course of the study period, modifications to the policy were made, some of which affected the categorization of severity of overlap symptoms as well as requirements for SARS-CoV-2 testing. Relevant to the current study, between December 16, 2020, and December 31, 2021, employees experiencing mild overlap symptoms for any period after vaccination were referred for testing but could continue to work on site. After January 1, 2021, employees experiencing mild overlap symptoms after vaccination were only referred for testing if the symptom duration exceeded 24 hours in total. After January 21, 2021, the mild overlap symptom category was expanded to describe mild-to-moderate overlap symptoms, separating those from severe postvaccination overlap symptoms. Also, the temperature cutoff between mild-to-moderate versus severe fever was increased from ≥37.7°C (100°F) to ≥38.3°C (101°F) to align with MDPH guidance. To compare responses across the entire period, overlap symptoms were grouped into “lower severity,” which included mild and mild-to-moderate symptoms, and “higher severity,” which included severe symptoms, across the study period to reflect the relative categorization of overlap symptoms. Typical COVID-19 symptoms were consistent throughout the study period.
Data collection
Survey instrument
Study data were collected and managed using REDCap (Research Electronic Data Capture) tools hosted at MGB. Reference Harris, Taylor and Minor7,Reference Harris, Taylor, Thielke, Payne, Gonzalez and Conde8 The survey utilized REDCap standard features as well as the Shazam External Module to customize code to display return-to-work guidance on the survey completion screen based on the symptoms entered by the employee. The REDCap application programming interface (API) was used to import daily information about the previous day’s employee vaccination records from the MGB electronic data warehouse. The REDCap Alerts & Notifications module with conditional logic was used to automatically e-mail HCP 3 daily surveys after their vaccination date(s) and to provide their return-to-work guidance after survey completion. For HCP without access to e-mail, they could access the website Mass General Brigham Vaccine Check (https://redcap.partners.org/redcap/surveys/?s=L8R3KFWJ88) to enter vaccination survey data. The survey continued through March 18, 2021, after which HCP were instructed to refer to a handout describing postvaccination symptoms and reactions management and return-to-work policy (Supplementary Material A online).
Compliance was defined as response of at least 1 survey within 3 days of a vaccine administration and required completion of all components of the survey.
Employee handout
At the time of vaccination, in addition to providing information on the Centers for Disease Control and Prevention V-Safe program, 9 employees were provided a postvaccination employee “tip sheet.” The tip sheet was created to describe possible postvaccination reactions and symptoms and requirements with respect to testing and on-site work restrictions, and support implementation of the policy (Supplementary Material B online). The tip sheet was translated into 6 languages.
Use of navigators
Beginning December 30, 2020, a phone-based navigator program was initiated to increase the participation of HCP with limited or no computer access, who required assistance with completing the survey in another language, or who had not completed their day 1 survey and worked among a subset of departments where access to the survey was considered at risk. Details on the implementation of the navigator program are provided (Supplementary Material C online).
Measurements
Employee characteristics and SARS-CoV-2 test results
Basic demographic data on employees (ie, age, sex, race, primary language, ethnicity, job title, job group description, employee job group, facility) were obtained from internal human resources databases and were linked to vaccination date and time and brand of vaccine. Employee role groups, including administrative, clinical, other, research, and support services, were created by mapping 36 job titles and group descriptions to these 5 role groups. Employee SARS-CoV-2 testing results obtained within the MGB system and infection statuses maintained in the electronic health record (EHR) by MGB Occupational Health Services (OHS) were identified. The infection status was utilized because some SARS-CoV-2 testing was performed outside the MGB system and was entered manually into the EHR prompting the appropriate infection status when positive for SARS-CoV-2. Employee test results, infection statuses, and REDCap survey responses were linked.
Testing for SARS-CoV-2 and determination of SARS-CoV-2 infection in the postvaccination period
During the study period, employees could obtain testing through standard MGB pathways: when symptomatic, asymptomatic with exposures, when asymptomatic all other reasons, and when referred by their responses to the survey. The various MGB testing sites used a variety of nucleic acid amplification tests (NAATs) approved by the FDA (Supplementary Material D online). Antigen testing was reserved for public health–directed testing at 2 MGB sites including 1 rehabilitation center and a community health center; however, only NAAT results were included in this analysis. When tested outside the MGB system, OHS entered external results in a protocolized manner that allowed these results to be identified through the EHR extract. Compliance with testing requirements and restrictions from work were the responsibility of the employee. If, however, the employee reported any high-severity symptom or any typical COVID-19 symptom, he or she was instructed to remain away from work and to obtain testing. Test orders were simplified through a mobile application (COVID Pass, Mass General Brigham Information Systems, Boston, MA). Reference Zhang, Dimitrov and Simpson10
Each positive SARS-CoV-2 assay was followed up by MGB OHS as part of contact tracing and employee counseling. For employees with prior infection with SARS-CoV-2, MGB criteria to determine whether the positive test represented active infection or a persistent positive from remote infection was applied independently by 2 authors (A.G. and E.S.S.) with concordance and no requirement for adjudication.
Outcomes
Outcomes assessed included survey compliance, reported lower- and higher-severity overlap symptoms and typical COVID-19 symptoms, and SARS-CoV-2 testing that occurred within 7 days after vaccination. Although the survey was used in the 3 days after vaccination, 7 days after each vaccination was chosen to allow for time to schedule and obtain testing based on symptoms occurring on day 3 after vaccination.
Evaluation and management of allergic symptoms after vaccination, which were included in the prospective surveillance strategy, have been reported previously, and they are not included in this analysis. Reference Blumenthal, Robinson and Camargo11,Reference Blumenthal, Freeman and Saff12
Statistical analysis
Categorical outcomes of demographic characteristics, reported symptoms, and testing outcomes among HCP were summarized by counts and proportions (%). Age distributions were compared using the Wilcoxon rank-sum test. We compared frequencies using the Pearson χ2 test. All tests were 2-sided, and P < .05 was considered statistically significant. Multivariable logistic regression was applied to assess the association of demographic characteristics, vaccine manufacturer, and test results with reported symptom severity and type. Analyses were conducted in R version 4.0.5 software. Reference Dowle13–15 The Pfizer-BioNTech vaccine was used as the referent vaccine in these analyses because it was the first vaccine introduced to the MGB employee population.
Results
Employee characteristics and survey response
In total, 64,187 employees received 1 or more doses of vaccine during the study period. Survey compliance was 83% (53,270 of 64,187) for dose 1 and 77% (48,550 of 62,846) for dose 2. There were 8,095 nonrespondents.
Respondents and nonrespondents did not differ by age. Compared to respondents, nonrespondents were more often male, non-White, non-English speaking, Hispanic or unknown ethnicity, and within other or support services roles as opposed to administrative, clinical, or research roles (Table 1).
Selected Characteristics of Mass General Brigham Healthcare Personnel Receiving COVID-19 Vaccination, By Survey Compliance
a Unless otherwise stated.
b Wilcoxon rank-sum test; Pearson χ2 test.
Use of navigator
From December 30, 2020, through March 19, 2021, 2,193 employees were contacted by the navigator team via phone to complete the survey. In total, 1,795 employees completed 2,456 surveys. Overall, 893 surveys were completed prior to outreach from navigators. The navigators made an additional 3,620 calls with no response. Additionally, between January 19, 2021, and March 19, 2021, 183 employees consented to receiving the survey by text during manual scheduling of their first vaccination dose and 169 provided valid mobile numbers for outreach. In total, 547 surveys were completed via a texted link, and 135 respondents (80%) completed at least 1 of the 6 surveys.
Reported symptoms: Lower- and higher-severity overlap symptoms and typical COVID-19 symptoms
The frequency and percentage of reported symptoms, by dose, is reported in Table 2. Among respondents, reported overlap symptoms of any severity were more common after dose 2 than after dose 1. The proportion of respondents with higher severity overlap symptoms increased several fold after dose 2 across all overlap symptoms. Self-reported typical COVID-19 symptoms of sore throat, cough, nasal congestion or rhinorrhea, shortness of breath, and anosmia or ageusia, which would not be expected to be associated with vaccine administration, were similar after dose 1 and dose 2 (Table 2).
Reported Overlap Symptoms, by Severity, and Typical COVID-19 Symptoms, within 3 days of Dose 1 and Dose 2
History of infection with SARS-CoV-2 prior to vaccination (adjusted odds ratio [aOR], 5.61; 95% confidence interval [CI], 5.01–6.27) was associated with self-reported higher-severity overlap symptoms after dose 1; however, history of infection was not associated with an increase in higher-severity overlap symptoms after dose 2 (aOR, 0.83; 95% CI, 0.74–0.93). Severity of reported symptoms after both dose 1 and dose 2 decreased with age. Non-white race and Hispanic ethnicity were both associated with report of higher-severity symptoms (Table 3).
Factors Associated With Reported Higher Severity Symptoms After Dose 1 and Dose 2
Note. OR, odds ratio; CI, confidence interval; Ref, referent. There were 53,270 survey responses after vaccine dose 1, and 48,550 survey responses after vaccine dose 2.
Testing and testing outcomes
Among 3,208 respondents after dose 1 tested for SARS-CoV-2 within 7 days of dose 1, 162 (5.0%) were positive; this corresponded to 162 (0.3%) of all 53,270 respondents after dose 1. Of 7,039 respondents tested for SARS-CoV-2 within 7 days of dose 2, 23 (.33%) were positive. These results corresponded to 23 (0.05%) of 48,550 of all respondents being positive after dose 2. Of the 10,917 nonrespondents after dose 1, 33 (11.0%) new infections of 300 tested were identified, and of the 14,296 nonrespondents after dose 2, and 7 (1.1%) new infections of 620 tested were identified. These results corresponded to 33 (0.3%) of 10,917 of all nonrespondents being positive after dose 1 and 7 (0.05%) of 14,296 of all nonrespondents being positive after dose 2 (data not shown).
Testing after self-reported symptoms
After dose 1, the percent positivity was 4.6% for those reporting either lower- or higher-severity overlap symptoms. Percent positivity for HCP reporting typical COVID-19 symptoms ranged from 6.6% to 51.5%, depending on specific symptom.
After dose 2, the percent positivity was 0.5% for self-reported lower-severity symptoms and 0.2% for self-reported higher-severity symptoms. Percent positivity was between 0.0% and 1.4% among those reporting typical COVID-19 symptoms, depending on the specific symptom (Table 4).
Reported Overlap and Typical COVID-19 Symptoms, by Testing Outcomes and Vaccine Dose
Note: Only respondents reporting symptoms are included in this analysis; individuals may contribute to testing outcomes multiple times if they report >1 symptom.
Association of symptom type, number of symptoms, and other factors with infection after vaccination
Self-reporting of 1 typical or ≥2 typical COVID-19 symptoms was associated with increased likelihood of testing positive: for 1 typical symptom, aOR, 6.85 (95% CI, 4.59–10.1) after dose 1 and aOR, 6.72 (95% CI, 2.41–17.4) after dose 2, and for ≥2 typical COVID-19 symptoms, aOR, 19.0 (95% CI, 11.7–30.2) after dose 1 and aOR, 7.72 (95% CI, 1.15–30.8) after dose 2. Sex and ethnicity were not associated with diagnosis of infection (Table 5). Black and unknown race and research role groups were less likely to be associated with infection after dose 1 but not after dose 2.
Reported Symptom Type, Number, and Other Factors Associated with Diagnosis of COVID-19 Infection within 7 days of vaccination
Note. OR, odds ratio; CI, confidence interval; Ref, referent. There were 53,270 survey responses after vaccine dose 1, and 48,550 survey responses after vaccine dose 2.
Discussion
In this prospective cohort of HCP vaccinated with mRNA vaccines, postvaccination symptom survey compliance was high; however, despite efforts to address potential technological and language barriers, response rates varied by sex, race, primary language, ethnicity, and employee role group. The incidence of overlap systemic symptoms including fever, fatigue, myalgias, arthralgias, and headache was similar to those reported in clinical trials for both vaccines, and systemic symptoms were more prominent after dose 2 than after dose 1. 16,17 Reported higher-severity overlap symptoms and typical COVID-19 symptoms were predictive of infection with SARS-CoV-2; however, lower-severity overlap symptoms were only associated with infection after dose 1 when ≥3 symptoms were present. Prior infection with SARS-CoV-2 was associated with report of increased higher severity systemic symptoms after dose 1. Among HCP, new infections were rare, and identified in 0.30% and 0.05% after dose 1 and dose 2, respectively.
Among those respondents who were tested within 7 days of vaccination, only those reporting multiple lower severity systemic overlap symptoms, at least 1 higher-severity overlap symptom, or typical COVID-19 symptoms were associated with test positivity after dose 1, and only typical COVID-19 symptoms were associated with test positivity after dose 2. This finding suggests that public health authorities and healthcare facilities can consider less restrictive policies related to postvaccination overlap symptoms and possibly only exclude HCP from work after dose 2 for typical COVID-19 symptoms. If booster doses are necessary, and overlap symptoms are similar or more pronounced than current dose 2 symptoms, a less restrictive policy may be necessary to ensure adequate staffing.
Given the effectiveness of the mRNA vaccines at preventing both symptomatic and asymptomatic infection, Reference Polack, Thomas and Kitchin3,Reference Baden, El Sahly and Essink4,Reference Hall, Foulkes and Saei18–25 the utility of postvaccination testing for SARS-CoV-2 systemic symptoms within 7 days of receipt of vaccine is questionable, especially in the setting of declining community prevalence. The 7-day weighted average of percent positive molecular assays in Massachusetts during the study period ranged from 1.8% to 8.7%. 26 In settings with lower community prevalence, the likelihood of overlap symptoms representing infection would be expected to be even lower. As we look ahead to potential booster strategies, especially in the setting of overall reduced community prevalence, policies related to HCP exclusion from work for nontypical COVID-19 symptoms are likely to be overly conservative and should be reconsidered. Others have reported on more severe postvaccination symptoms in individuals with prior history of infection, Reference Menni, Klaser and May27–Reference d’Arminio Monforte, Tavelli and Perrone29 a pattern confirmed in the current study.
The study had several limitations. The voluntary nature of the survey and self-reporting of symptoms may have introduced bias in the results. Some HCP may have been reluctant to report symptoms or severity of symptoms if doing so would prompt either recommendation for testing or exclusion from work, or both. Although testing was performed at no cost to employees and was accessible Reference Zhang, Dimitrov and Simpson10 and time off for testing was supported by flexible human resources policies, HCP may have minimized or underreported symptoms. HCP completing the web-based survey, once submitted, were unable to modify their answers and thus if they inadvertently entered incorrect responses, these could not be corrected. Testing for SARS-CoV-2, when indicated based on survey responses, was not completed for a substantial portion of those reporting symptoms that required testing, and in some cases, exclusion from work pending the test result. The study population consisted of HCP from a single healthcare system; thus, these findings may not be generalizable to other workforces.
In summary, in this large prospective cohort of HCP receiving COVID-19 vaccination, compliance with postvaccination surveys was high and self-reported symptoms were common, especially after dose 2. More research is needed to better understand the reasons for more prominent reported symptoms among individuals with prior history of COVID-19. Return-to-work policies that exclude or require SARS-CoV-2 testing of HCP who report postvaccination overlap symptoms, especially in the setting of prior infection or after dose 2, should be re-examined. Specifically, public health guidance and facility policies should recognize the low risk of infection in HCP reporting limited mild-to-moderate–severity overlap symptoms including fever. The risk is likely to be even lower in the setting of additional doses beyond the primary vaccination series. Such guidance and policies would serve to both preserve workforce capacity at a time when healthcare facilities are challenged by chronic understaffing with superimposed pandemic demands Reference Lasater, Aiken and Sloane30,Reference Kadri, Sun and Lawandi31 and would reduce the unnecessary burden of testing and work disruption to HCP.
Supplementary material
To view supplementary material for this article, please visit https://doi.org/10.1017/ice.2021.449
Acknowledgments
The authors thank David C. Hooper, MD, for his thoughtful review and comment on the manuscript; the staff of the Mass General Brigham OHS for support of the MGB Employee COVID-19 vaccination program; the MGB Digital Care Transformation (DCT) group for assistance with patient outreach including Samuel Aronson, MD, Ivonne L. Bennett-King, BSc, Jo Charles, MPH, Karen Choe, BS, Eugene Clark, Christian Figueroa, BS, Polovna Laine, MM, Marian McPartlin, Mike Oates, Nina Pappacostas, BS, Noheli Romero, BA, Tabitha V. Rutkowski, BA, and Michela Tucci, BA, Dimitar Dimitrov, MSSE, and Eduardo Morales, PhD, for their assistance with REDCap programming that automated data workflows and returned custom workplace guidance; Michael C. Pandolfi for guidance on data extracts to support the project; and Thomas D. Sequist, MD, and Rosemary R. Sheehan, MBA, for their support of the employee vaccination program. The content is solely the responsibility of the authors and does not necessarily represent the official views of Harvard Catalyst, Harvard University and its affiliated academic healthcare centers, or the National Institutes of Health.
Financial support
This work was supported by the Roger I. and Ruth B. MacFarlane Foundation (to E.S.S.). This study was conducted with support from Harvard Catalyst, The Harvard Clinical and Translational Science Center (National Center for Advancing Translational Sciences, National Institutes of Health award no. 1TR002541) and financial contributions from Harvard University and its affiliated academic healthcare centers (to H.L.).
Conflicts of interest
Dr Paige Wickner began dual employment at CVS Health and Brigham and Women’s Hospital in May 2021. Dr Adam Landman was previously a consultant for the Abbott Medical Device Cybersecurity Council.
