THE PANDEMIC’S DELAYED IMPACT ON ARTICLE SUBMISSIONS

To assess the pandemic’s impact on the publishing process at Politics and Religion, we begin with the first step in the process: article submissions. Figure 1 shows Politics and Religion’s article and research note submissions by both month and year for 2012–2022, covering each year that the journal has used the online Editorial Manager system. To make the years encompassing the pandemic easier to assess, the colored lines in figure 1 identify the years 2019–2022.

Figure 1

Article and Research Note Submissions per Month at Politics and Religion, 2012–2022

As a relatively new journal, the number of submissions at Politics and Religion was increasing between 2012 and 2019, reaching about 150 to 160 article submissions in the year before the pandemic began. In early 2020, pre–COVID-19, submissions were lagging 2019’s pace. However, between the beginning of the pandemic shutdowns in March 2020 and Fall 2020, submissions exceeded the pace of the previous year. In fact, the slope of submissions in 2020 suggests that the pandemic shutdown spurred submissions to the journal as other commitments were curtailed. During the first six months of the pandemic, from March to September 2020, the journal received its most article submissions in any six-month period (i.e., 107). This was a 25%+ increase from the same period in 2019 or 2021, and it exceeded the total number of submissions in all of 2014. Other journals, including those represented in this symposium, experienced a similar spike during the early months of the pandemic. The American Journal of Political Science, for example, noted a 27% increase in manuscripts in April 2020 (Midwest Political Science Association Admin 2020), and this trend extended beyond political science journals (Squazzoni et al. Reference Squazzoni, Bravo, Grimaldo, García-Costa, Farjam and Mehmani2021).

At Politics and Religion, the rate of submissions flattened somewhat at the end of 2020, with total submissions that year essentially finishing equally as high as they had been in 2019, despite a slow start to the year. Other journals also reported this continuity in submission rates between 2019 and 2020 (Dolan and Lawless Reference Dolan and Lawless2021).

In 2021, submissions continued to track the 2019 and 2020 rates at a steadier pace. For Politics and Religion, the total number of submissions was almost identical in 2019, 2020, and 2021, peaking at about 160 submissions. As shown in figure 1, the 2021 slope is almost linear, without the spikes and slowdowns shown in 2020. In reviewing article and research note submissions, it is clear that during the first 18 months of the pandemic, there was no slowdown in submissions. Scholars were submitting as much research to the journal as they had before the COVID-19 pandemic.

Whereas 2020 and 2021 showed little effect on submission rates, there was a significant slowdown in 2022 and in the first part of 2023, which is a slight difference from other journals discussed in this symposium. In 2022, there was an almost 15% decrease in manuscript submissions, and this trend continued in early 2023. The journal transitioned to a new editorial team in January 2022. Although this is noteworthy, we expect that the editorial transition would more likely affect the processing of manuscripts and decision rates rather than initial submissions. Two options comprise a more likely explanation for the reduced levels of submissions. First, the pandemic led to scholarly fatigue, which had delayed effects on journal submissions. Second, the pandemic constrained the ability to conduct research, particularly work that required travel, in-person fieldwork, and feedback from in-person conferences. Scholars would have been able to submit research in 2020 and 2021 based on pre-pandemic travel, but restricted travel reduced research output in 2022 and likely in 2023. Initial surveys of researchers suggested that they initiated significantly fewer new projects during the pandemic (Lewis Reference Lewis2021). However, additional surveys and interviews should be conducted with scholars to assess authors’ perceptions about these constraints.

THE GENERAL STABILITY OF SUBMISSIONS BY WOMEN DURING THE PANDEMIC

Although submission rates remained steady (and even increased) during 2020 and 2021, before declining in 2022 and early 2023, it is possible that the data are concealing certain demographic disparities, notably gender differences. Prior research has shown that the gender gap in journal authorship increased during the onset of the COVID-19 pandemic due to increased family responsibilities that women disproportionately bear (Bell and Fong Reference Bell and Fong2021; Squazzoni et al. Reference Squazzoni, Bravo, Grimaldo, García-Costa, Farjam and Mehmani2021; Viglione Reference Viglione2020). Other scholars, by contrast, have not found clear effects of the pandemic on the gender gap of authors; rather, they find that the effects vary by discipline, with some being more resilient (Jemielniak, Slawska, and Wilamowski Reference Jemielniak, Slawska and Wilamowski2023; see also Ryan et al. Reference Ryan, Tuke, Hutchinson and Spencer2023).

We sought to analyze the effects of the pandemic on the gender gap at Politics and Religion. Unfortunately, it was not straightforward to investigate the effects of the COVID-19 pandemic on the gender of authors submitting to the journal. Politics and Religion only recently initiated a questionnaire that asked authors to identify their gender. To assess gender over time, we had to construct estimates by following other studies and using a data package to predict authors’ gender based on their first name (Fine and Shen Reference Fine and Shen2018; Holman, Stuart-Fox, and Hauser Reference Holman, Stuart-Fox and Hauser2018). We downloaded the names of all of the authors who submitted articles and research notes to the journal from 2012 to 2022 and then ran them through the database genderize.io to predict the gender of each author. For most names, the genderize.io tool predicted a binary male or female gender with a high degree of confidence. When confidence was less than 75% or if the gender prediction came back as unknown, we searched individual names using Google to attempt to identify an author’s gender. For the 10-year period, we were able to predict 97% of the authors’ gender with a high degree of confidence.

From 2012 to 2022, two facts are clear. First, submissions to Politics and Religion were disproportionately written by men, with an average of 70% male authors. Second, the gender composition of submissions was fairly consistent, even during the COVID-19 pandemic: there were only small fluctuations, with no statistically significant differences. Figure 2 displays the yearly proportion of female authors for all articles and research notes submitted to the journal. During the timespan, women averaged 30% of all authors; the percentage ranged from 22% in 2012 to 38% in 2014, but it generally hovered around 30%. In 2019, 34% of all authors were women. This percentage declined to 28% in 2020 and 2021, but it is not a statistically significant difference. The percentages of women authors in 2020 and 2021 also were greater than the percentage in 2018 (i.e., 23%).

Figure 2

Proportion of Estimated Female Authors on Article and Research Note Submissions by Year at Politics and Religion

Orange bars represent 95% confidence intervals.

The data are similar when they are restricted to only first authors. Women accounted for 29% of first authors during the timespan. In 2019, 31% of first authors were women, which declined slightly to 27% in 2020 and 2021. In 2022, 30% of first authors were women. Again, none of these changes are statistically significant. There also were no substantial rate changes in the gender of author submissions at the onset of the pandemic. Women comprised 28% of first authors for submissions between March 1 and June 30, 2020—essentially equal to the yearly average. In general, at Politics and Religion we found general resilience in the submission rates by gender—a positive finding that is substantiated by the findings of editors at other journals.

THE PANDEMIC’S DELAYED IMPACT ON REVIEWER RESPONSE

Despite the global disruption, journal turnaround times were steady during the pandemic, as shown in figure 3. Between 2017 and 2019, Politics and Religion experienced a significant decrease in the number of days to first decision, ranging between 50 and 70 days. Initially, the pandemic did not slow the processing time because the days to a first decision actually decreased in 2020, compared to 2019—although this was similar to 2017 and 2018. In fact, in the shutdown period of the COVID-19 pandemic, processing time was quite fast. Between March 1 and May 31, 2020, the average time to a first decision was less than 47 days.

Figure 3

Average Days to First Decision on Article and Research Note Submissions by Year at Politics and Religion

The number of days to a first decision increased in 2021 and 2022, however, averaging about 70 days. This was more than a 35% increase from 2020 but on par with 2019. There are a few reasons why the time to decision may have increased in 2021 and 2022. First, 2021 and 2022 were transition years for Politics and Religion. In 2021, the previous editorial team ended its five-year term and a new editorial team transitioned into the role in 2022. These transitions may be linked to longer processing times because the previous team was ending a relatively long term and the new team needed to become familiar with the process of managing the journal.

Second, and perhaps more important than the editorial transition, however, is that 2022 had the lowest acceptance and completion rates for reviewer requests, as shown in figure 4. Only 36% of review requests resulted in a completed review. Reviewer acceptance and completion rates declined by almost 40% in 2022 compared to 2020, due almost solely to not accepting requests. These acceptance and completion rates were the lowest in the history of Politics and Religion, and they are lower than the rates of other political science journals (Bruening et al. Reference Bruening, Backstrom, Brannon, Gross and Widmeier2015; Djupe Reference Djupe2015; Dolan and Lawless Reference Dolan and Lawless2022). These low levels in part may be an indication of the new editorial team tapping a different subset of scholars; that is, editorial teams tend to tap similar networks of reviewers during their term, and new teams bring variation (Djupe Reference Djupe2015). That said, we think it is clear evidence of pandemic-related fatigue, especially because it follows a similar pattern as the submissions. When reviewers decline requests, many mention being overwhelmed, being behind on their work, and facing personal or family illness as factors contributing to the need to decline. Prior scholarship on reviewer fatigue found that scholars lead busy professional lives and “face many demands on their time” (Bruening et al. Reference Bruening, Backstrom, Brannon, Gross and Widmeier2015, 599; see also Lupia and Aldrich Reference Lupia and Aldrich2014). The COVID-19 pandemic, and especially the return to more “normal” professional responsibilities in 2022 after numerous pandemic challenges, likely affected reviewers. In fact, in this symposium, the American Political Science Review reported a similar decline in reviewer responsiveness. Unfortunately, when reviewers decline requests more often, journal processing times are likely to slow down.

Figure 4

Proportion of Review Requests That End in a Review by Year at Politics and Religion

Although reviewer acceptance and completion rates decreased at Politics and Religion, the good news is that once individuals accepted the review request, their time to completion was similar to if not somewhat faster than prior years (i.e., 22 days). Nevertheless, it was more difficult to find reviewers to accept an assignment, resulting in challenges in processing manuscripts. After two years, the pandemic is affecting the publishing process through decreased submissions and decreased reviewer acceptances at Politics and Religion.

THE CONTINUED ACCELERATION OF INTERNATIONAL SUBMISSIONS AND ENGAGEMENT DURING THE PANDEMIC

In addition to delayed changes in submission and reviewer acceptance rates, the geography of submissions to Politics and Religion changed during the COVID-19 pandemic. However, we are not certain that these changes can be attributed to the pandemic. Between 2017 and 2019, the proportion of submissions from outside of North America and the United Kingdom was growing, as shown in figure 5. In 2012, this percentage was slightly less than 30%; by 2019, more than half of the submissions came from outside of North America and the United Kingdom. During the pandemic, that number spiked to almost 70% of submissions. This increase in non-North American and non-UK submissions remained high (i.e., more than 60%) for 2021 and 2022. Global submissions expanded during the pandemic. US submissions, by contrast, contracted in both percentages and raw numbers after the pandemic. Between 2012 and 2019, the journal averaged 45 manuscript submissions from scholars in the United States. Since COVID-19, the total number of US submissions has been below average: 42 in 2020, 40 in 2021, and 36 in 2022. We are not certain if the pandemic attributed to a higher proportion of non-US submissions or if this is part of a longer trend toward more global submissions. However, the trend is noteworthy and warrants future analysis after the COVID-19 pandemic.

Figure 5

Proportion of Article and Research Note Submissions by Country Group per Year at Politics and Religion

The way readers engaged with Politics and Religion also continued to change during the COVID-19 pandemic. The journal was trending toward more digital downloads, with those numbers increasing between 2017 and 2019. Downloads hit new highs in 2020 and then spiked in 2021. This coincided with changes by the publisher, Cambridge University Press, but it signals a shift in consumption patterns. The COVID-19 pandemic likely has spurred downloads, but this trend also should be analyzed using post-pandemic data.