Policy Significance Statement

This paper develops and validates resources for the interpretable detection of manipulated social media. It also offers insights into the specific tactics that authoritarian governments favor when manipulating media to distract from domestic and international challenges. With this knowledge, government agencies confronted with manipulated media from abroad may be better equipped to identify the entities behind malicious accounts, their whereabouts, and their operations—which in turn could be used to disrupt and deter future manipulated media production. Furthermore, such agencies may be able to identify specific weaknesses that adversarial countries are concerned about based on the type of messaging the manipulated media contains. Finally, for social media companies—and those tasked with regulating or monitoring such companies—this paper offers resources and tactical insights that could be used for speedier and more comprehensive manipulated media scrutiny.

2. Theoretical motivation

Why would countries like Iran expend energy and resources on a manipulation campaign on Twitter? To answer this question, we first must define manipulated media. While manipulated media can be defined in a number of ways, we will use Twitter’s definition for the purposes of this article. We use Twitter’s definition because we are analyzing the data from state-linked accounts suspended by Twitter for violating their manipulated media policies. Twitter defines “platform manipulation as using Twitter to engage in bulk, aggressive, or deceptive activity that misleads others and/or disrupts their experience” (Twitter, 2023). Note that “misinformation” is a subset of manipulated media by Twitter’s definition—misinformation on social media can be defined as “all false or inaccurate information that is spread in social media” (Wu et al., Reference Wu, Morstatter, Carley and Liu2019).

Much research has been dedicated to developing strategies and tools to detect, verify, mitigate, and limit the spread of several varieties of misinformation, rumors and fake news (Dang et al., Reference Dang, Moh’d, Islam and Milios2019; da Silva et al., Reference da Silva, Vieira and Garcia2019; Zhang and Hara, Reference Zhang and Hara2020; Bagozzi et al. Reference Bagozzi, Rajni, Brunilda Lugo, Kelly and Karthik2024). In this respect, da Silva et al. (Reference da Silva, Vieira and Garcia2019) present an extensive survey of machine learning applications, using different techniques and conceptual models, that have been developed to tackle the challenges of manipulated media detection. Our work utilizes previously identified Twitter manipulated media data to illustrate a potential strategic usage of targeted social media manipulation. Specifically, we consider the potential for manipulated media being used as a diversionary tool. Diversion is a social influence tactic that involves redirecting an audience’s attention away from an issue or argument by introducing a new topic or by distracting that audience with a separate issue. We analyze topics and timing of manipulative tweets and illustrate a novel perspective of how new forms of 21st century diversion are being conducted.

Our expectations for diversion in this context draw from extant political science and international relations research. Diversionary war theory posits that governments and their leaders will often value foreign conflict as a means for diverting domestic attention away from domestic challenges, and as such, will at times strategically engage in conflictual international behaviors in order to divert public attention away from pressing domestic issues (Amarasinghe, Reference Amarasinghe2022). To this end, leaders will commonly size upon or spark international conflicts as a means of nudging domestic actors away from exacting costs on their regime or leadership (Enterline, Reference Enterline2010). Much research has been conducted on the possible pathways by which leaders may undertake such diversionary behavior, from using military force abroad, to foreign policy adjustments, and other tactics—typically with the fundamental goal of distracting domestic audiences from domestic economic and/or political turmoil (Enterline, Reference Enterline2010; Kanat, Reference Kanat2011, Reference Kanat2014; McLaughlin Mitchell and Thyne, Reference McLaughlin Mitchell and Thyne2010; Smith, Reference Smith1996; Oakes, Reference Oakes2012; Yeh and Wu, Reference Yeh and Wu2020). In this vein, diversionary tactics tend to be multifunctional. They can simultaneously serve to divert blame to other (international or domestic) actors, distract from domestic challenges, boost leaders’ popularity, and/or demonstrate leaders’ competence in the face of domestic problems (Oakes, Reference Oakes2012).

Multiple studies have hypothesized and explored the unique methods being utilized by governments as diversionary tactics. Increasingly, such studies have come to identify tactics that fall outside the scope of war or militarized conflict. Carter (Reference Carter2020), for example, develops a theory of “diversionary cheaptalk” whereby leaders criticize foreign nations during domestic economic challenges as opposed to pursuing militarized conflict. Amarasinghe (Reference Amarasinghe2022) likewise claims that governments, during times of domestic turmoil, engage in diversionary tactics that prioritize verbal aggression in foreign interactions rather than violent interstate conflict. The authors consider international football losses as “exogenous” sentiment shocks in relation to domestic instability and governments’ associated international interactions. They find that “shocks” associated with such football losses increase domestic turmoil and in turn causally increase governments’ international interactions (Amarasinghe, Reference Amarasinghe2022). This exemplifies a short-term diversionary tactic that can be characterized as both relatively low-cost and low-risk—similar to the social media manipulation diversion strategy we explore in this work.

Research furthermore suggests that authoritarian governments will be especially likely to leverage misinformation and related media-based content for diversionary purposes (Alrababa’h and Blaydes, Reference Alrababa’h and Blaydes2021; Gray, Reference Gray2010; Koehler-Derrick et al., Reference Koehler-Derrick, Nielsen and Romney2022). Emphasizing the costliness to using actual armed conflict for diversionary purposes, Alrababa’h and Blaydes (Reference Alrababa’h and Blaydes2021) posit—and find—that Syria’s government instead favored tactics of media manipulation concerning external threats and conspiracy theories in diversionary manners. Drawing upon this logic, Koehler-Derrick et al. (Reference Koehler-Derrick, Nielsen and Romney2022) go on to argue that authoritarian governments will be especially likely to spread diversionary conspiracy theories in state-controlled media when they are under threat, owing to the fact that in these contexts the benefits to this form of media manipulation offset any costs of tactical backfire. Rozenas and Stukal (Reference Rozenas and Stukal2019) likewise find evidence to suggest that authoritarian governments increasingly favor tactics of media manipulation rather than censorship, in particular, using media manipulation to attribute bad domestic news to external factors.

A separate stream of research has examined social media messaging to explore the presence of discursive deflection. One study examines the tweets of President Trump (Ross and Rivers, Reference Ross and Rivers2018), suggesting that two of Trump’s tweet strategies included diversion and deflection. A second recent study presents evidence suggesting that leaders use Twitter to divert media from topics that are potentially harmful or threatening to them (Lewandowsky et al., Reference Lewandowsky, Ecker, Seifert, Schwarz and Cook2012). Another contemporary social media-focused study of diversionary tactics investigates the use of bots in efforts to suppress or prevent online and offline opposition activities, essentially leveraging the power of social media against (potential) mass political protests and related political instability in authoritarian regime contexts (Stukal et al., Reference Stukal, Sanovich, Bonneau and Tucker2022). These authors observe evidence of strategies such as bot volumes, retweet diversity, cheer leading, and negative campaigning prior to, during, and following opposition activities. Moreover, it is unlikely that such efforts will be received merely as cheap talk, given broader extant findings concerning the influence of tweets on international politics, international conflict, and international investment (e.g., Duncombe, Reference Duncombe2019; Tan and Tas, Reference Tan and Tas2021; Valle-Cruz et al., Reference Valle-Cruz, Fernandez-Cortez, López-Chau and Sandoval-Almazán2022; Zeitzoff, Reference Zeitzoff2018).

Social media manipulation research also gives consideration to the specific topics most prevalent in the media being spread. For example, studies have investigated the magnitude, propagation, and/or content of manipulated media regarding Covid-19 on Twitter (Himelein-Wachowiak et al., Reference Himelein-Wachowiak, Giorgi, Devoto, Rahman, Ungar, Schwartz, Epstein, Leggio and Curtis2021; Yini Zhang and Lukito, Reference Yini Zhang and Lukito2023). Lee et al. (Reference Lee, Bao, Wang and Lim2023) trace specific Covid-related conspiracy content through social media to understand differences in manipulated media tactics used therein. In line with several studies reviewed in our introduction, Verrall (Reference Verrall, Gill and Goolsby2022) similarly discusses the use of Covid-19 disinformation, misinformation, and malinformation (DMM) during the Covid-19 pandemic and DMM’s evolving capabilities. Yet research into manipulated media during Covid-19 primarily focuses on how manipulated media spreads Covid-19 misinformation or disinformation, rather than considering how manipulated media may be used by governments to divert attention from Covid-19-related challenges. We hence extend this research by investigating the potential for diversionary tactics of manipulated media to increase in response to domestic Covid-19 challenges. Based upon the literature reviewed further above, we focus on an authoritarian country’s state-directed manipulated media tactics (i.e., Iran). Given the recent findings concerning increases in commodity futures-based fake news during the Covid-19 pandemic and its associated period of heightened global market uncertainty (Banerjee et al., Reference Banerjee, Sensoy, Godell and Mahapatra2024), we anticipate international finance/investment-focused media manipulation to be especially likely in this context.

In these contexts, several characteristics of the Iranian state-linked misinformation campaign that we consider—and of Twitter access and English language usage in Iran more generally—require further discussion in order to establish the scope conditions for our theoretical expectations and analysis. First, we note that despite Twitter’s being banned in Iran since 2009, past research suggests that it remains widely used and accessed in Iran (Hashemi et al., Reference Hashemi, Wilson and Petrarca2022; Jafari, Reference Jafari2020) and has played a pivotal role in Iran’s contemporary political sphere (Faris and Rahimi, Reference Faris and Rahimi2016; Khazraee, Reference Khazraee2019). Perhaps correspondingly, prominent Iranian political elites now commonly hold official Twitter accounts, whereas many everyday citizens frequently bypass Iran’s official Twitter ban via virtual private networks (Ziabari, Reference Ziabari2023). Research has likewise found evidence of several key clusters of Persian Twitter users, including the Iranian diaspora, reformists, and an increasing number of conservative crowdfunded elites (Kermani and Adham, Reference Kermani and Adham2021). The latter group of elites has in turn been characterized as encompassing a wide range of pseudo-intellectuals, clerics, young devotees, and financed troll armies that together operate under a mandate of winning “a war of narratives against [Iran’s] skeptical people and anyone else in the world who doesn’t sympathize with the Islamic Republic” (Ziabari, Reference Ziabari2023). Research that has compared English and Persian tweets in this vein has furthermore found subtle differences in types of influential Twitter accounts operating in each language, with Persian language tweets being more dominated by Iranian micro-celebrities and English-language tweets seeing the most retweets for institutional elites intersecting with journalists and news/media outlets (Khazraee, Reference Khazraee2019).

Note also that the specific Iranian state-linked misinformation tweet campaign considered below is multilingual in its tweet content. While Twitter is unable to definitively classify the language of every tweet therein, the most commonly tagged languages are Spanish (35%), English (21%), Indonesian (10%), and Farsi (8%). Thus, the campaign under analysis can be assumed to have a substantial international focus, albeit with a secondary—likely elite oriented—domestic component. Given, moreover, that our eventual empirical focus is specifically on the English-language tweet subset of this misinformation campaign for purposes of comparability and exposition, our own analysis and corresponding scope conditions assume the intended audience of our tweets to be primarily international—including Iranian diaspora—and secondarily to include domestic Iranian elite. In the latter case, we can further note that English competency within Iran’s broader population—though difficult to estimate precisely—is likely to be fairly limited during our time period of analysis, with the biggest exceptions being Iran’s younger generations in (central and northern) Tehran, Isfahan, and Shiraz (Goodrich, Reference Goodrich2020). This reinforces our characterization of this campaign’s most likely target audience as being one of international actors and domestic Iranian elites.

Such international audiences and domestic elite actors are not always explicitly or exclusively considered within studies of diversionary war. Nevertheless, we contend that each target group aligns well with the diversionary strategies outlined further above. Indeed, the targeting of these specific actors with manipulated media can critically serve to divert the attention of potentially adversarial foreign governments, international media, and Iranian diaspora away from Iran’s domestic Covid-19 challenges. Importantly, each of these international and elite actors can in turn influence Iran’s broader domestic population through various channels—thus linking their sentiments and actions to overall domestic Iranian support for Iran’s government. In this manner, Iran’s broader domestic audiences can be seen as a second, and more indirect, target of our anticipated manipulated media tactics to the extent that international influences—and Iran’s economic, business, and political elites—influence this broader population.

3. Data

In order to conduct this research, we used (dis)aggregated data across a wide variety of sources. Our dependent variables are all derived from the content of tweets from accounts that have been identified by Twitter as state-linked disseminators of manipulated media. Our primary independent variables include Covid-19 rates, commodity prices, measures of weather, and sociopolitical events. Each of those datasets is described below.

Tweets: Our dependent variables are derived from Twitter’s curated repository of state-linked manipulated media. We will henceforth refer to these tweets of interest as “manipulative tweets.” This particular Iranian manipulative tweet sample was identified and released by Twitter in 2021. It covers 560,571 total tweets made by 209 distinct accounts during the period January 1, 2011, to December 27, 2020. After implementing the processing steps described below, these tweets were used as dependent variables in both a preliminary Lasso analysis and our paper’s eventual STM models, albeit at different aggregations.

For the Iranian manipulative tweet sample mentioned above, Twitter provides each identified tweet’s original text alongside associated meta-data pertaining to tweet date, tweet language, tweet ID, user profile information, and replies/retweets—among other fields. For our state-linked Iranian manipulative tweets, we subset the full set of manipulative tweets to retain only those tweets that Twitter identified as being made in English. This ensures a consistent sample of tweets for our anticipated STM analyses, retaining 115,723 tweets from Twitter’s full sample of 560,571 Iranian state-linked manipulative tweets.

Covid-19: Covid-19’s effects permeated almost every aspect of society at the beginning of 2020. It is therefore unsurprising that there emerged an urgent need for a database of daily data on Covid-19 cases and deaths to be collected and maintained by an internationally recognized and trusted entity. The World Health Organization (WHO), an agency of the United Nations filled that role. While collecting health data during the global pandemic was almost surely imperfect—especially in countries without transparent governments, WHO data were the most comprehensive, global source for Covid-19 cases in the time period of interest. Therefore, we retrieved WHO’s daily Covid-19 data for both Iran and globally starting from January 3, 2020 (when WHO began publishing global counts) to June 23, 2021 (after Iran’s specific manipulated media operation described in the previous subsection had ceased). Briefly, we can note that Iran was among the first countries in the world to experience the Covid-19 pandemic and experienced several surges in daily cases thereafter, including in November 2020, April 2021, August 2021, and February 2022 (Moghanibashi-Mansourieh et al., Reference Moghanibashi-Mansourieh, Arshi and Arabgari2023). Iran’s response to the Covid-19 pandemic was similarly uneven. For example, the country’s vaccination efforts throughout this period faced a number of challenges, especially early-on (Moghanibashi-Mansourieh et al., Reference Moghanibashi-Mansourieh, Arshi and Arabgari2023, 541–542). While Iran implemented a number of rolling restrictions on public gatherings and public spaces during the Covid-19 pandemic, full-scale lockdowns were imposed more sparingly, often lasting for periods of 1–2 weeks at a time and designated to specific subregions of Iran (A3M, 2024).

To complement our daily Covid-19 data for Iran and globally, we also retrieved Covid-19 data for a set of countries that were representatives of Iran’s geopolitical allies, its geopolitical adversaries, and its neighbors. The representative adversarial countries were the United States, Israel, the United Kingdom, and Saudi Arabia. Its representative “allied” countries were Russia, Syria, Lebanon (where Iran backs the Lebanese militant group, Hezbollah), Yemen (where Iran backs the Yemeni Houthi rebel group), and the Palestinian Territories. These data were again drawn from the WHO source mentioned above.

Commodity prices: In investigating the effects of Covid-19 on Iran’s state-linked manipulated media campaign, this research also accounts for how commodity prices might be associated with Iran’s manipulated media operations. One commodity dominates Iran’s exports: oil. Therefore, we retrieve daily price, for open market days, data for the oil variant that has the most liquid market: Brent crude oil (in USD per barrel). Similarly, we collect daily price data from Iran’s major food imports: rice (USD per 100 pounds), soybeans (USD per bushel), corn (USD per bushel), sugar (USD per pound), barley (USD per bushel), and cotton (USD per pound). All commodity price data, as well as the asset price data below, come from Bloomberg’s direct data feed via the Chicago Board of Trade. These daily data span the entirety of the period for which the identified Iranian manipulated media operation was active.

Asset prices: Beyond commodity prices, we are also interested in how the prices of assets, such as precious metals, cryptocurrencies, and stocks, might be associated with our dependent variables. Therefore, we collect daily data on the price of gold, silver, and platinum. Bloomberg sources these prices from the Chicago Board of Trade. Given the online nature of manipulated media, we also considered the daily prices in USD (at midnight UTC-4) of the two largest cryptocurrencies by market capitalization as of January 2021: Bitcoin and Ethereum. Given that cryptocurrency valuations are quite volatile, we also examine the daily change in price of each of these cryptocurrencies. Finally, we include two measures of US stock market performance. The first measure is the daily closing price of the Vanguard Total Stock Market Index Fund ETF (VTI), a passively managed fund that includes the weighted share prices of large, medium, and small-capitalization publicly traded companies. We use VTI as it is a single-number proxy for the state of the United States economy. Additionally, we use the daily closing price of VOO, the exchange traded fund that tracks the weighted performance of the Standard and Poor’s (S&P) 500—a very commonly used basket of 500 of the largest United States publicly-traded companies by market capitalization.

Events: To account for political events in Iran and globally, we leverage event data from the Integrated Crisis Early Warning System (ICEWS; Boschee et al., Reference Boschee, Lautenschlager, O’Brien, Shellman, Starz and Ward2015). ICEWS machine codes events from international news(wire) sources according to specific source and target actors, and a wide range of event types encompassing (verbal and material) conflictive and cooperative actions. We use the raw ICEWS data to create several daily event count aggregations. We first calculate the total global daily events in ICEWS for our daily sample period as a measure of overall political interaction at a global scale. We then separately extract a similar daily aggregation for events of all types that involve an actor associated with the country of Iran as a source (initiator) or target of a particular event. Next, we separately subset and aggregate only those events associated with (i) non-state-initiated domestic protests within Iran and (ii) repressive events in Iran initiated by Iranian state-based actors targeting non-state-based Iranian actors. Past research has established the appropriateness of using ICEWS for studying repressive events (Bagozzi et al., Reference Bagozzi, Berliner and Welch2021) and protests (Steinert-Threlkeld, Reference Steinert-Threlkeld2017)—including Covid-19-era protests (Mitternich, Reference Mitternich2020).

Additional variable details: Alongside the variables summarized above, we consider control variable measures of Iran’s daily temperatures and precipitation levels, obtained from the National Oceanic and Atmospheric Administration’s online repository of global historical weather data. We likewise include a month (time) counter variable that spans the full duration of our state-linked manipulative tweet corpus. This control—alongside our aforementioned temperature measure—accordingly allow us to account for both longer-term and cyclical (i.e., seasonal) temporal dependence in our data. To further control for political dynamics, we also consider dichotomous election indicators for domestic elections in Iran, the United States, and Israel, set equal to one beginning in the first month of a given country’s election year and remaining one until the exact day of that country’s election. For several of the variables mentioned further above, we interpolate missing values, primarily for our ensuring complete coverage for the daily aggregations used in our preliminary Lasso analysis, rather than for our STM analyses. Remaining missing values lead us to listwise delete observations lacking full coverage on our variables within our final STM analyses. This primarily arises toward the end of our time series. Finally, many of the variables outlined above are noticeably skewed. We accordingly log a majority of the covariates considered here. See Table 1 for more details on the variables that were logged in our analyses.

Table 1.

Lasso results for daily manipulative Tweet frequency

^∗∗∗ p<.01; ^∗∗ p<.05; ^∗ p<.10

4. Analysis and results

4.2. STM estimation

We use an STM to investigate how, and whether, Iranian Covid-19 cases influence strategies of Iranian state-based manipulated media. This STM treats our tweets as an admixture of underlying thematic clusters that themselves are comprised of words. It then recovers these word clusters as “topics” (i.e., probability-indexed word vectors). This STM approach extends prior topic modeling approaches, including latent Dirichlet allocation (LDA; Blei et al., Reference Blei, Ng and Jordan2003), in several notable manners. Of most relevance for our analysis, the STM allows for the inclusion of covariates when estimating one’s topics. This allows us to not only extract a set of latent topics for our manipulative tweets, but also to recover estimates of how our external (tweet-level) covariates affect the relative prevalence of said topics. In addition, the STM allows for correlations among one’s estimated topics during estimation. Given the potential for strategic coordination across the Twitter accounts’ topics, this is likely relevant to our tactical investigations into categories of Iranian state-linked manipulation.

As this analysis is at the level of individual tweets, the STM treats each manipulative tweet as the unit of analysis. Before estimating any STMs, we processed these tweet texts in standard manners for STM applications. This includes transforming all text to lower case, omitting all numbers, removing English-language stop words, excluding very sparse terms, removing punctuation, and then finally stemming all retained terms. In these contexts, stop words correspond to a common set of 174 English stop words as defined by the tm package in R (Feinerer et al., Reference Feinerer, Hornik and Meye2008). This—and the other preprocessing steps outlined above—is consistent with the set of English stop words used by other similar STM applications (e.g., Bagozzi and Berliner, Reference Bagozzi and Berliner2018; Kwon et al., Reference Kwon, Chadha and Wang2019.)

The STM, like LDA and other mixed-membership topic models, is flexible in the number of topics that it is able to recover from any given corpus, defined hereafter as $ k $ . This flexibility in turn requires that we choose a specific value of $ k $ within our STM application. For interpretability, we focus on estimating a relatively small number of topics to represent the overarching themes underlying our tweets. We then leverage a variety of model fit diagnostics to determine a defensible $ k $ within this range. More specifically, we consider four common diagnostics (i.e., model residuals, held-out likelihood, lower-bound, and semantic coherence). These are common criteria for STM applications, including ones considering Covid-19-related text and/or social media data (Abramova et al., Reference Abramova, Batzel and Modesti2022; Chung et al., Reference Chung, Rodriguez, Lanier and Gibbs2022; Rodriguez and Storer, Reference Rodriguez and Storer2020) in evaluating a plausible range of topics lying between 10 and 60. This range of topic number draws upon the guidance offered in existing STM research, for example, Roberts et al. (Reference Roberts, Stewart and Tingley2014a) emphasize that “[t]here is no right answer to the appropriate number of topics. More topics will give more fine-grained representations of the data at the potential cost of being less precisely estimated. […] For small corpora (a few hundred to a few thousand) 5–20 topics is a good place to start.” These diagnostics appear in Figure 1 and suggest that an optimal topic number lies in the 20-topic range. This is especially the case for hold-out likelihood, residuals, and lower bound, which each exhibit diminishing returns for $ k> $ 20, whereas semantic coherence is inconclusive. We therefore assign $ k $ to be 20 in our STM analysis.

Figure 1.

Topic number selection diagnostics.

For our $ k=20 $ STM, we treat our preprocessed manipulative tweets as our “documents” and then add our Lasso-selected variables as prevalence covariates. To safeguard against instability in our final set of topic estimates, we follow extant research (e.g., Bagozzi and Berliner, Reference Bagozzi and Berliner2018; Roberts et al., Reference Roberts, Stewart, Tingley, Lucas, Leder-Luis, Gadarian, Albertson and Rand2014b) by estimating a array of 50 ( $ k=20 $ ) STMs for our manipulative tweet corpus, each with distinct starting parameter values. We then chose an optimal STM from these 50 estimated STMs with the aid of semantic coherence and exclusivity scores.

For each of our STM-derived topics, we report the 20 most associated words in Table 2. Therein, each topic’s associated top 20 words are ranked in terms of their frequency-exclusivity (FREX) assignment from left to right (i.e., with most highly associated words appearing first, followed by less associated words). Table 2 also includes our own subjective labels for each of the estimated topics on the right-hand side of the plot. To assign these labels, we not only read the top words depicted here but also reviewed the top 100 $ + $ tweets that were estimated to be associated with each estimated topic by our final STM. Reading these tweets for relevant topics provided a much clearer picture of what theme or themes a particular topic encompassed than did initial assessments of the top words alone. Our Supplementary Appendix contains full rationales for each topic interpretation.

Table 2.

Top 20 words per STM topics, based upon FREX

The frequency plot in Figure 2 highlights each topic’s relative frequency across our entire tweet corpus, after classifying each tweet according to its most dominant topic based upon the STM’s word-indexed topic probabilities. We find reasonable coverage across all of our topics, with all topics aside from Topic 7 exhibiting over 2000 associated tweets and our two largest topics (Topics 4 and 15) exhibiting over 12,000 associated tweets a piece. It is worth further noting here that the three topics of focus below all lie within the top 12 most frequent topics according to Figure 2, with one such topic (Topic 16) falling within the top five most common topics across our corpus.

Figure 2.

Distribution of topics across Tweet Corpus, according to each Tweet’s most dominant topic.

4.3. Focused topic analysis

Of particular interest to our present analysis are Topics 5 (commodity prices), 11 (international markets), and 16 (Covid-19). These three topics exhibit the closest relevance to the overarching content themes of interest that were highlighted further above—namely themes of international finances/investment and Covid-19. Accordingly, we next expand upon the rationale for the subjectively assigned label associated with Topics 5, 11, and 16, based upon our own qualitative review of these associated top tweets and FREX words. Our Appendix provides further elaboration and interpretation of these three topics. After providing detail on Topics 5, 11, and 16 below, we directly assess the extent to which an increase in daily (ln) Iran Covid-19 rates affects attention to each of these topics at the individual tweet level.

Topic 5: Commodity prices. Silver, price, and US dollars (USD) are three of the most important words in this topic. This topic pertains to commodities prices with a particular focus on the change in prices as a result of high demand for rare earth minerals in new technologies. For example, one tweet that weighs heavily on Topic 5 is: “@Tickeron Silver have critical role in high tech such as 5 g mobile solar panel and electronics military high tech … buy physical silver is the best investment at this years investment demand for silver is sky rocketing price of silver to 100 usd soon current price of silver is 17 usd.” This, and our broader reading of this topic’s content, leads to a natural label of commodity prices for this topic.

Topic 11: International markets. This topic is similar to Topic 5 in that it focuses on finances. However, in contrast to Topic 5 which focuses largely on commodities, Topic 11 has a much more international focus with China, Euro, forex (foreign exchange), and India marking some of the most important words. This topic also covers Bitcoin and crypto markets. We therefore label this topic as “International Markets.” An illustrative tweet is: “@ScotlandNT @dundeeunitedfc Euro is oldman eus money look at italy and Spain and Greece euro it isn’t safe haven see brexit europe union end soon europe dont have oil gas mine army and young people europe dont have good furure#trump #gold #stock market #china forex signal eurusd #euro.”

Topic 16: Covid-19. Nearly every top word in this topic can be easily connected to Covid-19. Even some that may not be as easily connected (humanrightsviol or wear) are likely about mask mandates are the resistance of some to adherence to these mandates. Thus, we label this topic as “Covid-19.” Many top tweets from this topic are fairly informational, such as: “Singapore reports record 386 new Covid-19 cases and 9th death #COVID19 #coronavirus https://t.co/3Sw8oVloYK.”

Figure 3 presents the estimated effect of a substantively meaningful increase in ln Iran Covid-19 cases (specifically, a change from one standard deviation below the sample mean of Ln Iran Covid-19 cases to one standard deviation above the sample mean of Ln Iran Covid-19 cases) on the prevalence of our three primary topics of interest: Topics 5 (commodity prices), 11 (international markets), and 16 (Covid-19). These substantive effects are plotted with 95% confidence intervals, where a positive (negative) value on the x-axis implies than an increase in ln Iran Covid-19 cases is associated with an increase (decrease) in attention to a particular topic within our sample of Iranian state-linked manipulative tweets.

Figure 3.

Estimated effect of change in Ln Iran Covid19 cases on topics of interest.

We find in this case that a reasonable increase in the log of Iran’s domestic Covid-19 cases is associated with a reliable decrease in a manipulative tweet’s proportion of attention dedicated toward our identified Covid-19 topic. At the same time, a comparable increase in Iran’s (logged) domestic Covid-19 case rate is reliably associated with increases in a given manipulative tweet’s attention toward themes relating to international markets and commodity prices. Together, these results provide evidence for Iran’s use of manipulation tactics in a diversionary manner when faced with increased domestic challenges: as domestic Covid-19 cases climb, Iran reduces its efforts to direct attention toward the pandemic via manipulation, instead favoring an intensification of manipulation that redirects attention toward international investing and commodity prices.

4.4. Sensitivity assessment

In the Supplementary Appendix, we reevaluate the robustness of our analysis in several manners. To demonstrate that our findings are not dependent upon our main STM specification’s over- or under-controlling for possible confounds, we reestimate our primary STM specification and subsequent focused topic analysis in two manners. First, we reestimate our 20-topic STM when including ln Iran Covid-19 cases as the only prevalence covariate. After estimating this STM and re-identifying our three focused topics of interest, we find in Supplementary Figure A1 that the estimated effects of ln Iran Covid-19 cases mirrors those reported in Figure 3 in both direction and magnitude—albeit with more precise 95% confidence intervals. Next, we re-estimate our 20-topic STM when including all covariates initially included in our Lasso variable selection step, rather than only those variables retained by the Lasso. In Supplementary Figure A2, we find that ln Iran Covid-19 cases exhibits comparable relationships (in reliability, direction, and magnitude) with our three topics of interest when compared to those reported in Figure 3. We then re-estimate our primary 20-topic STM specification after adding the interaction between ln Iran Covid-19 cases and ln Iran protest events. As demonstrated in Supplementary Figure A3, we find some evidence to suggest that ln Iran Covid-19 cases may exert a larger effect (in our anticipated directions) on tweets discussing international markets and Covid-19 when ln Iran protest events are high as opposed to low. However, this was not the case for commodity prices.

As a final means of assessing the empirical support for our primary STM findings, we return to our main STM and use its prevalence covariates to estimate the temporal change in predicted topic probability for each of our 20 topics in relation to changes in our month counter (i.e., time counter) covariate. We then plot these predicted trends over time for the year 2020. 2020 is the first full year of the Covid-19 pandemic and also the only full Covid-19 year that we have complete coverage on across our associated covariates and STM. The plotted trends are presented in Figure 4 where for each specific topic’s predicted prevalence over time (in black), we also include the other associated 19 topics’ predicted prevalence time series plots (in grey) for scale. Even at this higher level of aggregation, we find evidence in support of our primary theoretical contentions and STM findings. Herein, we observe pronounced increases in topical attention to Topics 5 (commodity prices) and Topic 11 (international markets) in June of 2020; as well as a second spike in topical attention to Topic 5 (commodity prices) in November 2020. At the same time, we see a general decline in topical attention to Topic 16 (Covid-19) throughout the 2020 period, with pronounced dips in June 2020 and November 2020. These patterns align well with 2020 Covid-19 trends in Iran in several respects. First, Covid-19 rates were generally increasing throughout 2020 for Iran, which is consistent with our finding of a sustained decrease in attention to Topic 16 (Covid-19) in Figure 4. At the same time, Iran also saw its most pronounced surge in new Covid-19 cases during the first year of the pandemic in November 2020 (Motamedi, Reference Motamedi2020; Ritchie et al., Reference Ritchie, Roser and Rosado2022). The corresponding dip in attention to Topic 16 (Covid-19)—and spike in attention to Topic 5 (commodity prices)—at that same juncture in Figure (Motamedi, Reference Motamedi2020; Ritchie et al., Reference Ritchie, Roser and Rosado2022) each thereby reinforce our expectations and primary STM findings for these two topics.

Figure 4.

Predicted monthly topic prevalence for 2020.

Likewise, June 2020 was a major turning point in Iran’s domestic Covid-19 crisis. Indeed, it has been noted that leading up to June 2020 the Iranian government apparently had Covid-19 relatively under control in April to May of 2020 “until the beginning of June, 2020, when the media reported a worrying sharp increase in the number of COVID-19 cases that mirrored March’s peak levels [and] Iran, seemingly, has been catapulted into a second wave of disease” (Venkatesan, Reference Venkatesan2020, 784). Our June 2020 findings in Figure 4 capture this shift with its aforementioned spikes in tweets on Topics 5 (commodity prices) and Topic 11 (international markets) and dip in Tweet attention to Topic 16 (Covid-19). Thus, and consistent with our main STM analyses, manipulative tweet content associated with Covid-19 (international markets and commodity prices) appears to decline (increase) during periods of heightened domestic Covid-19 challenges within Iran. These findings notwithstanding, we do observe a number of additional temporal shifts in Figure 4’s remaining topic plots. While many of these do not align with the months highlighted above, some do—suggesting that future investigation of Iran’s broader manipulated media strategy in relation to Covid-19 is warranted.