Skip to main content

Diverse Pre-Treatment Effects in Survey Experiments

  • Katerina Linos (a1) and Kimberly Twist (a2)

Researchers using survey experiments typically assume respondents are blank slates, encountering information for the first time. We study how prior real-world information dissemination through the mass media shapes experimental results. We show prior exposure can lead us to both under- and overestimate true framing effects in experiments. Message clarity moderates the impact of pre-treatment, with clear information more likely to produce pre-treatment effects than unclear information.

Hide All
Barabas, J. and Jerit, J.. 2009. “Estimating the Causal Effects of Media Coverage on Policy-Specific Knowledge.” American Journal of Political Science 53 (1): 7389.
Cacioppo, J. T. and Petty, R. E.. 1979. “Effects of Message Repetition and Position on Cognitive Response, Recall, and Persuasion.” Journal of Personality and Social Psychology 37 (1): 97109.
Chong, D. and Druckman, J. N.. 2007. “Framing Public Opinion in Competitive Democracies.” American Political Science Review 101 (4): 637655.
Chong, D. and Druckman, J. N.. 2010. “Dynamic Public Opinion: Communication Effects over Time.” American Political Science Review 104 (4): 663680.
Druckman, J. N. and Leeper, T. J.. 2012. “Learning More from Political Communication Experiments: Pretreatment and its Effects.” American Journal of Political Science 56 (4): 875896.
Drummond, B. 2012. “Obama Health Law Seen Valid, Scholars Expect Rejection.” Business Week (June 22, 2012). (, accessed September 24, 2013.
Egan, P. J. and Citrin, J.. 2011. “The Limits of Judicial Persuasion and the Fragility of Judicial Legitimacy.” Unpublished manuscript. Available:
Fowler, E. F. and Gollust, S. E.. 2015. “The Content and Effect of Politicized Health Controversies.” The Annals of the American Academy of Political and Social Science 658: 155171.
Gaines, B. J., Kuklinski, J. H., and Quirk, P. J.. 2007. “The Logic of the Survey Experiment Reexamined.” Political Analysis 15 (1): 120.
Iyengar, S., Kinder, D. R., Peters, M. D., and Krosnick, J. A.. 1984. “The Evening News and Presidential Evaluations.” Journal of Personality and Social Psychology 46 (4): 778787.
Linos, K. and Twist, K.. 2017. “Replication Data for Diverse Pre-Treatment Effects in Survey Experiments.” Journal of Experimental Political Science doi:10.7910/DVN/WA03I2, Harvard Dataverse.
Malhotra, N. and Krosnick, J. A.. 2007. “Retrospective and Prospective Performance Assessments during the 2004 Election Campaign: Tests of Mediation and News Media Priming.” Political Behavior 29 (2): 249278.
Mutz, D. C. 2011. Population-Based Survey Experiments. Princeton: Princeton University Press.
Slothuus, R. 2015. “Assessing the Influence of Political Parties on Public Opinion: The Challenge from Pretreatment Effects.” Political Communication 33 (2): 302327.
Sniderman, P. M. 2011. “The Logic and Design of the Survey Experiment: An Autobiography of a Methodological Innovation.” In Cambridge Handbook of Experimental Political Science, eds. Druckman, James N., Green, Donald P., Kuklinski, James H., and Lupia, Arthur. New York, NY: Cambridge University Press.
Wallace, G. P. R. 2013. “International Law and Public Attitudes Toward Torture: An Experimental Study.” International Organization 67 (1): 105140.
Zaller, J. 1992. The Nature and Origins of Mass Opinion. New York, NY: Cambridge University Press.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of Experimental Political Science
  • ISSN: 2052-2630
  • EISSN: 2052-2649
  • URL: /core/journals/journal-of-experimental-political-science
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary materials

Linos and Twist supplementary material
Linos and Twist supplementary material 1

 PDF (1.1 MB)
1.1 MB


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed