Skip to main content

The Impact of Party Cues on Manual Coding of Political Texts*

  • Laurenz Ennser-Jedenastik and Thomas M. Meyer

Do coders of political texts incorporate prior beliefs about parties’ issue stances into their coding decisions? We report results from a coding experiment in which ten coders were each given 200 statements on immigration that were extracted from election manifestos. Party labels in these statements were randomly assigned (including a control category without party cues). Coders were more likely to code a statement as pro-immigration if it was attributed to the Greens and less likely choose the anti-immigration category if it was attributed to the populist radical right. No effect was found for mainstream parties of the center-left and center-right. The results also suggest that coders resort to party cues as heuristics when faced with ambiguous policy statements.

Hide All

Laurenz Ennser-Jedenastik, Assistant Professor ( and Thomas M. Meyer, Assistant Professor (, Department of Government, University of Vienna, Rooseveltplatz 3/1, 1090 Vienna. To view supplementary material for this article, please visit

Hide All
Benoit, Kenneth, Conway, Drew, Lauderdale, Benjamin E., Laver, Michael, and Mikhaylov, Slava. 2016. ‘Crowd-Sourced Text Analysis: Reproducible and Agile Production of Political Data’. American Political Science Review 110(2):278295.
Bolsen, Toby, Druckman, James N., and Cook, Fay L.. 2014. ‘The Influence of Partisan Motivated Reasoning on Public Opinion’. Political Behavior 36:235262.
Bräuninger, Thomas, and Giger, Nathalie. 2016. Strategic Ambiguity of Party Positions in Multiparty Competition. Political Science Research and Methods (FirstView).
Budge, Ian, Klingemann, Hans-Dieter, Volkens, Andrea, Bara, Judith, and Tanenbaum, Eric. 2001. Mapping Policy Preferences. Estimates for Parties, Electors, and Governments 1945-1998. Oxford: Oxford University Press.
Cohen, Geoffrey L. 2003. ‘Party Over Policy: The Dominating Impact of Group Influence on Political Beliefs’. Journal of Personality and Social Psychology 85:808822.
Dancey, Logan, and Sheagley, Geoff. 2013. ‘Heuristics Behaving Badly: Party Cues and Voter Knowledge’. American Journal of Political Science 57:312325.
Däubler, Thomas, Benoit, Kenneth, Mikhaylov, Slava, and Laver, Michael. 2012. ‘Natural Sentences as Valid Units for Coded Political Texts’. British Journal of Political Science 42:937951.
Dolezal, Martin, Ennser-Jedenastik, Laurenz, Müller, Wolfgang C., and Winkler, Anna K.. 2016. ‘Analyzing Manifestos in their Electoral Context a New Approach Applied to Austria, 2002–2008’. Political Science Research and Methods 4(3):641650.
Druckman, James N., Peterson, Erik, and Slothuus, Rune. 2013. ‘How Elite Partisan Polarization Affects Public Opinion Formation’. American Political Science Review 107:5779.
Eagly, Alice H., and Chaiken, Shelly. 1993. The Psychology of Attitudes. Orlando, FL: Harcourt Brace Jovanovich College Publishers.
Esuli, Andrea, and Sebastiani, Fabrizio. 2010. ‘Machines That Learn How to Code Open-Ended Survey Data’. International Journal of Market Research 52(6):775800.
Fortunato, David, and Stevenson, Randolph T.. 2016. Heuristics in Context. Political Science Research and Methods (FirstView).
Goren, Paul, Federico, Christopher M., and Kittilson, Miki C.. 2009. ‘Source Cues, Partisan Identities, and Political Value Expression’. American Journal of Political Science 53(4):805820.
Grimmer, Justin, and Stewart, Brendan M.. 2013. ‘Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts’. Political Analysis 21(3):267297.
Kam, Cindy D. 2005. ‘Who Toes the Party Line? Cues, Values, and Individual Differences’. Political Behavior 27:163182.
Klüver, Heike, and Sagarzazu, Iñaki. 2016. ‘Setting the Agenda or Responding to Voters? Political Parties, Voters and Issue Attention’. West European Politics 39:380398.
Koch, Jeffrey W. 2001. ‘When Parties and Candidates Collide: Citizen Perception of House Candidates’ Positions on Abortion’. Public Opinion Quarterly 65:121.
Laver, Michael, Benoit, Kenneth, and Garry, John. 2003. ‘Extracting Policy Positions From Political Texts Using Words as Data’. American Political Science Review 97:311331.
Laver, Michael, and Garry, John. 2000. ‘Estimating Policy Positions from Political Texts’. American Journal of Political Science 44:619634.
Lowe, Will, and Benoit, Kenneth. 2013. ‘Validating Estimates of Latent Traits from Textual Data Using Human Judgment as a Benchmark’. Political Analysis 21(3):298313.
Mikhaylov, Slava, Laver, Michael, and Benoit, Kenneth. 2012. ‘Coder Reliability and Misclassification in the Human Coding of Party Manifestos’. Political Analysis 20:7891.
Nardulli, Peter F., Althaus, Scott L., and Hayes, Matthew. 2015. ‘A Progressive Supervised-Learning Approach to Generating Rich Civil Strife Data’. Sociological Methodology 45(1):148183.
Nicholson, Stephen P. 2012. ‘Polarizing Cues’. American Journal of Political Science 56:5266.
Petersen, Michael B., Skov, Martin, Serritzlew, Søren, and Ramsøy, Thomas. 2013. ‘Motivated Reasoning and Political Parties: Evidence for Increased Processing in the Face of Party Cues’. Political Behavior 35:831854.
Pfarr, Christian, Schmid, Andreas, and Schneider, Udo. 2011. ‘Estimating Ordered Categorical Variables Using Panel Data: A Generalized Ordered Probit Model With an Autofit Procedure’. Journal of Economics and Econometrics 54:723.
Proksch, Sven-Oliver, and Slapin, Jonathan B.. 2010. ‘Position Taking in European Parliament Speeches’. British Journal of Political Science 40:587611.
Ross, Janell. 2016. ‘Michelle Obama Speech: How the First Lady Took Down Donald Trump Without Mentioning His Name’. Independent, 26 July 2016. Available at, accessed 14 September 2017.
Rovny, Jan. 2012. ‘Who Emphasizes and Who Blurs? Party Strategies in Multidimensional Competition’. European Union Politics 13(2):269292.
Rovny, Jan. 2013. ‘Where Do Radical Right Parties Stand? Position Blurring in Multidimensional Competition’. European Political Science Review 5(1):126.
Sagarzazu, Iñaki, and Klüver, Heike. 2017. ‘Coalition Governments and Party Competition: Political Communication Strategies of Coalition Parties’. Political Science Research and Methods 5(2):333349.
Schwarz, Daniel, Traber, Denise, and Benoit, Kenneth. 2017. ‘Estimating Intra-Party Preferences: Comparing Speeches to Votes’. Political Science Research and Methods 5(2):379396.
Slapin, Jonathan B., and Proksch, Sven-Oliver. 2008. ‘A Scaling Model for Estimating Time-Series Party Positions from Texts’. American Journal of Political Science 52:705722.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Science Research and Methods
  • ISSN: 2049-8470
  • EISSN: 2049-8489
  • URL: /core/journals/political-science-research-and-methods
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
Type Description Title
Supplementary materials

Ennser-Jedenastik and Meyer Dataset

Supplementary materials

Ennser-Jedenastik and Meyer supplementary material
Ennser-Jedenastik and Meyer supplementary material 1

 Word (327 KB)
327 KB


Altmetric attention score

Full text views

Total number of HTML views: 4
Total number of PDF views: 90 *
Loading metrics...

Abstract views

Total abstract views: 590 *
Loading metrics...

* Views captured on Cambridge Core between 29th September 2017 - 22nd March 2018. This data will be updated every 24 hours.