Skip to main content

The Impact of Party Cues on Manual Coding of Political Texts*


Do coders of political texts incorporate prior beliefs about parties’ issue stances into their coding decisions? We report results from a coding experiment in which ten coders were each given 200 statements on immigration that were extracted from election manifestos. Party labels in these statements were randomly assigned (including a control category without party cues). Coders were more likely to code a statement as pro-immigration if it was attributed to the Greens and less likely choose the anti-immigration category if it was attributed to the populist radical right. No effect was found for mainstream parties of the center-left and center-right. The results also suggest that coders resort to party cues as heuristics when faced with ambiguous policy statements.

Hide All

Laurenz Ennser-Jedenastik, Assistant Professor ( and Thomas M. Meyer, Assistant Professor (, Department of Government, University of Vienna, Rooseveltplatz 3/1, 1090 Vienna. To view supplementary material for this article, please visit

Hide All
Benoit Kenneth, Conway Drew, Lauderdale Benjamin E., Laver Michael, and Mikhaylov Slava. 2016. ‘Crowd-Sourced Text Analysis: Reproducible and Agile Production of Political Data’. American Political Science Review 110(2):278295.
Bolsen Toby, Druckman James N., and Cook Fay L.. 2014. ‘The Influence of Partisan Motivated Reasoning on Public Opinion’. Political Behavior 36:235262.
Bräuninger Thomas, and Giger Nathalie. 2016. Strategic Ambiguity of Party Positions in Multiparty Competition. Political Science Research and Methods (FirstView).
Budge Ian, Klingemann Hans-Dieter, Volkens Andrea, Bara Judith, and Tanenbaum Eric. 2001. Mapping Policy Preferences. Estimates for Parties, Electors, and Governments 1945-1998. Oxford: Oxford University Press.
Cohen Geoffrey L. 2003. ‘Party Over Policy: The Dominating Impact of Group Influence on Political Beliefs’. Journal of Personality and Social Psychology 85:808822.
Dancey Logan, and Sheagley Geoff. 2013. ‘Heuristics Behaving Badly: Party Cues and Voter Knowledge’. American Journal of Political Science 57:312325.
Däubler Thomas, Benoit Kenneth, Mikhaylov Slava, and Laver Michael. 2012. ‘Natural Sentences as Valid Units for Coded Political Texts’. British Journal of Political Science 42:937951.
Dolezal Martin, Ennser-Jedenastik Laurenz, Müller Wolfgang C., and Winkler Anna K.. 2016. ‘Analyzing Manifestos in their Electoral Context a New Approach Applied to Austria, 2002–2008’. Political Science Research and Methods 4(3):641650.
Druckman James N., Peterson Erik, and Slothuus Rune. 2013. ‘How Elite Partisan Polarization Affects Public Opinion Formation’. American Political Science Review 107:5779.
Eagly Alice H., and Chaiken Shelly. 1993. The Psychology of Attitudes. Orlando, FL: Harcourt Brace Jovanovich College Publishers.
Esuli Andrea, and Sebastiani Fabrizio. 2010. ‘Machines That Learn How to Code Open-Ended Survey Data’. International Journal of Market Research 52(6):775800.
Fortunato David, and Stevenson Randolph T.. 2016. Heuristics in Context. Political Science Research and Methods (FirstView).
Goren Paul, Federico Christopher M., and Kittilson Miki C.. 2009. ‘Source Cues, Partisan Identities, and Political Value Expression’. American Journal of Political Science 53(4):805820.
Grimmer Justin, and Stewart Brendan M.. 2013. ‘Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts’. Political Analysis 21(3):267297.
Kam Cindy D. 2005. ‘Who Toes the Party Line? Cues, Values, and Individual Differences’. Political Behavior 27:163182.
Klüver Heike, and Sagarzazu Iñaki. 2016. ‘Setting the Agenda or Responding to Voters? Political Parties, Voters and Issue Attention’. West European Politics 39:380398.
Koch Jeffrey W. 2001. ‘When Parties and Candidates Collide: Citizen Perception of House Candidates’ Positions on Abortion’. Public Opinion Quarterly 65:121.
Laver Michael, Benoit Kenneth, and Garry John. 2003. ‘Extracting Policy Positions From Political Texts Using Words as Data’. American Political Science Review 97:311331.
Laver Michael, and Garry John. 2000. ‘Estimating Policy Positions from Political Texts’. American Journal of Political Science 44:619634.
Lowe Will, and Benoit Kenneth. 2013. ‘Validating Estimates of Latent Traits from Textual Data Using Human Judgment as a Benchmark’. Political Analysis 21(3):298313.
Mikhaylov Slava, Laver Michael, and Benoit Kenneth. 2012. ‘Coder Reliability and Misclassification in the Human Coding of Party Manifestos’. Political Analysis 20:7891.
Nardulli Peter F., Althaus Scott L., and Hayes Matthew. 2015. ‘A Progressive Supervised-Learning Approach to Generating Rich Civil Strife Data’. Sociological Methodology 45(1):148183.
Nicholson Stephen P. 2012. ‘Polarizing Cues’. American Journal of Political Science 56:5266.
Petersen Michael B., Skov Martin, Serritzlew Søren, and Ramsøy Thomas. 2013. ‘Motivated Reasoning and Political Parties: Evidence for Increased Processing in the Face of Party Cues’. Political Behavior 35:831854.
Pfarr Christian, Schmid Andreas, and Schneider Udo. 2011. ‘Estimating Ordered Categorical Variables Using Panel Data: A Generalized Ordered Probit Model With an Autofit Procedure’. Journal of Economics and Econometrics 54:723.
Proksch Sven-Oliver, and Slapin Jonathan B.. 2010. ‘Position Taking in European Parliament Speeches’. British Journal of Political Science 40:587611.
Ross Janell. 2016. ‘Michelle Obama Speech: How the First Lady Took Down Donald Trump Without Mentioning His Name’. Independent, 26 July 2016. Available at, accessed 14 September 2017.
Rovny Jan. 2012. ‘Who Emphasizes and Who Blurs? Party Strategies in Multidimensional Competition’. European Union Politics 13(2):269292.
Rovny Jan. 2013. ‘Where Do Radical Right Parties Stand? Position Blurring in Multidimensional Competition’. European Political Science Review 5(1):126.
Sagarzazu Iñaki, and Klüver Heike. 2017. ‘Coalition Governments and Party Competition: Political Communication Strategies of Coalition Parties’. Political Science Research and Methods 5(2):333349.
Schwarz Daniel, Traber Denise, and Benoit Kenneth. 2017. ‘Estimating Intra-Party Preferences: Comparing Speeches to Votes’. Political Science Research and Methods 5(2):379396.
Slapin Jonathan B., and Proksch Sven-Oliver. 2008. ‘A Scaling Model for Estimating Time-Series Party Positions from Texts’. American Journal of Political Science 52:705722.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Science Research and Methods
  • ISSN: 2049-8470
  • EISSN: 2049-8489
  • URL: /core/journals/political-science-research-and-methods
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
Type Description Title
Supplementary Materials

Ennser-Jedenastik and Meyer Dataset

Supplementary Materials

Ennser-Jedenastik and Meyer supplementary material
Ennser-Jedenastik and Meyer supplementary material 1

 Word (327 KB)
327 KB


Altmetric attention score

Full text views

Total number of HTML views: 4
Total number of PDF views: 71 *
Loading metrics...

Abstract views

Total abstract views: 459 *
Loading metrics...

* Views captured on Cambridge Core between 29th September 2017 - 11th December 2017. This data will be updated every 24 hours.