Skip to main content Accessibility help

The Politics of Scrutiny in Human Rights Monitoring: Evidence from Structural Topic Models of US State Department Human Rights Reports

  • Benjamin E. Bagozzi and Daniel Berliner


Human rights monitoring reports play important roles both in the international human rights regime and in productions of human rights data. However, human rights reports are produced by organizations subject to formal and informal pressures that may influence the topics considered salient for attention and scrutiny. We study this potential using structural topic models (STMs), a method used for identifying the latent topical dimensions of texts and assessing the effects of covariates on these dimensions. We apply STMs to a corpus of 6298 State Department Country Reports on Human Rights Practices (1977–2012), identifying a plausible set of topics including killings and disappearances, freedoms of expression and movement, and labor rights, among others. We find that these topics vary markedly both over time and space. We also find that while US domestic politics play no systematic role in shaping topic prevalence, US allies tend to receive more attention to violations of physical integrity rights. These results challenge extant research, and illustrate the usefulness of STM methods for future study of foreign policy documents. Our findings also highlight the importance of topical attention shifts in documents that monitor and evaluate countries.



Hide All

Benjamin E. Bagozzi is an Assistant Professor in the Department of Political Science & International Relations, University of Delaware, Smith Hall, 18 Amstel Ave, Newark, DE 19716 ( Daniel Berliner is an Assistant Professor in the School of Politics & Global Studies, Arizona State University, Coor Hall - Sixth Floor, 975 S. Myrtle Ave, Tempe, AZ 85287 ( Earlier drafts of this paper were presented at the 2016 ISA Annual Convention and at the ASU Center on the Future of War conference “How Do We Know What We Know? Charting the Future for Human Rights Documentation and Analysis.” The authors would like to thank Ken Benoit, three anonymous PSRM reviewers, as well as Chad Clay, David Davis, Christopher Fariss, Jillienne Haglund, LaDawn Haglund, Milli Lake, Will Moore, Kathryn Sikkink, Ryan Welch, Reed Wood, and Thorin Wright for their helpful comments and suggestions. To view supplementary material for this article, please visit



Hide All
Apodaca, Clair. 2006. Understanding U.S. Human Rights Policy: A Paradoxical Legacy. New York City, NY: Routledge.
Bagozzi, Benjamin E. 2015. ‘The Multifaceted Nature of Global Climate Change Negotiations’. Review of International Organizations 10(4):439464.
Carleton, David, and Stohl, Michael. 1987. ‘The Role of Human Rights in US Foreign Assistance Policy: A Critique and Reappraisal’. American Journal of Political Science 31(4):10021018.
Cingranelli, David, and Pasquarello, Thomas. 1985. ‘Human Rights Practices and the Distribution of US Foreign Aid to Latin American Countries’. American Journal of Political Science 29(3):539563.
Cingranelli, David L., and Richards, David L.. 2010. ‘The Cingranelli and Richards (CIRI) Human Rights Data Project’. Human Rights Quarterly 32(2):401424.
Clark, Ann Marie, and Sikkink, Kathryn. 2013. ‘Information Effects and Human Rights Data: Is the Good News About Increased Human Rights Information Bad News for Human Rights Measures?Human Rights Quarterly 35(3):539568.
Cohen, Dara Kay. 2013. ‘Explaining Rape During Civil War: Cross-National Evidence (1980–2009)’. American Political Science Review 107(3):461477.
De Neufville, Judith Innes. 1986. ‘Human Rights Reporting as a Policy Tool: An Examination of the State Department Country Reports’. Human Rights Quarterly 8(4):681699.
Fariss, Christopher J. 2014. ‘Respect for Human Rights has Improved Over Time: Modeling the Changing Standard of Accountability’. American Political Science Review 108(2):297318.
Fariss, Christopher J., Jones, Zachary M., Linder, Fridolin, Crabtree, Charles, Biek, Megan, Ross, Ana, Kaur, Taranamol, and Tsai, Michael. 2015. ‘Human Rights Texts: Converting Human Rights Primary Source Documents Into Data’. PLoS ONE 10(9):e0138935.
Finnemore, Martha, and Sikkink, Kathryn. 1998. ‘International Norm Dynamics and Political Change’. International Organization 54(2):887917.
Foot, Rosemary. 2001. Rights Beyond Borders: The Global Community and the Struggle Over Human Rights in China. New York City, NY: Oxford University Press.
Gibney, Mark, and Stohl, Michael. 1988. ‘Human Rights and US Refugee Policy’. In Mark Gibney (ed.), Open Borders? Closed Societies? The Ethical and Political Issues, Chapter 6 151183. Westport: Greenwood Press.
Gibney, Mark, and Dalton, Matthew. 1996. ‘The Political Terror Scale’. In David L. Cingranelli (ed.), Human Rights and Developing Countries, vol. 4, Policy Studies and Developing Nations 7384. Greenwich: JAI Press.
Goodman, Ryan, and Jinks, Derek. 2003. ‘Measuring the Effects of Human Rights Treaties’. European Journal of International Law 14(1):171183.
Hill, Daniel W. Jr., Moore, Will H., and Mukherjee, Bumba. 2013. ‘Information Politics v Organizational Incentives: When are Amnesty International’s “Naming and Shaming” Reports Biased?International Studies Quarterly 52(2):219232.
Keck, Margaret, and Sikkink, Kathryn. 1998. Activists Beyond Borders: Advocacy Networks in International Politics. Ithaca, NY: Cornell University Press.
Kelley, Judith G., and Simmons, Beth A.. 2015. ‘Politics by Number: Indicators as Social Pressure in International Relations’. American Journal of Political Science 59(1):5570.
Lorenz, Andrea W. 1993. ‘Human Rights Watch Urges Clinton Administration to Take a Bold Stand on Human Rights’. Washington Report on Middle East Affairs, February, p. 61. Available at, accessed 20 June 2015.
McCormick, James M., and Mitchell, Neil J.. 1997. ‘Human Rights Violations, Umbrella Concepts, and Empirical Analysis’. World Politics 49(4):510525.
Mertus, Julie A. 2004. Bait and Switch: Human Rights and US Foreign Policy. New York: Routledge.
Mitchell, Neil J., and McCormick, James M.. 1988. ‘Economic and Political Explanations of Human Rights Violations’. World Politics 40(4):476498.
Mosley, Layna, and Uno, Saika. 2007. ‘Racing to the Bottom or Climbing to the Top? Economic Globalization and Collective Labor Rights’. Comparative Political Studies 40(8):923948.
Parmly, Michael E. 2001. ‘Perspectives: Country Reports on Human Rights Practices’. The Defense Institute of Security Assistance Management Journal 23(3):5160.
Poe, Steven C. 1990. ‘Human Rights and US Foreign Aid: A Review of Quantitative Studies and Suggestions for Future Research’. Human Rights Quarterly 12(4):499512.
Poe, Steven C., and Tate, Neal. 1994. ‘Repression of Human Rights to Personal Integrity in the 1980s: A Global Analysis’. American Political Science Review 88(4):853872.
Poe, Steven C., Carey, Sabine C., and Vazquez, Tanya C.. 2001. ‘How are These Pictures Different? A Quantitative Comparison of the US State Department and Amnesty International Human Rights Reports, 1976-1995’. Human Rights Quarterly 23(3):650677.
Quinn, Kevin M., Monroe, Burt L., Colaresi, Michael, Crespin, Michael H., and Radev, Dragomir R.. 2010. ‘How to Analyze Political Attention With Minimal Assumptions and Costs’. American Journal of Political Science 54(1):209228.
Richards, David L. 2016. ‘The Myth of Information Effects in Human Rights Data: Response to Ann Marie Clark and Kathryn Sikkink’. Human Rights Quarterly 38(2):477492.
Roberts, L. Kathleen. 2003. ‘United States and the World: Changing Approaches to Human Rights Diplomacy Under the Bush Administration’. Berkeley Journal of International Law 21(3):631661.
Roberts, Margaret E., Stewart, Brandon M., and Tingley, Dustin. 2014. ‘stm-package {stm}’. R Documentation. Available at, accessed 20 June 2015.
Roberts, Margaret E., Stewart, Brandon M., Tingley, Dustin, Lucas, Christopher, Leder-Luis, Jetson, Gadarian, Shana, Albertson, Bethany, and Rand, David G.. 2014. ‘Structural Topic Models for Open Ended Responses’. American Journal of Political Science 58(4):10641082.
Ron, James, Ramos, Howard, and Rodgers, Kathleen. 2005. ‘Transnational Information Politics: Human Rights NGO Reporting, 1986–2000’. International Studies Quarterly 49(3):557587.
Schnakenberg, Keith E., and Fariss, Christopher J.. 2014. ‘Dynamic Patterns of Human Rights Practices’. Political Science Research and Methods 2(1):131.
Sikkink, Kathryn. 2007. Mixed Signals: US Human Rights Policy and Latin America. Ithaca: Cornell University Press.
Sikkink, Kathryn, and Walling, Carrie Booth. 2007. ‘The Impact of Human Rights Trials in Latin America’. Journal of Peace Research 44(4):427445.
Weitzer, Ronald. 2007. ‘The Social Construction of Sex Trafficking: Ideology and Institutionalization of a Moral Crusade’. Politics & Society 35(3):447475.
Wood, Reed, and Gibney, Mark. 2010. ‘The Political Terror Scale (PTS): A Re-Introduction and a Comparison to CIRI’. Human Rights Quarterly 32(2):367400.

Related content

Powered by UNSILO
Type Description Title
Supplementary materials

Bagozzi and Berliner supplementary material

 PDF (2.4 MB)
2.4 MB
Supplementary materials

Bagozzi and Berliner Dataset


The Politics of Scrutiny in Human Rights Monitoring: Evidence from Structural Topic Models of US State Department Human Rights Reports

  • Benjamin E. Bagozzi and Daniel Berliner


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.