Hostname: page-component-848d4c4894-p2v8j Total loading time: 0.001 Render date: 2024-05-20T00:04:15.026Z Has data issue: false hasContentIssue false

Testing for Negative Spillovers: Is Promoting Human Rights Really Part of the “Problem”?

Published online by Cambridge University Press:  25 January 2021

Get access


The international community often seeks to promote political reforms in recalcitrant states. Recently, some scholars have argued that, rather than helping, international law and advocacy create new problems because they have negative spillovers that increase rights violations. We review three mechanisms for such spillovers: backlash, trade-offs, and counteraction and concentrate on the last of these. Some researchers assert that governments sometimes “counteract” international human rights pressures by strategically substituting violations in adjacent areas that are either not targeted or are harder to monitor. However, most such research shows only that both outcomes correlate with an intervention—the targeted positively and the spillover negatively. The burden of proof, however, should be as rigorous as those for studies of first-order policy consequences. We show that these correlations by themselves are insufficient to demonstrate counteraction outside of the narrow case where the intervention is assumed to have no direct effect on the spillover, a situation akin to having a valid instrumental variable design. We revisit two prominent findings and show that the evidence for the counteraction claim is weak in both cases. The article contributes methodologically to the study of negative spillovers in general by proposing mediation and sensitivity analysis within an instrumental variables framework for assessing such arguments. It revisits important prior findings that claim negative consequences to human rights law and/or advocacy, and raises critical normative questions regarding how we empirically evaluate hypotheses about causal mechanisms.

Research Article
Copyright © The IO Foundation 2021

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)


Acharya, Avidit, Blackwell, Matthew, and Sen, Maya. 2016. Explaining Causal Findings Without Bias: Detecting and Assessing Direct Effects. American Political Science Review 110 (3):512–29.CrossRefGoogle Scholar
Ahmed, Faisal. 2012. The Perils of Unearned Foreign Income: Aid, Remittances, and Government Survival. American Political Science Review 106 (1):146–65.CrossRefGoogle Scholar
Alvi, Shahzad, and Ahmed, Ather Maqsood. 2014. Analyzing the Impact of Health and Education on Total Factor Productivity: A Panel Data Approach. Indian Economic Review 49 (1):109–23.Google Scholar
Ambrosio, Thomas. 2016. Authoritarian Backlash: Russian Resistance to Democratization in the Former Soviet Union. Routledge.CrossRefGoogle Scholar
Angrist, Joshua D. 2001. Estimation of Limited Dependent Variable Models with Dummy Endogenous Regressors: Simple Strategies for Empirical Practice. Journal of Business and Economic Statistics 19 (1):228.CrossRefGoogle Scholar
Angrist, Joshua D., and Imbens, Guido W.. 1995. Two-Stage Least Squares Estimation of Average Causal Effects in Models with Variable Treatment Intensity. Journal of the American Statistical Association 90 (430):431–42.CrossRefGoogle Scholar
Angrist, Joshua D., Imbens, Guido W., and Rubin, Donald B.. 1996. Identification of Causal Effects Using Instrumental Variables. Journal of the American Statistical Association 91 (434):444–55.CrossRefGoogle Scholar
Angrist, Joshua D., and Pischke, Jörn-Steffen. 2009. Mostly Harmless Econometrics: An Empiricist's Companion. Princeton University Press.CrossRefGoogle Scholar
Arendt, Hannah. 1970. On Violence. Houghton Mifflin Harcourt.Google Scholar
Aronow, Peter M., and Samii, Cyrus. 2016. Does Regression Produce Representative Estimates of Causal Effects? American Journal of Political Science 60 (1):250–67.CrossRefGoogle Scholar
Baron, Reuben M., and Kenny, David A.. 1986. The Moderator–Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations. Journal of Personality and Social Psychology 51 (6):1173–82.CrossRefGoogle ScholarPubMed
Bell, Sam R., Clay, K. Chad, and Murdie, Amanda. 2012. Neighborhood Watch: Spatial Effects of Human Rights INGOs. The Journal of Politics 74 (2):354–68.CrossRefGoogle Scholar
Calver, Matthew. 2015. Closing the Aboriginal Education Gap in Canada: The Impact on Employment, GDP, and Labour Productivity. International Productivity Monitor (28):2746.Google Scholar
Carothers, Thomas. 2003. Promoting the Rule of Law Abroad: The Knowledge Problem. The Carnegie Endowment for International Peace. Accessed 3 November 2020 from <>..>Google Scholar
Chaudoin, Stephen, Hays, Jude, and Hicks, Raymond. 2018. Do We Really Know the WTO Cures Cancer? British Journal of Political Science 48 (4):903–28.CrossRefGoogle Scholar
Cinelli, Carlos, and Hazlett, Chad. 2020. Making Sense of Sensitivity: Extending Omitted Variable Bias. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 82 (1):3967.CrossRefGoogle Scholar
Cohen, Jacob. 1992. A Power Primer. Psychological Bulletin 112 (1):155–59.CrossRefGoogle Scholar
Conley, Timothy G., Hansen, Christian B., and Rossi, Peter E.. 2012. Plausibly Exogenous. Review of Economics and Statistics 94 (1):260–72.CrossRefGoogle Scholar
Conrad, Courtenay R., and DeMeritt, Jacqueline H.R.. 2014. Unintended Consequences: The Effect of Advocacy to End Torture on Empowerment Rights Violations. In Examining Torture: Empirical Studies of State Repression, edited by Lightcap, Tracy and Pfiffner, James P., 159–83. Palgrave Macmillan.Google Scholar
Conrad, Courtenay R., and Moore, Will H.. 2010. What Stops the Torture? American Journal of Political Science 54 (2):459–76.CrossRefGoogle Scholar
Conrad, Courtenay R., and Ritter, Emily Hencken. 2013. Treaties, Tenure, and Torture: The Conflicting Domestic Effects of International Law. The Journal of Politics 75 (2):397409.CrossRefGoogle Scholar
Davenport, Christian. 2007. State Repression and Political Order. Annual Review of Political Science 10:123.CrossRefGoogle Scholar
Daxecker, Ursula. 2017. Dirty Hands: Government Torture and Terrorism. Journal of Conflict Resolution 61 (6):1261–89.CrossRefGoogle Scholar
Downs, George W., Rocke, David M., and Barsoom, Peter N.. 1996. Is the Good News About Compliance Good News About Cooperation? International Organization 50 (3):379406.CrossRefGoogle Scholar
Dreher, Axel, Gassebner, Martin, and Siemers, Lars-H.R.. 2012. Globalization, Economic Freedom, and Human Rights. Journal of Conflict Resolution 56 (3):516–46.CrossRefGoogle Scholar
Epprecht, Marc. 2012. Sexual Minorities, Human Rights and Public Health Strategies in Africa. African Affairs 111 (443):223–43.CrossRefGoogle ScholarPubMed
Ertefaie, Ashkan, Small, Dylan S., Flory, James H., and Hennessy, Sean. 2017. A Tutorial on the Use of Instrumental Variables in Pharmacoepidemiology. Pharmacoepidemiology and Drug Safety 26 (4):357–67.CrossRefGoogle ScholarPubMed
Fägerlind, Ingemar, and Saha, Lawrence J.. 2014. Education and National Development: A Comparative Perspective. Elsevier.Google Scholar
Fariss, Christopher J., and Schnakenberg, Keith E.. 2014. Measuring Mutual Dependence Between State Repressive Actions. Journal of Conflict Resolution 58 (6):1003–32.CrossRefGoogle Scholar
Franklin, James C. 2008. Shame on You: The Impact of Human Rights Criticism on Political Repression in Latin America. International Studies Quarterly 52 (1):187211.CrossRefGoogle Scholar
Green, Donald P., Ha, Shang E., and Bullock, John G.. 2010. Enough Already About “Black Box” Experiments: Studying Mediation Is More Difficult Than Most Scholars Suppose. The Annals of the American Academy of Political and Social Science 628 (1):200208.CrossRefGoogle Scholar
Hafner-Burton, Emilie M. 2008. Sticks and Stones: Naming and Shaming the Human Rights Enforcement Problem. International Organization 62 (4):689716.CrossRefGoogle Scholar
Harris, Richard, and Arku, Godwin. 2006. Housing and Economic Development: The Evolution of an Idea Since 1945. Habitat International 30 (4):1007–17.CrossRefGoogle Scholar
Helfer, Laurence R. 2017. Overlegalizing Human Rights: International Relations Theory and the Commonwealth Caribbean Backlash Against Human Rights Regimes. In International Law and Society, 125204. Routledge.Google Scholar
Hopgood, Stephen, Snyder, Jack, and Vinjamuri, Leslie. 2017. Introduction: Human Rights Past, Present and Future. In Human Rights Futures, edited by Hopgood, Stephen, Snyder, Jack, and Vinjamuri, Leslie, 123. Cambridge University Press.CrossRefGoogle Scholar
Huber, Martin. 2014. Sensitivity Checks for the Local Average Treatment Effect. Economics Letters 123 (2):220–23.CrossRefGoogle Scholar
Hurd, Elizabeth Shakman. 2017. Governing Religion As Right. In Human Rights Futures, edited by Hopgood, Stephen, Snyder, Jack, and Vinjamuri, Leslie, 189212. Cambridge University Press.CrossRefGoogle Scholar
Ichino, Nahomi, and Schündeln, Matthias. 2012. Deterring or Displacing Electoral Irregularities? Spillover Effects of Observers in a Randomized Field Experiment in Ghana. The Journal of Politics 74 (1):292307.CrossRefGoogle Scholar
Imai, Kosuke, Keele, Luke, Tingley, Dustin, and Yamamoto, Teppei. 2011. Unpacking the Black Box of Causality: Learning About Causal Mechanisms from Experimental and Observational Studies. American Political Science Review 105 (4):765–89.CrossRefGoogle Scholar
Imbens, Guildo W. 2003. Sensitivity to Exogeneity Assumptions in Program Evaluation. American Economic Review 93 (2):126–32.CrossRefGoogle Scholar
Kelley, Judith. 2011. Do International Election Monitors Increase or Decrease Opposition Boycotts? Comparative Political Studies 44 (11):1527–56.CrossRefGoogle Scholar
Kennedy, David. 2002. The International Human Rights Movement: Part of the Problem? Harvard Human Rights Journal 15 (3):101–26.Google Scholar
Kennedy, David. 2004. The Dark Sides of Virtue: Reassessing International Humanitarianism. Princeton University Press.CrossRefGoogle Scholar
Kleinfeld, Rachel. 2012. Advancing the Rule of Law Abroad: Next Generation Reform. Brookings Institution Press.Google Scholar
Kraay, Aart. 2012. Instrumental Variables Regressions with Uncertain Exclusion Restrictions: A Bayesian Approach. Journal of Applied Econometrics 27 (1):108–28.CrossRefGoogle Scholar
Kuperman, Alan J. 2004. The Limits of Humanitarian Intervention: Genocide in Rwanda. Brookings Institution Press.Google Scholar
Lupu, Yonatan. 2013. Best Evidence: The Role of Information in Domestic Judicial Enforcement of International Human Rights Agreements. International Organization 67 (3):469503.CrossRefGoogle Scholar
MacKinnon, David P., Lockwood, Chondra M., Hoffman, Jeanne M., West, Stephen G., and Sheets, Virgil. 2002. A Comparison of Methods to Test Mediation and Other Intervening Variable Effects. Psychological Methods 7 (1):83104.CrossRefGoogle ScholarPubMed
Moore, Will H. 1998. Repression and Dissent: Substitution, Context, and Timing. American Journal of Political Science 42 (3):851–73.CrossRefGoogle Scholar
Moore, Will H. 2000. The Repression of Dissent: A Substitution Model of Government Coercion. Journal of Conflict Resolution 44 (1):107–27.CrossRefGoogle Scholar
Morrison, Kevin. 2009. Oil, Nontax Revenue, and the Redistributional Foundations of Regime Stability. International Organization 63 (1):107–38.CrossRefGoogle Scholar
Moyn, Samuel. 2010. The Last Utopia: Human Rights in History. Belknap/Harvard University Press.Google Scholar
Murdie, Amanda, and Bhasin, Tavishi. 2011. Aiding and Abetting: Human Rights INGOs and Domestic Protest. Journal of Conflict Resolution 55 (2):163–91.CrossRefGoogle Scholar
Murdie, Amanda, and Davis, David. 2012. Shaming and Blaming: Using Events Data to Assess the Impact of Human Rights INGOs. International Studies Quarterly 56 (1):116.CrossRefGoogle Scholar
Neyman, Jerzy. 1923. On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9. Statistical Science 5 (4):465–72.Google Scholar
Oster, Emily. 2019. Unobservable Selection and Coefficient Stability: Theory and Evidence. Journal of Business and Economic Statistics 37 (2):187204.CrossRefGoogle Scholar
Pearl, Judea. 2000. Causality: Models, Reasoning, and Inference. Cambridge University Press.Google Scholar
Pearl, Judea. 2001. Direct and Indirect Effects. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence, 411–20. Morgan Kaufmann.Google Scholar
Posner, Eric A. 2008. Human Welfare, Not Human Rights. Columbia Law Review 108: 1758–801.Google Scholar
Rafi, Mohammad, and Chowdhury, A.M.R.. 2000. Human Rights and Religious Backlash: The Experience of a Bangladeshi NGO. Development in Practice 10 (1):1930.CrossRefGoogle ScholarPubMed
Rejali, Darius M. 2007. Torture and Democracy. Princeton University Press.Google Scholar
Risse, Thomas, and Sikkink, Kathryn. 1999. The Socialization of International Human Rights Norms into Domestic Practice: Introduction. In The Power of Human Rights: International Norms and Domestic Change, edited by Risse, Thomas, Ropp, Steve C., and Sikkink, Kathryn, 138. Cambridge University Press.CrossRefGoogle Scholar
Robins, James M., and Greenland, Sander. 1992. Identifiability and Exchangeability for Direct and Indirect Effects. Epidemiology 3 (2):143–55.CrossRefGoogle ScholarPubMed
Rosenbaum, Paul R. 2002. Observational Studies. 2nd ed. Springer.CrossRefGoogle Scholar
Rubin, Donald B. 1974. Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies. Journal of Educational Psychology 66 (5):688701.CrossRefGoogle Scholar
Schedler, Andreas. 2002. The Menu of Manipulation. Journal of Democracy 13 (2):3650.CrossRefGoogle Scholar
Scheff, Thomas J. 2000. Shame and the Social Bond: A Sociological Theory. Sociological Theory 18 (1):8499.CrossRefGoogle Scholar
Sikkink, Kathryn. 2013. The United States and Torture: Does the Spiral Model Work? In The Persistent Power of Human Rights: From Commitment to Compliance, edited by Risse, Thomas, Ropp, Steve C., and Sikkink, Kathryn, 145–63. Cambridge University Press.CrossRefGoogle Scholar
Simmons, Beth A. 2009. Mobilizing for Human Rights: International Law in Domestic Politics. Cambridge University Press.CrossRefGoogle Scholar
Simmons, Beth A., and Strezhnev, Anton. 2017. Human Rights and Human Welfare: Looking for a “Dark Side” to International Human Rights Law. In Human Rights Futures, edited by Hopgood, Stephen, Snyder, Jack, and Vinjamuri, Leslie, 6087. Cambridge University Press.CrossRefGoogle Scholar
Simpser, Alberto, and Donno, Daniela. 2012. Can International Election Monitoring Harm Governance? The Journal of Politics 74 (2):501–13.CrossRefGoogle Scholar
Snyder, Jack. 2019. Backlash Against Human Rights Shaming: Emotions in Groups. International Theory 12 (1):109–32.CrossRefGoogle Scholar
Sobel, Michael E. 2008. Identification of Causal Parameters in Randomized Studies with Mediating Variables. Journal of Educational and Behavioral Statistics 33 (2):230–51.CrossRefGoogle Scholar
Staiger, Douglas, and Stock, James H.. 1997. Instrumental Variables Regression with Weak Instruments. Econometrica 65 (3):557–86.CrossRefGoogle Scholar
Stock, James H., Wright, Jonathan H., and Yogo, Motohiro. 2002. A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments. Journal of Business and Economic Statistics 20 (4):518–29.CrossRefGoogle Scholar
Thomas, Daniel C. 2001. The Helsinki Effect: International Norms, Human Rights, and the Demise of Communism. Princeton University Press.CrossRefGoogle Scholar
Tsutsui, Kiyoteru, Whitlinger, Claire, and Lim, Alwyn. 2012. International Human Rights Law and Social Movements: States’ Resistance and Civil Society's Insistence. Annual Review of Law and Social Science 8:367–96.CrossRefGoogle Scholar
VanderWeele, Tyler J. 2013. A Three-Way Decomposition of a Total Effect into Direct, Indirect, and Interactive Effects. Epidemiology 24 (2):224–32.CrossRefGoogle ScholarPubMed
VanderWeele, Tyler J. 2014. A Unification of Mediation and Interaction: A Four-Way Decomposition. Epidemiology 25 (5):749–61.CrossRefGoogle Scholar
VanderWeele, Tyler J., and Vansteelandt, Stijn. 2009. Conceptual Issues Concerning Mediation, Interventions and Composition. Statistics and Its Interface 2 (4):457–68.CrossRefGoogle Scholar
Vinjamuri, Leslie. 2017. Human Rights Backlash. In Human Rights Futures, edited by Hopgood, Stephen, Snyder, Jack, and Vinjamuri, Leslie, 114–34. Cambridge University Press.CrossRefGoogle Scholar
Vreeland, James Raymond. 2008. Political Institutions and Human Rights: Why Dictatorships Enter into the United Nations Convention Against Torture. International Organization 62 (1):65101.CrossRefGoogle Scholar
Wald, Abraham. 1940. The Fitting of Straight Lines If Both Variables Are Subject to Error. The Annals of Mathematical Statistics 11 (3):284300.CrossRefGoogle Scholar
Weiss, Thomas, Cortright, David, Lopez, George, and Minear, Larry. 1997. Political Gain and Civilian Pain: Humanitarian Impacts of Economic Sanctions. Rowman and Littlefield.Google Scholar
Wood, Reed M. 2008. “A Hand Upon the Throat of the Nation”: Economic Sanctions and State Repression, 1976–2001. International Studies Quarterly 52 (3):489513.CrossRefGoogle Scholar
Zhao, Xinshu, Lynch, John G. Jr, and Chen, Qimei. 2010. Reconsidering Baron and Kenny: Myths and Truths About Mediation Analysis. Journal of Consumer Research 37 (2):197206.CrossRefGoogle Scholar
Supplementary material: Link

Strezhnev et al. Dataset

Supplementary material: PDF

Strezhnev et al. supplementary material


Download Strezhnev et al. supplementary material(PDF)
PDF 239.9 KB