Skip to main content
    • Aa
    • Aa

The Constraining Power of International Treaties: Theory and Methods


We acknowledge the contribution of von Stein (2005) in calling attention to the very real problem of selection bias in estimating treaty effects. Nonetheless, we dispute both von Stein's theoretical and empirical conclusions. Theoretically, we contend that treaties can both screen and constrain simultaneously, meaning that findings of screening do nothing to undermine the claim that treaties constrain state behavior as well. Empirically, we question von Stein's estimator on several grounds, including its strong distributional assumptions and its statistical inconsistency. We then illustrate that selection bias does not account for much of the difference between Simmons's (2000) and von Stein's (2005) estimated treaty effects, and instead reframe the problem as one of model dependency. Using a preprocessing matching step to reduce that dependency, we then illustrate treaty effects that are both substantively and statistically significant—and that are quite close in magnitude to those reported by Simmons.

Corresponding author
Beth A. Simmons is Professor, Department of Government, Harvard University, 1033 Massachusetts Avenue, Cambridge, MA 02139 (
Daniel J. Hopkins is a Ph.D. student, Department of Government, Harvard University, Littauer Center, North Yard, Cambridge, MA 02138 (
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

AbadieAlberto. 2002. “Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models.” Journal of the American Statistical Association 97: 28492.

AlbertA., and J. A.Anderson. 1984. “On the Existence of Maximum Likelihood Estimates in Logistic Regression Models.” Biometrick 71 (1): 110.

BeckN., J. N.Katz, and R.Tucker. 1998. Taking Time Seriously: Time-Series-Cross-Section Analysis with a Binary Dependent Variable. American Journal of Political Science 42 (4): 126088.

BerinskyAdam J. 1999. “The Two Faces of Public Opinion.” American Journal of Political Science 43 (4): 120930.

ChristmannAndreas, and Peter J.Rousseeuw. 2001. “Measuring Overlap in Logistic Regression.” Computational Statistics and Data Analysis 37: 6575.

DownsGeorge W., David M.Rocke, and Peter N.Barsoom. 1996. “Is the good new about compliance good news about cooperation?International Organization 50 (3): 379406.

HardingDavid J. 2003. “Counterfactual Models of Neighborhood Effects: The Effect of Neighborhood Poverty on Dropping Out and Teenage Pregnancy.” American Journal of Sociology 109 (3): 676719.

HeckmanJames J. 1979. “Sample Selection Bias as a Specification Error.” Econometrica 47 (1): 15361.

HeckmanJames J., HidehikoIchimura, JeffreySmith, and PetraTodd. 1998. “Characterizing Selection Bias Using Experimental Data.” Econometrica 66 (5): 101798.

ImaiKosuke. 2005. Do Get-Out-The-Vote Calls Reduce Turnout?: The Importance of Statistical Methods for Field Experiments. American Political Science Review 99 (2): 283300.

ImbensGuido. 2004. “Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review.” Review of Economics and Statistics 86 (1): 430.

KingGary, MichaelTomz, and JasonWittenberg. 2000. “Making the Most of Statistical Analyses: Improving Interpretation and Presentation.” American Journal of Political Science 44 (2): 4155.

LeeLung-fei. 1984. “Tests for the Bivariate Normal Distribution in Econometric Models with Selectivity.” Econometrica 52 (4): 84363.

LemkeDouglas, and WilliamReed. 2001. “War and Rivalry Among Great Powers.” American Journal of Political Science 45 (2): 45769.

LiaoTim Futing. 1995. “The Nonrandom Selection of Don't Knows in Binary and Ordinal Responses: Corrections with the Bivariate Probit Model with Sample Selection.” Quality and Quantity 29: 87110.

ReedWilliam. 2000. “A Unified Statistical Model of Conflict Onset and Escalation.” American Journal of Political Science 44 (1): 8493.

RosenbaumPaul E., and Donald B.Rubin. 1984. “Reducing Bias in Observational Studies Using Subclassification on the Propensity Score.” Journal of the American Statistical Association 79 (387): 51624.

RosenbaumPaul R. 2002. Observational Studies. 2nd ed. New York, NY: Springer Verlag.

SignorinoCurt. 2003. “Structure and Uncertainty in Discrete Choice Models.” Political Analysis 11 (4): 31644.

SimmonsBeth A. 2000. “International Law and State Behavior: Commitment and Compliance in International Monetary Affairs. American Political Science Review 94 (4): 81935.

TimponeRichard J. 1998. “Structure, Behavior, and Voter Turnout in the United States.” American Political Science Review 92 (1): 14558.

VreelandJames Raymond. 2003. The IMF and Economic Development. New York: Cambridge University Press.

WinshipChristopher, and Robert D.Mare. 1992. “Models for Sample Selection Bias.” Annual Review of Sociology 18: 32750.

WinshipChristopher, and Stephen L.Morgan. 1999. “The Estimation of Causal Effects from Observational Data.” Annual Review of Sociology 25: 659707.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

American Political Science Review
  • ISSN: 0003-0554
  • EISSN: 1537-5943
  • URL: /core/journals/american-political-science-review
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Full text views

Total number of HTML views: 5
Total number of PDF views: 114 *
Loading metrics...

Abstract views

Total abstract views: 438 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 18th August 2017. This data will be updated every 24 hours.