Skip to main content Accessibility help

The Millennium Development Goals and Education: Accountability and Substitution in Global Assessment

  • James H. Bisbee, James R. Hollyer, B. Peter Rosendorff and James Raymond Vreeland


Precise international metrics and assessments may induce governments to alter policies in pursuit of more favorable assessments according to these metrics. In this paper, we explore a secondary effect of global performance indicators (GPIs). Insofar as governments have finite resources and make trade-offs in public goods investments, a GPI that precisely targets the provision of a particular public good may cause governments to substitute away from the provision of other, related, public goods. We argue that both the main effect of the GPI (on the measured public good) and this substitution effect vary systematically based on the domestic political institutions and informational environments of targeted states. Specifically, we contend that both the main and substitution effects of GPIs should be largest for governments that are least accountable (opaque and nondemocratic) and should be smallest for those that are most accountable. We illustrate the logic of these arguments using a formal model and test these claims using data on primary and secondary enrollment rates across 114 countries. We find that countries substitute toward primary education enrollment rates (which is targeted by the Millennium Development Goals) and away from secondary (which is not), and that these effects are mitigated as accountability rises.



Hide All
Adserà, Alícia, Boix, Carles, and Payne, Mark. 2003. Are You Being Served? Political Accountability and Quality of Government. Journal of Law, Economics and Organization 19 (2):445–90.
Baron, Reuben M., and Kenny, David A.. 1986. The Moderator–Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations. Journal of Personality and Social Psychology 51 (6):1173–82.
Beck, Nathaniel, and Katz, Jonathan N.. 2011. Modeling Dynamics in Time-Series-Cross-Section Political Economy Data. Annual Review of Political Science 14:331–52.
Berliner, Daniel. 2014. The Political Origins of Transparency. Journal of Politics 76 (2):479–91.
Berliner, Daniel, and Erlich, Aaron. 2015. Competing for Transparency: Political Competition and Institutional Reform in Mexican States. American Political Science Review 109 (1):110–28.
Besley, Timothy, and Burgess, Robin. 2002. The Political Economy of Government Responsiveness: Theory and Evidence from India. Quarterly Journal of Economics 117 (4):1415–51.
Bremmer, Ian. 2006. The J Curve: A New Way to Understand Why Nations Rise and Fall. Simon and Schuster.
Broz, J. Lawrence. 2002. Political System Transparency and Monetary Commitment Regimes. International Organization 56 (4):861–87.
Brunetti, Aymo, and Weder, Beatrice. 2003. A Free Press Is Bad News for Corruption. Journal of Public Economics 87:1801–24.
Bueno de Mesquita, Bruce, Smith, Alastair, Siverson, Randolph M., and Morrow, James D.. 2003. The Logic of Political Survival. MIT Press.
Bueno de Mesquita, Ethan. 2007. Politics and the Suboptimal Provision of Counterterror. International Organization 61:936.
Cameron, William Bruce. 1963. Informal Sociology: A Casual Introduction to Sociological Thinking, vol. 21. Random House.
Campbell, Donald T. 1979. Assessing the Impact of Planned Social Change. Evaluation and Program Planning 2 (1):6790.
Cheibub, José Antonio, Gandhi, Jennifer, and Vreeland, James Raymond. 2010. Democracy and Dictatorship Revisited. Public Choice 143 (1–2):67101.
Chong, Alberto, De La O, Ana L., Karlan, Dean, and Wantchekon, Leonard. 2010. Information Dissemination and Local Governments’ Electoral Returns: Evidence from a Field Experiment in Mexico. Paper presented at the Annual Meeting of the American Political Science Association, Seattle, March.
Copelovitch, Mark, Gandrud, Christopher, and Hallerberg, Mark. 2015. Financial Regulatory Transparency, International Institutions, and Borrowing Costs. Prepared for the 2015 Annual Political Economy of International Organizations Conference, February.
Di Tella, Rafael, and Schargrodsky, Ernesto. 2003. The Role of Wages and Auditing During a Crackdown on Corruption in the City of Buenos Aires. Journal of Law, Economics and Organization 46 (1):269–92.
Djankov, Simeon, McLiesh, Caralee, Nenova, Tatiana, and Shleifer, Andrei. 2003. Who Owns the Media? Journal of Law and Economics 46 (2):341–81.
Edwards, Marc A., and Roy, Siddhartha. 2017. Academic Research in the Twenty-First Century: Maintaining Scientific Integrity in a Climate of Perverse Incentives and Hypercompetition. Environmental Engineering Science 34 (1):5161.
Evans, Alice. 2018. Amplifying Accountability by Benchmarking Results at District and National Levels. Development Policy Review 36 (2):221–40.
Ferraz, Claudio, and Finan, Frederico. 2008. Exposing Corrupt Politicians: The Effects of Brazil's Publically Released Audits on Electoral Outcomes. Quarterly Journal of Economics 123 (2):703–45.
Fuller, Sarah C., and Ladd, Helen F.. 2013. School-Based Accountability and the Distribution of Teacher Quality Across Grades in Elementary School. Education 8 (4):528–59.
Glaeser, Edward L., and Goldin, Claudia, eds. 2006. Corruption and Reform: Lessons from America's Economic History. University of Chicago Press.
Grant, Taylor, and Lebo, Matthew J.. 2016. Error Correction Methods with Political Time Series. Political Analysis 24 (1):330.
Grief, Avner. 2006. Institutions and the Path to the Modern Economy: Lessons from Medieval Trade. Cambridge University Press.
Habyarimana, James, Humphreys, Macartan, Posner, Daniel N., and Weinstein, Jeremy M.. 2009. Coethnicity: Diversity and the Dilemmas of Collective Action. Russell Sage Foundation.
Harding, Robin, and Stasavage, David. 2014. What Democracy Does (and Doesn't Do) for Basic Services: School Fees, School Inputs, and African Elections. Journal of Politics 76 (1):229–45.
Heckman, James J., Stixrud, Jora, and Urzua, Sergio. 2006. The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior. Journal of Labor Economics 24 (3):411–82.
Heston, Alan, Summers, Robert, and Aten, Bettina. 2009. Penn World Table Version 6.3. Technical Report, Center of International Comparisons at the University of Pennsylvania.
Hollyer, James R., Rosendorff, B. Peter, and Vreeland, James Raymond. 2011. Democracy and Transparency. Journal of Politics 73 (4):115.
Hollyer, James R., Rosendorff, B. Peter, and Vreeland, James Raymond. 2014. Measuring Transparency. Political Analysis 22 (4):413–34.
Hollyer, James R., Rosendorff, B. Peter, and Vreeland, James Raymond. 2015. Transparency, Protest and Autocratic Instability. American Political Science Review 109 (4):764–84.
Holmstrom, Bengt, and Milgrom, Paul. 1991. Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design. Journal of Law, Economics and Organization 7:2452.
Honaker, James, King, Gary, and Blackwell, Matthew. 2011. Amelia II: A Program for Missing Data. Journal of Statistical Software 45 (7):147.
Honig, Dan, and Weaver, Catherine. 2019. A Race to the Top? The Aid Transparency Index and the Normative Power of Global Performance Assessments. International Organization 73 (3). <>
Hulme, David. 2009. The Millennium Development Goals (MDGs): A Short History of the World's Biggest Promise. Brooks World Poverty Institute Working Paper 100.
Imai, Kosuke, Keele, Luke, and Yamamoto, Teppei. 2010. Identification, Inference and Sensitivity Analysis for Causal Mediation Effects. Statistical Science 25 (1):5171.
Islam, Roumeen. 2006. Does More Transparency Go Along with Better Governance? Economics and Politics 18 (2):121–67.
Johns, Leslie. 2012. Courts as Coordinators: Endogenous Enforcement and Jurisdiction in International Adjudication. Journal of Conflict Resolution 56 (2):257–89.
Kapuściński, Ryszard. 1989. The Emperor: Downfall of an Autocrat. Vintage.
Kelley, Judith G., and Simmons, Beth A.. 2015. Politics by Number: Indicators as Social Pressure in International Relations. American Journal of Political Science 59 (1):5570.
Kelley, Judith G., and Simmons, Beth A.. 2019. Global Assessment Power in the Twenty-First Century. International Organization 73 (3).
Kelley, Judith G., Simmons, Beth A., and Doshi, Rush. 2019. The Power of Ranking: The Ease of Doing Business Indicator as a Form of Social Pressure. International Organization 73 (3). <>
Kijima, Rie, and Lipscy, Phillip Y.. 2016. The Politics of International Testing. Working paper presented at the Assessment Power in World Politics Workshop, Harvard University, May.
Kosack, Stephen, and Fung, Archon. 2014. Does Transparency Improve Governance? Annual Review of Political Science 17:6587.
Le, Ahn, and Malesky, Edmund. 2016. Do Subnational Assessments (SPAs) Lead to Improved Governance? Evidence from a Field Experiment in Vietnam. Working paper presented at the Assessment Power in World Politics Workshop, Harvard University, May.
Lebovic, James H., and Voeten, Erik. 2009. The Cost of Shame: International Organizations and Foreign Aid in the Punishing of Human Rights Violations. Journal of Peace Research 46 (1):7997.
Macartney, Hugh. 2016. The Dynamic Effects of Educational Accountability. Journal of Labor Economics 34 (1):128.
Mani, Anandi, and Mukand, Sharun. 2007. Democracy, Visibility and Public Good Provision. Journal of Development Economics 83 (2):506–29.
Milgrom, Paul R., and North, Douglass C.. 1990. The Role of Institutions in the Revival of Trade: The Law Merchant, Private Judges, and the Champaign Fairs. Economics and Politics 2 (1):123.
Morse, Julia C. 2019. Blacklists, Market Enforcement, and the Global Regime to Combat Terrorist Financing. International Organization 73 (3). <>
Peters, John G., and Welch, Susan. 1980. The Effects of Charges of Corruption on Voting Behavior in Congressional Elections. American Political Science Review 74 (3):697708.
Reinikka, Ritva, and Svensson, Jakob. 2003. The Power of Information: Evidence from a Newspaper Campaign to Reduce Capture. Working Paper: Institute for International Economic Studies, Stockholm University.
Risse, Thomas, and Sikkink, Kathryn. 1999. The Socialization of International Human Rights Norms into Domestic Practices. In The Power of Human Rights: International Norms and Domestic Change, 138. Cambridge University Press.
Skagerlind, Helena Hede. 2016. Assessment Power in Global Development Policy: The Millennium Development Goals. Working paper presented at the Assessment Power in World Politics Workshop, Harvard University, May.
Stasavage, David. 2005. Democracy and Education Spending in Africa. American Journal of Political Science 49 (2):343–58.

Related content

Powered by UNSILO
Type Description Title
Supplementary materials

Bisbee et al. supplementary material
Bisbee et al. supplementary material 1

 Unknown (37.6 MB)
37.6 MB
Supplementary materials

Bisbee et al. supplementary material
Bisbee et al. supplementary material 2

 PDF (684 KB)
684 KB

The Millennium Development Goals and Education: Accountability and Substitution in Global Assessment

  • James H. Bisbee, James R. Hollyer, B. Peter Rosendorff and James Raymond Vreeland


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.