Hostname: page-component-76fb5796d-25wd4 Total loading time: 0 Render date: 2024-04-26T22:11:00.065Z Has data issue: false hasContentIssue false
  • English
  • Français

Hazards and fallacies of social measurements: global indicators in the pandemic

Published online by Cambridge University Press:  10 June 2021

Marta Infantino
Marta Infantino*
Affiliation:
Associate Professor of Comparative Law, University of Trieste, Italy
*
*Corresponding author. E-mail: minfantino@units.it
Get access Rights & Permissions [Opens in a new window]

Abstract

Since the outbreak of the COVID-19 pandemic, efforts to quantitatively measure the global health situation and/or governments’ reaction vis-à-vis the pandemic have flourished. In spite of the significance of data in the fight against the pandemic, however, such global knowledge is largely questionable, insofar as it exposes itself to the many hazards and fallacies associated with global attempts to frame the social world in numbers. This is why the paper attempts to identify the hazards and fallacies most commonly associated with global measurements of social phenomena and to verify whether and to what extent these hazards and fallacies affect numerical representations of the pandemic and its effects. To this end, the paper analyses ten English-language global numerical initiatives that were launched between January and May 2020, and reviews them in light of existing critical literature on global numbers. The aim is to provide a deeper understanding of global measurements of health and related law-and-policy measures, and to suggest caution about their use as a basis for knowledge and action in the context of the pandemic.

Keywords

global law-and-policy indicatorsglobal health indicatorsCOVID-19global measurementsnudging
Type
Article
Information
International Journal of Law in Context , Volume 17 , Special Issue 2: Numbers in an emergency: The many roles of indicators in the COVID-19 crisis , June 2021 , pp. 168 - 185
Copyright
Copyright © The Author(s) 2021. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Best, J (2017) The rise of measurement-driven governance: the case of international development. Global Governance 23, 163–181.CrossRefGoogle Scholar
Bhuta, N, Malito, DV and Umbach, G (2018) ‘Introduction: Of numbers and narratives: indicators in global governance and the rise of a reflexive indicator culture’. In Malito, DV, Umbach, G and Bhuta, N (eds), The Palgrave Handbook of Indicators in Global Governance. London: Palgrave, pp. 1–29.Google Scholar
Bonacini, L, Gallo, G and Scicchitano, S (2021) Working from home and income inequality: risks of a ‘new normal’ with COVID-19. Journal of Population Economics 34, 303–360.CrossRefGoogle Scholar
Broome, A and Quirk, J (2015) Governing the world at a distance: the practice of global benchmarking. Review of International Studies 41, 819–841.CrossRefGoogle Scholar
Broome, A, Homolar, A and Kranke, M (2018) Bad science: international organizations and the indirect power of global benchmarking. European Journal of International Relations 24, 514–539.CrossRefGoogle ScholarPubMed
Bruno, I, Jany-Catrice, F and Touchelay, B (eds) (2016) The Social Sciences of Quantification: From Politics of Large Numbers to Target-Driven Policies. Cham: Springer.CrossRefGoogle Scholar
Cassese, S and Casini, L (2012) Public regulation of global indicators. In Davis, KE et al. (eds), Governance by Indicators: Global Power through Quantification and Rankings. New York: OUP, pp. 465–474.CrossRefGoogle Scholar
Cheng, C et al. (2020) COVID-19 government response event dataset (CoronaNet v.1.0). Nature Human Behaviour 4, 756–768.CrossRefGoogle Scholar
Cooley, A (2015) The emerging politics of international rankings and ratings: a framework for analysis. In Cooley, A and Snyder, J (eds), Ranking the World: Grading States as a Tool of Global Governance. New York: CUP, pp. 1–38.CrossRefGoogle Scholar
Davis, KE, Kingsbury, B and Merry, SE (2012) Introduction: Global governance by indicators. In Davis, KE et al. (eds), Governance by Indicators: Global Power through Quantification and Rankings. New York: OUP, pp. 3–28.CrossRefGoogle Scholar
Desrosières, A (2000) La politique des grands nombres: Histoire de la raison statistique, 2nd edn. Paris: La Découverte.Google Scholar
DKG (2020) Analytical Framework and Methodology. Available at http://analytics.dkv.global/covid-regional-assessment-250-regions/COVID-Regional-Safety-Methodology.pdf (accessed 1 February 2021).Google Scholar
Dong, E, Du, H and Gardner, L (2020) An interactive web-based dashboard to track COVID-19 in real time. Lancet Infectious Disease 20, 533–534.CrossRefGoogle ScholarPubMed
Esmark, A (2020) The New Technocracy. Bristol: Bristol University Press.Google Scholar
Espeland, W and Sauder, (2007) Rankings and reactivity: how public measures recreate social worlds. American Journal of Sociology 113, 1–40.CrossRefGoogle Scholar
European Parliament (Policy Department for External Relations Directorate General for External Policies of the Union) (2020) The Geopolitical Implications of the COVID-19 Pandemic. PE 603.511. Brussels: European Union.Google Scholar
Fioramonti, L (2014) The Politics of Numbers, and How Numbers Rule the World. New York: Zed Books.CrossRefGoogle Scholar
Fisher, F (1990) Technocracy and the Politics of Expertise. Newbury: Sage.Google Scholar
Gostin, LO, Moon, S and Meier, BM (2020) Reimagining global health governance in the age of COVID-19. American Journal of Public Health 110, 1615–1619. Available at https://ajph.aphapublications.org/doi/pdfplus/10.2105/AJPH.2020.305933 (accessed 1 February 2021).CrossRefGoogle ScholarPubMed
Gruzd, A and Mai, P (2020) Going viral: how a single tweet spawned a COVID-19 conspiracy theory on Twitter. Big Data & Society July–December, 1–9.CrossRefGoogle Scholar
Hale, T et al. (2020) Variation in government responses to Covid-19. Blavatnik School Working Paper BSG-WP-2020/032. Available at https://www.bsg.ox.ac.uk/sites/default/files/2020-10/BSG-WP-2020-032-v8.pdf (accessed 1 February 2021).Google Scholar
Hariri, YN ([2015] 2017) Homo Deus: A Brief History of Tomorrow. London: Vintage.CrossRefGoogle Scholar
IHME COVID-19 Health Service Utilization Forecasting Team (under the direction of Christopher JL Murray) (2020) Forecasting the impact of the first wave of the COVID-19 pandemic on hospital demand and deaths for the USA and European Economic Area countries. Preprint available at https://doi.org/10.1101/2020.04.21.20074732 (accessed 1 February 2021).CrossRefGoogle Scholar
Infantino, M (2017) Global indicators. In Cassese, S (ed.), Research Handbook on Global Administrative Law. Cheltenham: EE, pp. 347–367.Google Scholar
Infantino, M (2019) Numera et impera: Il diritto comparato e gli indicatori giuridici globali. Milan: FrancoAngeli.Google Scholar
Ioannidis, JP (2020) Coronavirus disease 2019: the harms of exaggerated information and non-evidence-based measures. European Journal of Clinical Investigation 50, 1–5.CrossRefGoogle ScholarPubMed
Jerven, M (2013) Poor Numbers: How We Are Misled by African Development Statistics and What to Do About It. Ithaca: Cornell University Press.Google Scholar
Kelley, JG (2017) Scorecard Diplomacy: Grading States to Influence their Reputation and Behavior. New York: CUP.CrossRefGoogle Scholar
Kelley, JG and Simmons, BA (eds) (2020) The Power of Global Performance Indicators. New York: CUP.CrossRefGoogle Scholar
Kennedy, D (2016) A World of Struggle: How Power, Law, and Expertise Shape Global Political Economy. Princeton: Princeton University Press.CrossRefGoogle Scholar
Ladeur, K-H (ed.) (2004) Public Governance in the Age of Globalization. New York: Routledge.Google Scholar
Linnet, T (2020) The price of certainty: How the politics of pandemic data demand an ethics of care. Big Data & Society July–December, 1–7. Available at https://doi.org/10.1177/2053951720942539 (accessed 27 April 2021).Google Scholar
Lumley, T (2020) Are we number two on COVID? Stats Chat. Available at https://www.statschat.org.nz/2020/09/07/are-we-number-two-on-covid/ (accessed 1 February 2021).Google Scholar
McLean, S et al. (2020) The Covid-19 pandemic has catapulted one mysterious data website to prominence, sowing confusion in international rankings (May 20, 2020). CN. Available at https://edition.cnn.com/interactive/2020/05/world/worldometer-coronavirus-mystery/ (accessed 1 February 2021).Google Scholar
Merry, SE (2015) The Seductions of Quantification: Measuring Human Rights, Gender Violence, and Sex Trafficking. Chicago: Chicago University Press.Google Scholar
Mooney, P and Juhàsz, L (2020) Mapping COVID-19: how web-based maps contribute to the infodemic. Dialogues in Human Geography 10, 265–270.CrossRefGoogle Scholar
Möslein, F (2018) Robots in the boardroom: artificial intelligence and corporate law. In Barfield, W and Pagallo, U (eds), Research Handbook on the Law of Artificial Intelligence. Cheltenham: EE, pp. 649–670.CrossRefGoogle Scholar
Nelken, D (2018) The legitimacy of global social indicators: reconfiguring authority, accountability and accuracy. Cahiers de Droit 59, 35–84.CrossRefGoogle Scholar
Porcher, S (2020a) A novel dataset of governments’ responses to COVID-19 all around the world. Preprint available at https://halshs.archives-ouvertes.fr/halshs-02567283/document (accessed 1 February 2021).CrossRefGoogle Scholar
Porcher, S (2020b) ‘Contagion’: the determinants of governments’ public health responses to COVID-19 all around the world. Preprint available at https://halshs.archives-ouvertes.fr/halshs-02567286 (accessed 1 February 2021).CrossRefGoogle Scholar
Porter, TM (1995) Trust in Numbers: The Pursuit of Objectivity in Science and Public Life. Princeton: Princeton University Press.Google Scholar
Restrepo, Amariles D (2015) Legal indicators, global law and legal pluralism: an introduction. Journal of Legal Pluralism & Unofficial Law 47, 9–21.CrossRefGoogle Scholar
Restrepo, Amariles D (2017) Supping with the Devil? Indicators and the rise of managerial rationality in law. International Journal of Law in Context 13, 465–484.Google Scholar
Restrepo Amariles, D and McLachlan, J (2018) Legal indicators in transnational law practice: a methodological assessment. Jurimetrics Journal 58, 163–209.Google Scholar
Rittich, K (2010) Governing by measuring: the millennium development goals in global governance. In Fabri H, Ruiz, Wolfrum, R and Gogolin, J (eds), Selected Proceedings of the European Society of International Law. Oxford/Portland: Hart, pp. 463–487.Google Scholar
Rovan, J (2011) Composite indicators. In Lovric, M (ed.), International Encyclopedia of Statistical Science. Berlin-Heidelberg: Springer.Google Scholar
Sætnan A, Rudinow, Lomell H, Mork and Hammer, S (eds) (2010) The Mutual Construction of Statistics and Society. London: Taylor & Francis.CrossRefGoogle Scholar
Shelton, T (2020) A post-truth pandemic? Big Data & Society July–December, 1–6.CrossRefGoogle Scholar
Siems, M and Nelken, D (2017) Global social indicators and the concept of legitimacy. International Journal of Law in Context 13, 436–449.CrossRefGoogle Scholar
Stephens, M (2020) A geospatial infodemic: mapping Twitter conspiracy theories of COVID-19. Dialogues in Human Geography 10, 276–281.CrossRefGoogle Scholar
Stiglitz, J (2020) Conquering the great divide. Finance & Development September, 17–19. Available at https://www.imf.org/external/pubs/ft/fandd/2020/09/pdf/COVID19-and-global-inequality-joseph-stiglitz.pdf (accessed 1 February 2021).Google Scholar
Strathern, M (1997) From improvement to enhancement: an anthropological comment on the audit culture. Cambridge Anthropology 19, 1–21.Google Scholar
Su, R and Shen, W (2021) Is nationalism rising in times of the COVID-19 pandemic? Individual-level evidence from the United States. Journal of Chinese Political Science 26, 169–187.CrossRefGoogle Scholar
Supiot, A (2017) Governance by Numbers: The Making of a Legal Model of Allegiance. Oxford: Hart.Google Scholar
Taylor, AL and Habibi, R (2020) The collapse of global cooperation under the WHO International Health Regulations at the outset of COVID-19: sculpting the future of global health governance. ASIL Insights 24. Available at https://www.asil.org/insights/volume/24/issue/15/collapse-global-cooperation-under-who-international-health-regulations (accessed 1 February 2021).Google Scholar
Taylor, L (2020) The price of certainty: how the politics of pandemic data demand an ethics of care. Big Data & Society July–December, 1–7.CrossRefGoogle Scholar
Taylor, L et al. (2020) Data Justice and COVID-19: Global Perspectives. London: Meatspace Press. Available at https://ia801905.us.archive.org/23/items/data-justice-and-covid-19/Data_Justice_and_COVID-19.pdf (accessed 1 February 2021).Google Scholar
Usher, N (2020) News cartography and epistemic authority in the era of big data: journalists as map-makers, map-users, and map-subjects. New Media & Society 22, 247–263.CrossRefGoogle Scholar
von Bogdandy, A and Goldmann, M (2012) Taming and framing indicators: a legal reconstruction of the OECD's Programme for International Student Assessment (PISA). In Davis, KE et al. (eds), Governance by Indicators: Global Power through Quantification and Rankings. New York: OUP, pp. 52–85.CrossRefGoogle Scholar
Woods, ET et al. (2020) COVID-19, nationalism, and the politics of crisis: a scholarly exchange. Nations and Nationalism 26, 807–825.CrossRefGoogle Scholar