Hostname: page-component-77f85d65b8-45ctf Total loading time: 0 Render date: 2026-04-13T15:17:30.676Z Has data issue: false hasContentIssue false

Objectivity of Measurement in Political Science

Published online by Cambridge University Press:  24 September 2025

Sharon Crasnow*
Affiliation:
Department of Philosophy, Norco College , Norco, CA, USA

Abstract

A recent dispute in political science raises issues about the objectivity of measures of democracy. Political scientists Little and Meng argue that democracy indices using country experts as coders show a greater degree of democratic backsliding than do measures that are objective. They worry that this discrepancy may reflect coder bias. I distinguish three aspects of objectivity and offer a reconceptualization of objectivity as coherence objectivity. I argue that coherence objectivity is better suited for evaluating measures of social science concepts like democracy than the understanding of objectivity implicit in Little and Meng’s discussion.

Information

Type
Contributed Paper
Copyright
© The Author(s), 2025. Published by Cambridge University Press on behalf of Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Alexandrova, Anna. 2017. A Philosophy for the Science of Well-Being. Oxford University Press. https://doi.org/10.1093/oso/9780199300518.001.0001.CrossRefGoogle Scholar
Bermeo, Nancy. 2016. “On Democratic Backsliding.” Journal of Democracy 27 (1):519. https://doi.org/10.1353/jod.2016.0012.CrossRefGoogle Scholar
Cartwright, Nancy, Bradburn, Norman M., and Fuller, Jonathan. 2017. “A Theory of Measurement.” In Measurement in Medicine: Philosophical Essays on Assessment and Evaluation, ed. McClimans, Leah, 7388. Rowman and Littlefield. https://doi.org/10.5040/9798881812669.ch-005.Google Scholar
Chang, Hasok. 2004. Inventing Temperature: Measurement and Scientific Progress. Oxford University Press. https://doi.org/10.1093/0195171276.001.0001.CrossRefGoogle Scholar
Chang, Hasok. 2022. Realism for Realistic People. Cambridge University Press. https://doi.org/10.1017/9781108635738.CrossRefGoogle Scholar
Coppedge, Michael, Gerring, John, Lindberg, Staffan I., Skaaning, Svend-Erik, and Teorell, Jan. 2017. Varieties of Democracy Project. Varieties of Democracy Project. https://v-dem.net/media/publications/v-dem_working_paper_2017_45.pdf.Google Scholar
Crasnow, Sharon. 2021. “Coherence Objectivity and Measurement: The Example of Democracy.” Synthese 199:1207–29. https://doi.org/10.1007/s11229-020-02779-w.CrossRefGoogle Scholar
Crasnow, Sharon, and Intemann, Kristen. 2024. Feminist Epistemology and Philosophy of Science: An Introduction. Routledge. https://doi.org/10.4324/9781032693781.CrossRefGoogle Scholar
Daston, Lorraine, and Galison, Peter. 1992. “The Image of Objectivity.” Representations 40:81128. https://doi.org/10.2307/2928741.CrossRefGoogle Scholar
Daston, Lorraine, and Galison, Peter. 2007. Objectvity. Zone Books.Google Scholar
Diamond, Lawrence. 2015. “Facing Up to the Democratic Recession.” Journal of Democracy 26 (1):141–55. https://doi.org/10.1353/jod.2015.0009.CrossRefGoogle Scholar
Douglas, Heather. 2004. “The Irreducible Complexity of Objectivity.” Synthese 138:453–73. https://doi.org/10.1023/B:SYNT.0000016451.18182.91.CrossRefGoogle Scholar
Haggard, Stephan, and Kaufman, Robert. 2021. Democratic Backsliding in the Contemporary World. Cambridge University Press. https://doi.org/10.1017/9781108957809.CrossRefGoogle Scholar
Janack, Marianne. 2002. “Dilemmas of Objectivity.” Social Epistemology 16 (3):267–81. https://doi.org/10.1080/0269172022000025624.CrossRefGoogle Scholar
Knutsen, Carl Henrik, Marquardt, Kyle L., Seim, Brigette, Coppedge, Michael, Edgell, Amanda B., Medzihorsky, Juraj, Pemstein, Daniel, Teorell, Jan, Gerring, John, and Lindberg, Staffan I.. 2024. “Conceptual and Measurement Issues in Assessing Democratic Backsliding.” PS: Political Science and Politics 57 (2):162–77. https://doi.org/10.1017/S104909652300077X.Google Scholar
Koskinen, Inkeri. 2020. “Defending a Risk Account of Scientific Objectivity.” British Journal of Philosophy of Science 71 (4):1187–207. https://doi.org/10.1093/bjps/axy053.CrossRefGoogle Scholar
Levitsky, Steven, and Ziblatt, Daniel. 2019. How Democracies Die. Crown.Google Scholar
Little, Andrew T., and Meng, Anne. 2024a. “Measuring Democratic Backsliding.” PS: Political Science and Politics 57 (2):149–61. https://doi.org/10.1017/S104909652300063X.Google Scholar
Little, Andrew T., and Meng, Anne. 2024b. “What We Do and Do Not Know About Democratic Backsliding.” PS: Political Science and Politics 57 (2):224–29. htttps://doi.org/10.1017/S1049096523001038.Google Scholar
Lloyd, Elisabeth.1995. “Objectivity and the Double-Standard for Feminist Epistemologies.” Synthese 104:351–81. https://doi.org/10.1007/BF01064505.CrossRefGoogle Scholar
Longino, Helen. 1990. Science as Social Knowledge: Values and Objectivity in Scientific Inquiry. Princeton University Press. https://doi.org/10.1515/9780691209753.CrossRefGoogle Scholar
Lührmann, Anna, and Lindberg, Staffan. 2019. “A Third Wave of Autocratization Is Here: What Is New About It?Democratization 26 (7):1095–113. https://doi.org/10.1080/13510347.2019.1582029.CrossRefGoogle Scholar
Montuschi, Eleanora. 2021. “Finding a Context for Objectivity.” Synthese 199:4061–76. https://doi.org/10.1007/s11229-020-02969-6.CrossRefGoogle Scholar