Hostname: page-component-77f85d65b8-6c7dr Total loading time: 0 Render date: 2026-04-17T01:51:06.077Z Has data issue: false hasContentIssue false
  • English
  • Français

Measuring Bias against Female Political Leadership

Published online by Cambridge University Press:  16 November 2018

Mark Setzler
Mark Setzler*
Affiliation:
High Point University
Get access Rights & Permissions [Opens in a new window]

Abstract

Much research examining gender bias in politics analyzes responses to explicit survey questions asking individuals whether they prefer male over female leaders or agree that male political leaders are superior. Drawing insights from the measurement of other types of prejudice, this article explores the methodological shortcomings of a widely used question of this type. Analyzing the results of two surveys—one national and one state-level—I compare response patterns to a standard, highly explicit question that is frequently administered by the Pew Research Center with those for a modestly altered item that employs multiple strategies to reduce social desirability bias. Compared with the alternative measure, the conventional item seriously underreports prejudice against women leaders. Moreover, the underreporting of bias is especially prevalent among individuals belonging to groups that are strong advocates of gender equality.

Keywords

Female leaderssurvey methodssocial desirability bias

Information

Type
Research Article
Information
Politics & Gender , Volume 15 , Issue 4 , December 2019 , pp. 695 - 721
Copyright
Copyright © The Women and Politics Research Section of the American Political Science Association 2018

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

The author gratefully acknowledges the many insights provided by Alixandra B. Yanus and Jeff Seward. Martin J. Kifer and High Point University's Survey Research Center provided critical support to the project by fielding survey questions on my behalf. Data and replication syntax will be provided upon request.

References

REFERENCES

Alexander, Amy C. 2012. “Change in Women's Descriptive Representation and the Belief in Women's Ability to Govern: A Virtuous Cycle.” Politics & Gender 8 (4): 437–64.CrossRefGoogle Scholar
Alexander, Amy C. 2015. “Big Jumps in Women's Presence in Parliaments: Are These Sufficient for Improving Beliefs in Women's Ability to Govern?” Advancing Women in Leadership 35: 82–97.Google Scholar
Alexander, Amy C., and Welzel, Christian. 2011. “Islam and Patriarchy: How Robust Is Muslim Support for Patriarchal Values?” International Review of Sociology 21 (2): 249–76.CrossRefGoogle Scholar
Bejarano, Christina E., Manzano, Sylvia, and Montoya, Celeste. 2011. “Tracking the Latino Gender Gap: Gender Attitudes across Sex, Borders, and Generations.” Politics & Gender 7 (4): 521–49.CrossRefGoogle Scholar
Ben-Nun Bloom, Pazit. 2016. “State-Level Restriction of Religious Freedom and Women's Rights: A Global Analysis.” Political Studies 64 (4): 832–53.CrossRefGoogle Scholar
Benson, Brett V., Merolla, Jennifer L., Geera, John G.. 2011. “Two Steps Forward, One Step Back? Bias in the 2008 Presidential Election.” Electoral Studies 30 (4): 607–20.CrossRefGoogle Scholar
Bernstein, Robert, Chadha, Anita, and Montjoy, Robert. 2001. “Overreporting Voting: Why It Happens and Why It Matters.” Public Opinion Quarterly 65 (1): 22–44.CrossRefGoogle ScholarPubMed
Brint, Steven, and Abrutyn, Seth. 2010. “Who's Right about the Right? Comparing Competing Explanations of the Link between White Evangelicals and Conservative Politics in the United States.” Journal for the Scientific Study of Religion 49 (2): 328–50.CrossRefGoogle Scholar
Burden, Barry C., Ono, Yoshikuni, and Yamada, Masahiro. 2017. “Reassessing Public Support for a Female President.” Journal of Politics 79 (3): 1073–78.CrossRefGoogle Scholar
Calfano, Brian R., and Djupe, Paul A.. 2011. “Not in His Image: The Moderating Effect of Gender on Religious Appeals.” Politics and Religion 4 (2): 338–54.CrossRefGoogle Scholar
Claassen, Ryan L. and Ryan, John Barry. 2016. “Social Desirability, Hidden Biases, and Support for Hillary Clinton.” PS: Political Science & Politics 49 (4): 730–35.Google Scholar
Coffé, Hilde, and Dilli, Selin. 2015. “The Gender Gap in Political Participation in Muslim-Majority Countries.” International Political Science Review 36 (5): 526–44.CrossRefGoogle Scholar
Cunningham, William A., Nezlek, John B., and Banaji, Mahzarin R.. 2004. “Implicit and Explicit Ethnocentrism: Revisiting the Ideologies of Prejudice.” Personality and Social Psychology Bulletin 30 (10): 1332–46.CrossRefGoogle ScholarPubMed
Deckman, Melissa. 2010. “Women as Leaders in Protestant Denominations.” In Gender and Women's Leadership: A Reference Handbook, ed. O'Connor, Karen. Thousand Oaks, CA: Sage, 544–54.CrossRefGoogle Scholar
Dolan, Kathleen. 2010. “The Impact of Gender Stereotyped Evaluations on Support for Women Candidates.” Political Behavior 32 (1): 69–88.CrossRefGoogle Scholar
Dolan, Kathleen. 2014. When Does Gender Matter? Women Candidates and Gender Stereotypes in American Elections. New York: Oxford University Press.CrossRefGoogle Scholar
Espírito-Santo, Ana. 2016. “Citizens’ Attitudes towards Descriptive Representation: The Case of Women in Portugal.” European Journal of Women's Studies 23 (1): 43–59.CrossRefGoogle Scholar
Gilens, Martin, Sniderman, Paul M., and Kuklinski, James H.. 1998. “Affirmative Action and the Politics of Realignment.” British Journal of Political Science 28 (1): 159–83.CrossRefGoogle Scholar
Hadaway, C. Kirk, Marler, Penny Long, and Chaves, Mark. 1993. “What the Polls Don't Show: A Closer Look at U.S. Church Attendance.” American Sociological Review 58 (6): 741–52.CrossRefGoogle Scholar
Harkness, Janet A., van de Vijver, Fons J. R., and Mohler, Peter Ph., eds. 2002. Cross-Cultural Survey Methods. New York: Wiley.Google Scholar
Hayes, Danny. 2011. “When Gender and Party Collide: Stereotyping in Candidate Trait Attribution.” Politics & Gender 7 (2): 133–65.CrossRefGoogle Scholar
Hedlund, Ronald D., Freeman, Patricia K., Hamm, Keith E., and Stein, Robert E.. 1979. “The Electability of Women Candidates: The Effects of Sex Role Stereotypes.” Journal of Politics 41 (2): 513–24.CrossRefGoogle Scholar
Heerwig, Jennifer A., and McCabe, Brian J.. 2009. “Education and Social Desirability Bias: The Case of a Black Presidential Candidate.” Social Science Quarterly 90 (3): 674–86.CrossRefGoogle Scholar
Holman, Mirya, Merolla, Jennifer, and Zechmeister, Elizabeth. 2011. “Sex, Stereotypes, and Security: A Study of the Effects of Terrorist Threat on Assessments of Female Leadership.” Journal of Women, Politics & Policy 32 (3): 173–92.CrossRefGoogle Scholar
Inglehart, Ronald, and Baker, Wayne. 2000. “Modernization, Cultural Change, and the Persistence of Traditional Values.” American Sociological Review 65 (1): 19–51.CrossRefGoogle Scholar
Inglehart, Ronald, and Norris, Pippa. 2003. Rising Tide: Gender Equality and Cultural Change Around the World. New York: Cambridge University Press.CrossRefGoogle Scholar
Inglehart, Ronald, Norris, Pippa, and Welzel, Christian. 2002. “Gender Equality and Democracy.” Comparative Sociology 1 (3): 321–45.Google Scholar
Institute for Women's Policy Research. 2015. “Status of Women in the States.” http://statusofwomendata.org/explore-the-data/political-participation/political-participation-full-section/#ppwomeninelectedoffice (accessed June 1, 2018).Google Scholar
Jackman, Mary R. 1978. “General and Applied Tolerance: Does Education Increase Commitment to Racial Integration?” American Journal of Political Science 22 (2): 302–24.CrossRefGoogle Scholar
Janus, Alexander L. 2010. “The Influence of Social Desirability Pressures on Expressed Immigration Attitudes.” Social Science Quarterly 91 (4): 928–46.CrossRefGoogle Scholar
Kahn, Kim Fridkin. 1996. The Political Consequences of Being a Woman. New York: Columbia University Press.Google Scholar
Kane, Emily W., and Macaulay, Laura J.. 1993. “Interviewer Gender and Gender Attitudes.” Public Opinion Quarterly 57 (1): 1–28.CrossRefGoogle Scholar
Kawakami, Kerry, and Dovidio, John F.. 2001. “The Reliability of Implicit Stereotyping? Or Confronting Prejudice: Effects of Prejudice Labeling on Stereotype Activation.” Personality and Social Psychology Bulletin 27 (2): 212–25.CrossRefGoogle Scholar
Kenski, Kate, and Falk, Erika. 2004. “Of What Is That Glass Ceiling Made? A Study of Attitudes about Women and the Oval Office.” Women & Politics 26 (2): 57–80.CrossRefGoogle Scholar
Kenski, Kate, and Falk, Erika. 2006. “Sexism versus Partisanship: A New Look at the Question of Whether America Is Ready for a Woman President.” Sex Roles 54 (7–8): 413–28.Google Scholar
Kerevel, Yann P., and Atkeson, Lonna Rae. 2015. “Reducing Stereotypes of Female Political Leaders in Mexico.” Political Research Quarterly 68 (4): 732–44.CrossRefGoogle Scholar
Knoll, Benjamin R. 2013. “Assessing the Effect of Social Desirability on Nativism Attitude Responses.” Social Science Research 42 (6): 1587–98.CrossRefGoogle ScholarPubMed
Krosnick, Jon A., and Presser, Stanley. 2010. “Question and Questionnaire Design.” In Handbook of Survey Research, 2nd ed., eds. Marsden, Peter V. and Wrights, James D.. Bingley, UK: Emerald Group Publishing, 263–314.Google Scholar
Krupnikov, Yanna, Piston, Spencer, and Bauer, Nichole M.. 2016. “Saving Face: Identifying Voter Responses to Black Candidates and Female Candidates.” Political Psychology 37 (2): 253–73.CrossRefGoogle Scholar
Kunovich, Sheri, and Paxton, Pamela. 2005. “Pathways to Power: The Role of Political Parties in Women's National Political Representation.” American Journal of Sociology 111 (2): 505–52.CrossRefGoogle Scholar
Lawless, Jennifer L. 2004. “Women, War, and Winning Elections: Gender Stereotyping in the Post–September 11th Era.” Political Research Quarterly 57 (3): 479–90.CrossRefGoogle Scholar
Mo, Cecilia Hyunjung. 2015. “The Consequences of Explicit and Implicit Gender Attitudes and Candidate Quality in the Calculations of Voters.” Political Behavior 37 (2): 357–95.CrossRefGoogle Scholar
Morgan, Jana, and Buice, Melissa. 2013. “Latin American Attitudes towards Women in Politics: The Influence of Elite Cues, Female Advancement, and Individual Characteristics.” American Political Science Review 107 (4): 644–52.CrossRefGoogle Scholar
Paxton, Pamela, and Hughes, Melanie M.. 2014. Women, Politics, and Power: A Global Perspective. 2nd ed. Thousand Oaks, CA: Sage.Google Scholar
Paxton, Pamela, and Kunovich, Sheri. 2003. “Women's Political Representation: The Importance of Ideology.” Social Forces 82 (1): 87–114.CrossRefGoogle Scholar
Pew Forum on Religion and Public Life. 2008. “U.S. Religious Landscape Survey.” http://www.pewforum.org/files/2013/05/report-religious-landscape-study-full.pdf (accessed August 27, 2018).Google Scholar
Pew Research Center. 2008. “A Paradox in Public Attitudes: Men or Women: Who's the Better Leader?” August 25. http://www.pewsocialtrends.org/2008/08/25/men-or-women-whos-the-better-leader/ (accessed August 27, 2018).Google Scholar
Pew Research Center. 2015. “Women and Leadership: Public Says Women are Equally Qualified, but Barriers Persist.” January 15. http://www.pewsocialtrends.org/2015/01/14/women-and-leadership/ (accessed August 27, 2018).Google Scholar
Powell, Richard J. 2013. “Social Desirability Bias in Polling on Same-Sex Marriage Ballot Measures.” American Politics Research 41 (1): 1052–70.CrossRefGoogle Scholar
Rizzo, Helen, Abdel-Latif, Abdel-Hamid, and Meyer, Katherine. 2007. “The Relationship between Gender Equality and Democracy: A Comparison of Arab versus Non-Arab Muslim Societies.” Sociology 41 (6): 1151–70.CrossRefGoogle Scholar
Rosenthal, Cindy Simon. 1995. “The Role of Gender in Descriptive Representation.” Political Research Quarterly 48 (3): 599–611.CrossRefGoogle Scholar
Sanbonmatsu, Kira. 2002. “Gender Stereotypes and Vote Choice.” American Journal of Political Science 46 (1): 20–34.CrossRefGoogle Scholar
Sanbonmatsu, Kira, and Dolan, Kathleen. 2009. “Do Gender Stereotypes Transcend Party?” Political Research Quarterly 62 (3): 485–94.CrossRefGoogle Scholar
Schaffner, Brian F. 2011. “Racial Salience and the Obama Vote.” Political Psychology 32 (6): 963–88.CrossRefGoogle Scholar
Sears, David O., Sidanius, James, and Bobo, Lawrence D., eds. 2000. Racialized Politics: Values, Ideology, and Prejudice in American Public Opinion. Chicago: University of Chicago Press.Google Scholar
Seguino, Stephanie. 2011. “Help or Hindrance? Religion's Impact on Gender Inequality in Attitudes and Outcomes.” World Development 39 (8): 1308–29.CrossRefGoogle Scholar
Setzler, Mark. 2015. “Does Religion Bias Individuals against Female Political Leadership in Latin America?” The Latin Americanist 59 (4): 47–72.CrossRefGoogle Scholar
Setzler, Mark, and Yanus, Alixandra B.. 2015. “The Impact of Religion on Voting For Female Congressional Candidates.” Politics and Religion 8 (4): 679–98.CrossRefGoogle Scholar
Setzler, Mark, and Yanus, Alixandra B.. 2016. “Evangelical Protestantism and Bias against Female Political Leaders.” Social Science Quarterly 97 (2): 1–19.Google Scholar
Streb, Matthew J., Burrell, Barbara, Frederick, Brian, and Genovese, Michael A.. 2008. “Social Desirability Effects and Support for a Female American President.” Public Opinion Quarterly 72 (1): 76–89.CrossRefGoogle Scholar
Tripp, Aili Marie, and Kang, Alice. 2008. “The Global Impact of Quotas: On the Fast Track to Increased Female Legislative Representation.” Comparative Political Studies 41 (3): 338–61.CrossRefGoogle Scholar
Valdini, Melody Ellis. 2013. “Electoral Institutions and the Manifestation of Bias: The Effect of the Personal Vote on the Representation of Women.” Politics & Gender 9 (1): 76–92.CrossRefGoogle Scholar
Supplementary material: File

Setzler supplementary material

Table A1

Download Setzler supplementary material(File)
File 15 KB