Hostname: page-component-848d4c4894-tn8tq Total loading time: 0 Render date: 2024-06-13T11:43:05.008Z Has data issue: false hasContentIssue false

Gender Identification and Survey Weighting: A Shifting Landscape

Published online by Cambridge University Press:  07 October 2022

Brian R. Urlacher*
Affiliation:
University of North Dakota, USA

Abstract

In October 2021, the US Census Bureau piloted a new set of questions to operationalize sex and gender identity. This move follows a larger trend across the social sciences to rethink how surveys ask about sex and gender. Although this step is normatively positive, it complicates well-established protocols for weighting survey data. This article explores the likely pitfalls for survey researchers that accompany a shift in how the US Census Bureau measures gender. A preliminary empirical investigation of survey weighting indicates that using more inclusive gender categories will not negatively affect weighting metrics. Whereas the creation of a new set of US or even global best practices in measuring gender may be helpful to survey researchers, at this stage, there remain important empirical and ethical questions that are not well understood.

Type
Article
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of the American Political Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

American National Election Studies. 2021. “ANES 2020 Time Series Study Full Release.”https://electionstudies.org/data-center/2020-time-series-study.Google Scholar
Ansara, Y. Gavriel, and Hegarty, Peter. 2014. “Methodologies of Misgendering: Recommendations for Reducing Cisgenderism in Psychological Research.” Feminism & Psychology 24 (2): 259–70.CrossRefGoogle Scholar
Battaglia, Michael P., Frankel, Martin R., and Link, Michael W.. 2008. “Improving Standard Poststratification Techniques for Random-Digit-Dialing Telephone Surveys.” Survey Research Methods 2 (1): 1119.Google Scholar
Battaglia, Michael P., Hoaglin, David C., and Frankel, Martin R.. 2009. “Practical Considerations in Raking Survey Data.” Survey Practice 2 (5). DOI:10.29115/SP-2009-0019.Google Scholar
Bauer, Greta R., Braimoh, Jessica, Scheim, Ayden I., and Dharma, Christoffer. 2017. “Transgender-Inclusive Measures of Sex/Gender for Population Surveys: Mixed-Methods Evaluation and Recommendations.” PLoS ONE 12 (5): 128.Google Scholar
Crissman, Halley P., Berger, Mitchell B., Graham, Louis F., and Dalton, Vanessa K.. 2017. “Transgender Demographics: A Household Probability Sample of US Adults, 2014.” American Journal of Public Health 107 (2): 213–15.CrossRefGoogle Scholar
Davern, Michael, Bautista, Rene, Freese, Jeremy, Morgan, Stephen L., and Smith, Tom W.. 2021. “General Social Survey 2021 Cross-Section.” Chicago: National Opinion Research Center.Google Scholar
Fernandes, Praveen. 2017. “The Census Won’t Collect LGBT Data. That’s a Problem.” New York Times, May 10. www.nytimes.com/2017/05/10/opinion/the-census-wont-collect-lgbt-data-thats-a-problem.html.Google Scholar
File, Thom, and Lee, Jason-Harold. 2021. “Phase 3.2 of Census Bureau Survey Questions Now Include SOGI, Child Tax Credit, COVID Vaccination of Children.” Washington, DC: US Census Bureau. www.census.gov/library/stories/2021/08/household-pulse-survey-updates-sex-question-now-asks-sexual-orientation-and-gender-identity.html.Google Scholar
Fraser, Gloria. 2018. “Evaluating Inclusive Gender Identity Measures for Use in Quantitative Psychological Research.” Psychology & Sexuality 9 (4): 343–57.CrossRefGoogle Scholar
Keeter, Scott. 2019. “Growing and Improving Pew Research Center’s American Trends Panel.” Washington, DC: Pew Research Center. www.pewresearch.org/methods/2019/02/27/growing-and-improving-pew-research-centers-american-trends-panel.Google Scholar
Kennedy, Lauren, Khanna, Katharine, Simpson, Daniel, and Gelman, Andrew. 2022. “He, She, They: Using Sex and Gender in Survey Adjustment.” New York: Columbia University. Unpublished manuscript, last modified March 24.Google Scholar
King, Ashley. 2020. “Taylor Swift Blasts US Census for Not Counting Transgender, Non-Binary People.” Digital Music News, June 28. www.digitalmusicnews.com/2020/06/28/taylor-swift-blasts-us-census-transgender-nonbinary.Google Scholar
Kish, Leslie. 1965. Survey Sampling. New York: John Wiley & Sons.Google Scholar
Magliozzi, Devon, Saperstein, Aliya, and Westbrook, Laurel. 2016. “Scaling Up: Representing Gender Diversity in Survey Research.” Socius 2:111.CrossRefGoogle Scholar
McDermott, Rose, and Hatemi, Peter K.. 2011. “Distinguishing Sex and Gender.” PS: Political Science & Politics 44 (1): 8992.Google Scholar
Medeiros, Mike, Forest, Benjamin, and Öhberg, Patrik. 2020. “The Case for Non-Binary Gender Questions in Surveys.” PS: Political Science & Politics 53 (1): 128–35.Google Scholar
Pasek, Josh. 2011. “ANES Raking Implementation.” Comprehensive R Archive Network. http://cran.r-project.org.Google Scholar
Puckett, Jae A., Brown, Nina C., Dunn, Terra, Mustanski, Brian, and Newcomb, Michael E.. 2020. “Perspectives from Transgender and Gender Diverse People on How to Ask About Gender.” LGBT Health 7 (6): 305–11.CrossRefGoogle Scholar
Raymond, Henry F., Wilson, Erin C., and McFarland, Willi. 2017. “Transwoman Population Size.” American Journal of Public Health 107 (9): e12.CrossRefGoogle Scholar
Tate, Charlotte C., Ledbetter, Jay N., and Youssef, Cris P.. 2013. “A Two-Question Method for Assessing Gender Categories in the Social and Medical Sciences.” Journal of Sex Research 50 (8): 767–76.Google Scholar
United Nations Economic and Social Council. 2019. “In-Depth Review of Measuring Gender Identity Note by Canada and the United Kingdom.” 67th Plenary Session of the Conference of European Statisticians. Paris, June 2628. Geneva, Switzerland: Economic Commission for Europe.Google Scholar
Urlacher, Brian R. 2022. “Replication Data for ‘Gender Identification and Survey Weighting: A Shifting Landscape.’” https://doi.org/10.7910/DVN/P6IHTM, Harvard Dataverse, Version 1.CrossRefGoogle Scholar
US Census Bureau. 2020. “Why We Ask the Sex Question.” Washington, DC: US Census Bureau. www2.census.gov/programs-surveys/decennial/2020/partners/outreach-materials/handouts/why-we-ask-the-sex-question.pdf.Google Scholar
Westbrook, Laurel, and Saperstein, Aliya. 2015. “New Categories Are Not Enough: Rethinking the Measurement of Sex and Gender in Social Surveys.” Gender & Society 29 (4): 534–60.CrossRefGoogle Scholar
Supplementary material: Link

Urlacher Dataset

Link