Skip to main content
    • Aa
    • Aa

When to Protect? Using the Crosswise Model to Integrate Protected and Direct Responses in Surveys of Sensitive Behavior

  • Daniel W. Gingerich (a1), Virginia Oliveros (a2), Ana Corbacho (a3) and Mauricio Ruiz-Vega (a3)

Sensitive survey techniques (SSTs) are frequently used to study sensitive behaviors. However, existing strategies for employing SSTs lead to highly variable prevalence estimates and do not permit analysts to address the question of whether the use of an SST is actually necessary. The current article presents a survey questioning strategy and corresponding statistical framework that fills this gap. By jointly analyzing survey responses generated by an SST (the crosswise model) along with direct responses about the sensitive behavior, the article's framework addresses the question of whether the use of an SST is required to study a given sensitive behavior, provides an efficient estimate of the prevalence of the sensitive behavior, and, in its extended form, efficiently estimates how individual characteristics relate to the likelihood of engaging in the behavior. The utility of the approach is demonstrated through an examination of gender differences in proclivities towards corruption in Costa Rica.

Corresponding author
Hide All

Authors' note: This article was prepared when Ana Corbacho was Sector Economic Advisor and Daniel Gingerich and Virginia Oliveros were visiting scholars at the Inter-American Development Bank. The data, code, and any additional materials required to replicate all analyses in this article are available on the Political Analysis Dataverse of Harvard University's Dataverse Network at: Supplementary materials for this article are available on the Political Analysis Web site.

Hide All
P. M. Aronow , A. Coppock , F. W. Crawford , and D. P. Green 2015. Combining list experiment and direct question estimates of sensitive behavior prevalence. Journal of Survey Statistics and Methodology. doi:10.1093/jssam/smu023.

O. Azfar , and P. Murrell 2009. Identifying reticent respondents: Assessing the quality of survey data on corruption and values. Economic Development and Cultural Change 57(2): 387411.

G. Blair , and K. Imai 2012. Statistical analysis of list experiments. Political Analysis 20(1): 4777.

G. Blair , K. Imai , and J. Lyall 2014. Comparing and combining list and endorsement experiments: Evidence from Afghanistan. American Journal of Political Science 58(4): 1043–63.

G. Blair , K. Imai , and Y.-Y. Zhou 2015. Statistical analysis of the randomized response technique. Journal of the American Statistical Association 110(511): 1304–19.

U. Böckenholt , and P. G. M. van der Heijden 2007. Item randomized-response models for measuring noncompliance: Risk-return perceptions, social influences, and self-protective responses. Psychometrika 72(2): 245–62.

P. D. Bourke , and M. A. Moran 1988. Estimating proportions from randomized response data using the EM algorithm. Journal of the American Statistical Association 83(404): 964–68.

D. Corstange 2009. Sensitive questions, truthful answers? Modeling the list experiment with LISTIT. Political Analysis 17:5463.

M. G. de Jong , R. Pieters , and J. P. Fox 2010. Reducing social desirability bias through item randomized response: An application to measure underreported desires. Journal of Marketing Research 47(1): 1427.

M. G. de Jong , R. Pieters , and S. Stremersch 2012. Analysis of sensitive questions across cultures: An application of multigroup item randomized response theory to sexual attitudes and behavior. Journal of Personality and Social Psychology 103(3): 543–64.

D. Dollar , R. Fisman , and R. Gatti 2001. Are women really the “fairer” sex? Corruption and women in government. Journal of Economic Behavior & Organization 46(4): 423–29.

S. E. Edgell , S. Himmelfarb , and K. L. Duchan 1982. Validity of forced responses in a randomized response model. Sociological Methods & Research 11(1): 89100.

Justin Esarey , and Gina Chirillo . 2013. “Fairer sex” or purity myth? Corruption, gender, and institutional context. Politics and Gender 9(4): 390413.

J. P. Fox 2005. Randomized item response theory models. Journal of Educational and Behavioral statistics 30(2): 189212.

J. P. Fox , and C. Wyrick 2008. A mixed effects randomized item response model. Journal of Educational and Behavioral Statistics 33(4): 389415.

J. P. Fox , and R. R. Meijer 2008. Using item response theory to obtain individual information from randomized response data: An application using cheating data. Applied Psychological Measurement 32(8): 595610.

J. P. Fox , M. Avetisyan , and J. Palen 2013. Mixture randomized item-response modeling: A smoking behavior validation study. Statistics in Medicine 32(27): 4821–37.

A. Franzen , and S. Pointner 2012. Anonymity in the dictator game revisited. Journal of Economic Behavior & Organization 81(1): 7481.

M. Gilens , P. M. Sniderman , and J. H. Kuklinski 1998. Affirmative action and the politics of realignment. British Journal of Political Science 28(1): 159–83.

D. W. Gingerich 2013. Political institutions and party-directed corruption in South America: Stealing for the team. Cambridge: Cambridge University Press.

D. W Gingerich 2010. Understanding off-the-books politics: Conducting inference on the determinants of sensitive behavior with randomized response surveys. Political Analysis 18:349–80.

A. N. Glynn 2013. What can we learn with statistical truth serum? Design and analysis of the list experiment. Public Opinion Quarterly 77(S1): 159–72.

A. M. Goetz 2007. Political cleaners: Women as the new anti-corruption force? Development and Change 38:87105.

E. Gonzalez-Ocantos , C. K. De Jonge , C. Meléndez , J. Osorio , and D. W. Nickerson 2012. Vote buying and social desirability bias: Experimental evidence from Nicaragua. American Journal of Political Science 56(1): 202–17.

K. Imai 2011. Multivariate regression analysis for the item count technique. Journal of the American Statistical Association 106:407–16.

B. Jann , J. Jerke , and I. Krumpal 2012. Asking sensitive questions using the crosswise model an experimental survey measuring plagiarism. Public Opinion Quarterly 76(1): 3249.

A. Kraay , and P. Murrell 2013. Misunderestimating corruption. Policy Research Working Paper 6488, World Bank, Washington, DC.

I. Krumpal 2012. Estimating the prevalence of xenophobia and anti-Semitism in Germany: A comparison of randomized response and direct questioning. Social Science Research 41(6): 1387–403.

J. H. Kuklinski , P. M. Sniderman , K. Knight , T. Piazza , P. E. Tetlock , G. R. Lawrence , and B. Mellers 1997. Racial prejudice and attitudes toward affirmative action. American Journal of Political Science 41(2): 402–19.

C. W. Lamb Jr. and D. E. Stem Jr 1978. An empirical validation of the randomized response technique. Journal of Marketing Research 15(4): 616–21.

D. Lara , S. G. García , C. Ellertson , C. Camlin , and J. Suarez 2006. The measure of induced abortion levels in Mexico using randomized response technique. Sociological Methods and Research 35:279–30.

G. J. L. Lensvelt-Mulders , J. J. Hox , P. G. M. van der Heijden , and C. J. M. Maas 2005. Meta-analysis of randomized response research: Thirty years of validation. Sociological Methods and Research 33:319–48.

G. J. L. Lensvelt-Mulders , P. G. M. van der Heijden , O. Laudy , and G. van Gils 2006. A validation of a computer-assisted randomized response survey to estimate the prevalence of fraud in social security. Journal of the Royal Statistical Society Series A 169(Part 2): 305–18.

J. A. List , R. P. Berrens , A. K. Bohara , and J. Kerkvliet 2004. Examining the role of social isolation on stated preferences. American Economic Review 94:741–52.

E. J. Malesky , D. D. Gueorguiev , and N. M. Jensen 2015. Monopoly money: Foreign investment and bribery in Vietnam, a survey experiment. American Journal of Political Science 59(2): 419–39.

H.-E Sung . 2003. Fairer sex or fairer system? Gender and corruption revisited. Social Forces 82(2): 703–23.

Anand Swamy , Stephen Knack, Young Lee , and Omar Azfar . 2001. Gender and corruption. Journal of Development Economics 64:2555.

M. T. Tan , G. L. Tian , and M. L. Tang 2009. Sample surveys with sensitive questions: A nonrandomized response approach. American Statistician 63(1): 916.

B. Torgler , and N. T. Valev 2010. Gender and public attitudes toward corruption and tax evasion. Contemporary Economic Policy 28(4): 554–68.

P. E. Tracy , and J. A. Fox 1981. The validity of randomized response for sensitive measurements. American Sociological Review 46:187200.

P. G. M. van der Heijden , G. van Gils , J. Bouts , and J. J. Hox 2000. A comparison of randomized response, computer assisted self interview and face-to-face direct questioning: Eliciting sensitive information in the context of welfare and unemployment benefit fraud. Sociological Methods & Research 28:505–37.

S. L. Warner 1965. Randomized response: A survey technique for eliminating evasive answer bias. Journal of the American Statistical Association 60:63–9.

J. W. Yu , G. L. Tian , and M. L. Tang 2008. Two new models for survey sampling with sensitive characteristic: Design and analysis. Metrika 67(3): 251–63.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
Type Description Title
Supplementary Materials

Gingerich et al. supplementary material

 PDF (154 KB)
154 KB


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 38 *
Loading metrics...

Abstract views

Total abstract views: 91 *
Loading metrics...

* Views captured on Cambridge Core between 4th January 2017 - 18th October 2017. This data will be updated every 24 hours.