Skip to main content
×
×
Home

Using the Predicted Responses from List Experiments as Explanatory Variables in Regression Models

  • Kosuke Imai (a1), Bethany Park (a2) and Kenneth F. Greene (a3)
Abstract

The list experiment, also known as the item count technique, is becoming increasingly popular as a survey methodology for eliciting truthful responses to sensitive questions. Recently, multivariate regression techniques have been developed to predict the unobserved response to sensitive questions using respondent characteristics. Nevertheless, no method exists for using this predicted response as an explanatory variable in another regression model. We address this gap by first improving the performance of a naive two-step estimator. Despite its simplicity, this improved two-step estimator can only be applied to linear models and is statistically inefficient. We therefore develop a maximum likelihood estimator that is fully efficient and applicable to a wide range of models. We use a simulation study to evaluate the empirical performance of the proposed methods. We also apply them to the Mexico 2012 Panel Study and examine whether vote-buying is associated with increased turnout and candidate approval. The proposed methods are implemented in open-source software.

Copyright
Corresponding author
e-mail: kimai@princeton.edu (corresponding author)
Footnotes
Hide All

Authors' note: The proposed methods are implemented via the open-source software list: Statistical Methods for the Item Count Technique and List Experiments, which is available for download at the Comprehensive R Archive Network (http://cran.r-project.org/package=list). Supplementary materials for this article are available on the Political Analysis Web site. The replication archive is available as Imai, Park, and Greene (2014). We thank Adam Glynn and anonymous reviewers for helpful comments.

Footnotes
References
Hide All
Ahlquist, J., Mayer, K., and Jackman, S. 2013. Alien abduction and voter impersonation in the 2012 US general election: Evidence from a survey list experiment. Technical report, University of Wisconsin, Madison.
Biemer, P., and Brown, G. 2005. Model-based estimation of drug-use prevalence using item count data. Journal of Official Statistics 21(2): 287308.
Blair, G., and Imai, K. 2012. Statistical analysis of list experiments. Political Analysis 20(1): 4777.
Blair, G., Imai, K., and Lyall, J. 2014. Comparing and combining list and endorsement experiments: Evidence from Afghanistan. American Journal of Political Science 58(4): 1043–63.
Blair, G., Imai, K., and Park, B. 2014. List: Statistical methods for the item count technique and list experiment. Available at the Comprehensive R Archive Network (CRAN). http://CRAN.R-project.org/package=list (accessed June 1, 2014).
Blair, G., Imai, K., and Zhou, Y.-Y. 2014. Design and analysis of randomized response technique. Technical report, Pittsburgh, PA: Princeton University.
Blais, A. 2000. To vote or not to vote: The merits and limits of rational choice theory. Pittsburgh, PA: University of Pittsburgh Press.
Brusco, V., Nazareno, M., and Stokes, S. 2004. Vote buying in Argentina. Latin American Research Review 39(2): 6688.
Bullock, W., Imai, K., and Shapiro, J. N. 2011. Statistical analysis of endorsement experiments: Measuring support for militant groups in Pakistan. Political Analysis 19(4): 363–84.
Burden, B. C. 2000. Voter turnout and the National Election Studies. Political Analysis 8(4): 389–98.
Calvo, E., and Murillo, M. 2004. Who delivers? Partisan clients in the Argentine electoral market. American Journal of Political Science 48(4): 742–57.
Carreras, M., and İrepoğlu, Y. 2013. Electoral studies. Electoral Studies 32(4): 609–19.
Cornelius, W. 2004. Mobilized voting in the 2000 elections: The changing efficacy of vote buying and coercion in Mexican electoral politics. In Mexico's Pivotal Democratic Election, eds. Dominguez, J. I. and Lawson, C., 4765. Stanford, CA: Stanford University Press.
Cornelius, W., and Craig, A. 1991. The Mexican political system in transition. Monograph Series. La Jolla, CA: Center for U.S.-Mexican Studies.
Corstange, D. 2009. Sensitive questions, truthful answers? Modeling the list experiment with LISTIT. Political Analysis 17(1): 4563.
Corstange, D. 2012a. Religion, pluralism, and iconography in the public sphere: Theory and evidence from Lebanon. World Politics 64(1): 116–60.
Corstange, D. 2012b. Vote-trafficking in Lebanon. International Journal of Middle East Studies 44:483505.
Cox, G. W., and Kousser, J. M. 1981. Turnout and rural corruption: New York as a test case. American Journal of Political Science 25(4): 646–63.
Cox, G. W., and McCubbins, M. D. 1986. Electoral politics as a redistributive game. Journal of Politics 48(2): 370–89.
Diaz-Cayeros, A., Estévez, F., and Magaloni, B. 2009. Welfare benefits, canvassing, and campaign handouts. In Consolidating Mexico's democracy: The 2006 presidential campaign in comparative perspective, eds. Domínguez, J., Lawson, C., and Moreno, A., 229–45. Baltimore, MD: Johns Hopkins University Press.
Dixit, A., and Londregan, J. 1996. The determinants of success of special interests in redistributive politics. Journal of Politics 58:1132–55.
Domínguez, J., and McCann, J. 1995. Shaping Mexico's electoral arena: The construction of partisan cleavages in the 1988 and 1991 national elections. American Political Science Review 89(1): 3448.
Droitcour, J., Caspar, R. A., Hubbard, M. L., and Ezzati, T. M. 1991. The item count technique as a method of indirect questioning: A review of its development and a case study application. In Measurement errors in surveys, eds. Biemer, P. P., Groves, R. M., Lyberg, L. E., Mathiowetz, N. A., and Sudman, S., 185210. New York: John Wiley & Sons.
Gans-Morse, J., Mazzuca, S., and Nichter, S. 2014. Varieties of clientelism: Machine politics during elections. American Journal of Political Science 58(2): 415–32.
Glynn, A. N. 2013. What can we learn with statistical truth serum? Design and analysis of the list experiment. Public Opinion Quarterly 77:159–72.
Gonzalez-Ocantos, E., de Jonge, C. K., Meléndez, C., Osorio, J., and Nickerson, D. W. 2012. Vote buying and social desirability bias: Experimental evidence from Nicaragua. American Journal of Political Science 56(1): 202–17.
Greene, K. F. 2007. Why dominant parties lose: Mexico's democratization in comparative perspective. New York: Cambridge University Press.
Greene, K. F. 2014. Back from the dead: Vote-selling zombies and the return of Mexico's PRI. Paper presented at the Latin American Studies Association Congress, Chicago.
Greene, K. F., Domínguez, J., Lawson, C., and Moreno, A. 2012. The Mexico 2012 Panel Study. Wave 2. Original public opinion survey, available at http://kgreene.webhost.utexas.edu.
Holbrook, A. L., and Krosnick, J. A. 2010. Social desirability bias in voter turnout reports: Tests using the item count technique. Public Opinion Quarterly 74(1): 3767.
Imai, K. 2011. Multivariate regression analysis for the item count technique. Journal of the American Statistical Association 106(494): 407–16.
Imai, K., Park, B., and Greene, K. F. 2014. Replication data for: Using the predicted responses from list experiments as explanatory variables in regression models. The Dataverse Network. http://dx.doi.org/10.7910/DVN/27083 (accessed June 1, 2014).
Kane, J. G., Craig, S. C., and Wald, K. D. 2004. Religion and presidential politics in Florida: A list experiment. Social Science Quarterly 85(2): 281–93.
Kramon, E. 2009. Vote-buying and political behavior: Estimating and explaining vote-buying's effect on turnout in Kenya. Afrobarometer Working Papers 1–31.
Kuklinski, J. H., Cobb, M. D., and Gilens, M. 1997. Racial attitudes and the “New South.” Journal of Politics 59(2): 323–49.
Lindbeck, A., and Weibull, J. W. 1987. Balanced-budget redistribution as the outcome of political competition. Public Choice 52(3): 273–97.
Magaloni, B., Diaz-Cayeros, A., and Estévez, F. 2007. Clientelistm and portfolio diversification. Patrons, Clients, and Policies: Patterns of Democratic Accountability and Political Competition, 182–204. New York, NY: Cambridge University Press.
Nichter, S. 2008. Vote buying or turnout buying? Machine politics and the secret ballot. American Political Science Review 102(1): 1931.
Nichter, S., and Palmer-Rubin, B. 2015. Clientelism, declared support, and Mexico's 2012 campaign. In Mexico's evolving democracy: A comparative study of the 2012 elections, eds. Domínguez, J., Greene, K., Lawson, C., and Moreno, A., 220–26. Baltimore, MD: Johns Hopkins University Press.
Penfold Becerra, M. 2007. Clientelism and social funds: Evidence from Chávez's Misiones. Latin American Politics and Society 49(4): 6384.
Rosenfeld, B., Imai, K., and Shapiro, J. 2014. An empirical validation study of popular survey methodologies for sensitive questions. Working Paper available at http://imai.princeton.edu/research/Validate.html (accessed June 1, 2014).
Stokes, S. 2005. Perverse accountability: A formal model of machine politics with evidence from Argentina. American Political Science Review 99(3): 315–25.
Stokes, S., Dunning, T., Nazareno, M., and Brusco, V. 2013. Brokers, voters, and clientelism: The puzzle of distributive politics. Cambridge Studies in Comparative Politics. Cambridge, UK: Cambridge University Press.
Streb, M. J., Burrell, B., Frederick, B., and Genovese, M. A. 2008. Social desirability effects and support for a female American president. Public Opinion Quarterly 72(1): 7689.
Tourangeau, R., and Yan, T. 2007. Sensitive questions in surveys. Psychological Bulletin 133(5): 859–83.
Warner, S. L. 1965. Randomized response: A survey technique for eliminating evasive answer bias. Journal of the American Statistical Association 60(309): 6369.
Wimbush, J. C., and Dalton, D. R. 1997. Base rate for employee theft: Convergence of multiple methods. Journal of Applied Psychology 82(5): 756–63.
Wolfinger, R., and Rosenstone, S. 1980. Who votes? New Haven, CT: Yale University Press.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×
MathJax
Type Description Title
PDF
Supplementary materials

Imai et al. supplementary material
Appendix

 PDF (193 KB)
193 KB

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed