Skip to main content Accesibility Help
×
×
Home
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 19
  • Cited by
    This chapter has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Quadlin, Natasha 2018. Sibling Achievement, Sibling Gender, and Beliefs about Parental Investment: Evidence from a National Survey Experiment. Social Forces,

    MUMMOLO, JONATHAN and PETERSON, ERIK 2018. Demand Effects in Survey Experiments: An Empirical Assessment. American Political Science Review, p. 1.

    Miratrix, Luke W. Sekhon, Jasjeet S. Theodoridis, Alexander G. and Campos, Luis F. 2018. Worth Weighting? How to Think About and Use Weights in Survey Experiments. Political Analysis, Vol. 26, Issue. 03, p. 275.

    Druckman, James N. Howat, Adam J. and Mullinix, Kevin J. 2018. Graduate Advising in Experimental Research Groups. PS: Political Science & Politics, Vol. 51, Issue. 03, p. 620.

    Ewers, Michael C. and Shockley, Bethany 2018. Attracting and retaining expatriates in Qatar during an era of uncertainty: Would you stay or would you go?. Population, Space and Place, Vol. 24, Issue. 5, p. e2134.

    Flores, René D. and Schachter, Ariela 2018. Who are the “Illegals”? The Social Construction of Illegality in the United States. American Sociological Review, Vol. 83, Issue. 5, p. 839.

    Knudsen, Erik and Johannesson, Mikael Poul 2018. Beyond the Limits of Survey Experiments: How Conjoint Designs Advance Causal Inference in Political Communication Research. Political Communication, p. 1.

    Cohen, Jeffrey E. 2017. The Promise of Experiments for Studying the Presidency. Presidential Studies Quarterly, Vol. 47, Issue. 3, p. 414.

    Abbott, Kenneth W. 2017. Orchestrating experimentation in non-state environmental commitments. Environmental Politics, Vol. 26, Issue. 4, p. 738.

    Kubbe, Ina 2017. Neue Trends in den Sozialwissenschaften. p. 85.

    Schachter, Ariela 2016. From “Different” to “Similar”. American Sociological Review, Vol. 81, Issue. 5, p. 981.

    Baekgaard, Martin and Serritzlew, Søren 2016. Interpreting Performance Information: Motivated Reasoning or Unbiased Comprehension. Public Administration Review, Vol. 76, Issue. 1, p. 73.

    Slothuus, Rune 2016. Assessing the Influence of Political Parties on Public Opinion: The Challenge from Pretreatment Effects. Political Communication, Vol. 33, Issue. 2, p. 302.

    Blom-Hansen, Jens Morton, Rebecca and Serritzlew, Søren 2015. Experiments in Public Management Research. International Public Management Journal, Vol. 18, Issue. 2, p. 151.

    Morgan, Stephen L. and Taylor Poppe, Emily S. 2015. A Design and a Model for Investigating the Heterogeneity of Context Effects in Public Opinion Surveys. Sociological Methodology, Vol. 45, Issue. 1, p. 184.

    Veszteg, Róbert Ferenc Funaki, Yukihiko and Tanaka, Aiji 2015. The impact of the Tohoku earthquake and tsunami on social capital in Japan: Trust before and after the disaster. International Political Science Review, Vol. 36, Issue. 2, p. 119.

    Miller, Charles 2014. Re-examining the Australian public's attitude to military casualties: post-heroic or defeat-phobic?. Australian Journal of International Affairs, Vol. 68, Issue. 5, p. 515.

    Jackson, Michelle and Cox, D.R. 2013. The Principles of Experimental Design and Their Application in Sociology. Annual Review of Sociology, Vol. 39, Issue. 1, p. 27.

    Morgan, Stephen L. and Taylor Poppe, Emily S. 2012. The Consequences of International Comparisons for Public Support of K–12 Education. Educational Researcher, Vol. 41, Issue. 7, p. 262.

    ×
  • Print publication year: 2011
  • Online publication date: June 2012

8 - The Logic and Design of the Survey Experiment

Summary

The title promises a chapter about methods, so a confession is in order. Here, as everywhere, my concerns are substantive, not methodological. Still, what one wants to learn and how one ought to go about learning it are intertwined. So, I propose to bring out the logic of the survey experiment by presenting a classification of survey experiment designs. Specifically, I distinguish three designs: manipulative, permissive, and facilitative. The distinctions among the designs turn on the hypotheses being tested, not the operations performed, and, above all, on the role of predispositions. The first design aims to get people to do what they are not predisposed to do; the second to allow them to do what they are predisposed to do, without encouraging them; and the third to provide them with a relevant reason to do what they already are predisposed to do. Against the background of this threefold classification, I want to comment briefly on some issues of causal inference and external validity and then conclude by offering my own view on the reasons for the explosive growth in survey experiments in the study of public opinion.

The modern survey experiment is the biggest change in survey research in a half century. There is some interest in how it came about, I am told. So I begin by telling how I got the idea of computer-assisted survey experiments.

Recommend this book

Email your librarian or administrator to recommend adding this book to your organisation's collection.

Cambridge Handbook of Experimental Political Science
  • Online ISBN: 9780511921452
  • Book DOI: https://doi.org/10.1017/CBO9780511921452
Please enter your name
Please enter a valid email address
Who would you like to send this to *
×
References
Apostle, Richard A., Glock, Charles Y., Piazza, Thomas, and Suelze, Marijane. 1983. The Anatomy of Racial Attitudes. Berkeley: University of California Press.
Bartels, Larry, and Brady, Henry E.. 1993. “The State of Quantitative Political Methodology.” In The State of the Discipline II, ed. Finifter, Ada. Washington, DC: American Political Science Association, 121–62.
Chong, Dennis, and Druckman, James N.. 2007a. “Framing Public Opinion in Competitive Democracies.” American Political Science Review 101: 637–55.
Chong, Dennis, and Druckman, James N.. 2007b. “Framing Theory.” Annual Review of Political Science 10: 103–26.
Converse, Philip E. 1964. “The Nature of Belief Systems in Mass Publics.” In Ideology and Discontent, ed. Apter, David E.. New York: Free Press, 206–61.
Dawson, Michael C. 2001. Black Visions. Chicago: The University of Chicago Press.
Druckman, James N. 2001a. “Using Credible Advice to Overcome Framing Effects.” Journal of Law, Economics, & Organization 17: 62–82.
Druckman, James N. 2001b. “On the Limits of Framing Effects.” Journal of Politics 63: 1041–66.
Druckman, James N. 2001c. “The Implications of Framing Effects for Citizen Competence.” Political Behavior 23: 225–56.
Druckman, James N. 2004. “Political Preference Formation.” American Political Science Review 98: 671–86.
Druckman, James N., Hennessy, Cari Lynn, Charles, Kristi, and Weber, Jonathan. 2010. “Competing Rhetoric over Time: Frames versus Cues.” Journal of Politics 72: 136–48.
Freedman, David A., Pisani, Roger, and Purves, Roger. 1998. Statistics. New York: Norton, 3–11.
Gaines, Brian J., Kuklinski, James H., and Quirk, Paul J.. 2007. “The Logic of the Survey Experiment Reexamined.” Political Analysis 15: 1–20.
Gibson, James L., and Gouws, Amanda. 2003. Overcoming Intolerance in South Africa: Experiments in Democratic Persuasion. New York: Cambridge University Press.
Hacking, Ian. 1983. Representing and Intervening: Introductory Topics in the Philosophy of Natural Science. New York: Cambridge University Press.
Hurwitz, Jon, and Peffley, Mark.1998. Perception and Prejudice: Race and Politics in the United States. New Haven, CT: Yale University Press.
Jackman, Simon, and Sniderman, Paul M.. 2006. “The Limits of Deliberative Discussion: A Model of Everyday Political Arguments.” Journal of Politics 68: 272–83.
Kuklinski, James H., Sniderman, Paul M., Knight, Kathleen, Piazza, Thomas, Tetlock, Philiip E., Lawrence, Gordon R., and Mellers, Barbara. 1997. “Racial Attitudes Toward Affirmative Action.” American Journal of Political Science 41: 402–19.
Merton, Robert K. 1973. The Sociology of Science. Chicago: The University of Chicago Press.
Nelson, Thomas E., and Kinder, Donald R.. 1996. “Issue Frames and Group-Centrism in American Public Opinion.” Journal of Politics 58: 1055–78.
Riker, William H. 1996. The Strategy of Rhetoric. New Haven, CT: Yale University Press.
Schuman, Howard, and Presser, Stanley. 1981. Questions and Answers in Attitude Surveys. New York: Academic Press.
Sniderman, Paul M., and Carmines, Edward G.. 1997. Reaching beyond Race. Cambridge, MA: Harvard University Press.
Sniderman, Paul M., Fletcher, Joseph F., Russell, Peter, and Tetlock, Philip E.. 1996. The Clash of Rights: Liberty, Equality, and Legitimacy in Pluralist Democracies. New Haven, CT: Yale University Press.
Sniderman, Paul M., and Piazza, Thomas. 1993. The Scar of Race. Cambridge, MA: Harvard University Press.
Sniderman, Paul M., and Piazza, Thomas. 2002. Black Pride and Black Prejudice. Princeton, NJ: Princeton University Press.
Sniderman, Paul M., Tetlock, Philip E., and Elms, Laurel. 2001. “Public Opinion and Democratic Politics: The Problem of Non-attitudes and Social Construction of Political Judgment.” In Citizens and Politics: Perspectives from Political Psychology, ed. Kuklinski, James H.. New York: Cambridge University Press, 254–84.
Sniderman, Paul M., and Theriault, Sean M.. 2004. “The Structure of Political Argument and the Logic of Issue Framing.” In Studies in Public Opinion, eds. Saris, Willem and Sniderman, Paul M.. Princeton, NJ: Princeton University Press, 133–65.
Stoker, Laura. 1998. “Understanding Whites' Resistance to Affirmative Action: The Role of Principled Commitments and Racial Prejudice.” In Perception and Prejudice: Race and Politics in the United States, eds. Hurwitz, Jon and Peffley, Mark. New Haven, CT: Yale University Press, 135–70.
Webb, Eugene, J., Campbell, Donald T., Schwartz, Richard D., and Sechrest, Lee. 1996. Unobtrusive Measures: Nonreactive Research in the Social Sciences. New York: Rand McNally.
Zaller, John R. 1992. The Nature and Origins of Mass Opinion. New York: Cambridge University Press.