Skip to main content Accesibility Help
×
×
Home
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 23
  • Cited by
    This chapter has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Lee, Taedong An, Jungbae Sohn, Hyodong and Yoo, In Tae 2018. An Experiment of Community-Based Learning Effects on Civic Participation. Journal of Political Science Education, p. 1.

    Runst, Petrik 2018. Does Immigration Affect Demand for Redistribution? - An Experimental Design. German Economic Review, Vol. 19, Issue. 4, p. 383.

    Heinrich, Tobias Kobayashi, Yoshiharu and Long, Leah 2018. Voters Get What They Want (When They Pay Attention): Human Rights, Policy Benefits, and Foreign Aid. International Studies Quarterly, Vol. 62, Issue. 1, p. 195.

    Schneider, Mark 2018. The discerning voter. Party Politics, p. 135406881876119.

    Klar, Samara 2018. When Common Identities Decrease Trust: An Experimental Study of Partisan Women. American Journal of Political Science, Vol. 62, Issue. 3, p. 610.

    Dermont, Clau 2018. Environmental decision-making: the influence of policy information. Environmental Politics, p. 1.

    Bayram, A. Burcu 2018. Serious subjects: A test of the seriousness technique to increase participant motivation in political science experiments. Research & Politics, Vol. 5, Issue. 2, p. 205316801876745.

    Kobayashi, Tetsuro Ogawa, Yuki Suzuki, Takahisa and Yamamoto, Hitoshi 2018. News audience fragmentation in the Japanese Twittersphere. Asian Journal of Communication, p. 1.

    Hassell, Hans J. G. and Settle, Jaime E. 2017. The Differential Effects of Stress on Voter Turnout. Political Psychology, Vol. 38, Issue. 3, p. 533.

    Bayram, A. Burcu 2017. Good Europeans? How European identity and costs interact to explain politician attitudes towards compliance with European Union law. Journal of European Public Policy, Vol. 24, Issue. 1, p. 42.

    Pérez, Efrén O. and Tavits, Margit 2017. Language Shapes People's Time Perspective and Support for Future-Oriented Policies. American Journal of Political Science, Vol. 61, Issue. 3, p. 715.

    Cohen, Jeffrey E. 2017. The Promise of Experiments for Studying the Presidency. Presidential Studies Quarterly, Vol. 47, Issue. 3, p. 414.

    Robison, Joshua 2017. The Social Rewards of Engagement: Appealing to Social Motivations to Stimulate Political Interest at High and Low Levels of External Efficacy. Political Studies, Vol. 65, Issue. 1, p. 24.

    Baldassarri, Delia and Abascal, Maria 2017. Field Experiments Across the Social Sciences. Annual Review of Sociology, Vol. 43, Issue. 1, p. 41.

    Strother, Logan 2016. Beyond Kelo: An Experimental Study of Public Opposition to Eminent Domain. Journal of Law and Courts, Vol. 4, Issue. 2, p. 339.

    Flynn, D.J. and Harbridge, Laurel 2016. How Partisan Conflict in Congress Affects Public Opinion. American Politics Research, Vol. 44, Issue. 5, p. 875.

    Robison, Joshua and Mullinix, Kevin J. 2016. Elite Polarization and Public Opinion: How Polarization Is Communicated and Its Effects. Political Communication, Vol. 33, Issue. 2, p. 261.

    Wong, Seanon S. 2016. Emotions and the communication of intentions in face-to-face diplomacy. European Journal of International Relations, Vol. 22, Issue. 1, p. 144.

    Krupnikov, Yanna Piston, Spencer and Bauer, Nichole M. 2016. Saving Face: Identifying Voter Responses to Black Candidates and Female Candidates. Political Psychology, Vol. 37, Issue. 2, p. 253.

    Kanthak, Kristin and Woon, Jonathan 2015. Women Don't Run? Election Aversion and Candidate Entry. American Journal of Political Science, Vol. 59, Issue. 3, p. 595.

    ×
  • Print publication year: 2011
  • Online publication date: June 2012

3 - Internal and External Validity

Summary

One of the challenges in conducting interdisciplinary work, or in attempting to communicate across disciplinary boundaries, relates to the implicit norms that infuse different fields. Much like trying to speak across cultures, it often becomes frustrating to translate or make explicit differing assumptions underlying appropriate inferential methods and strategies. Status differentials often exacerbate these divergences, privileging one set of disciplinary norms over another, so that decisions about ideal methods do not always rest entirely on the appropriateness of a particular technique for a given project.

Such differences clearly affect the implementation of experimental methodology across the fields of psychology, economics, and political science. One of the areas in which these biases inflict misunderstanding surrounds issues related to internal and external validity. In political science, concerns with external validity often border on the monomaniacal, leading to the neglect, if not the complete dismissal, of attention to the important issues involved in internal validity. In psychology, the reverse emphasis predominates. In behavioral economics, the focus depends more on the primary function of the experiment. Because both internal and external validity remain important in assessing the quality, accuracy, and utility of any given experimental design, it facilitates optimal experimental design to concentrate on attempting to maximize both, but the nature of the enterprise often requires explicit consideration of the trade-offs between them.

Recommend this book

Email your librarian or administrator to recommend adding this book to your organisation's collection.

Cambridge Handbook of Experimental Political Science
  • Online ISBN: 9780511921452
  • Book DOI: https://doi.org/10.1017/CBO9780511921452
Please enter your name
Please enter a valid email address
Who would you like to send this to *
×
References
Angrist, Joshua, Imbens, Guido, and Rubin, Donald. 1996. “Identification of Causal Effects Using Instrumental Variables.” Journal of the American Statistical Association 91: 444–55.
Arceneaux, Kevin, Gerber, Alan, and Green, Donald. 2006. “Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment.” Political Analysis 14: 37–62.
Aronson, Elliott, Ellsworth, Phoebe C., Carlsmith, J. Merrill, and Gonzales, Marti Hope. 1990. Methods of Research in Social Psychology. 2nd ed. New York: McGraw-Hill.
Campbell, Donald T. 1957. “Factors Relevant to Validity of Experiments in Social Settings.” Psychological Bulletin 54: 297–312.
Campbell, Donald T., and Stanley, Julian C.. 1966. Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally.
Cohen, Dov, and Nisbett, Richard E.. 1994. “Self-Protection and the Culture of Honor: Explaining Southern Violence.” Personality and Social Psychology Bulletin 20: 551–67.
Darley, John M., and Latane, Bibb. 1968. “Bystander Intervention in Emergencies: Diffusion of Responsibility.” Journal of Personality and Social Psychology 8: 377–83.
Quervain, Dominique J.-F., Fischbacher, Urs, Treyer, Valerie, Schellhammer, Melanie, Schnyder, Ulrich, Buck, Alfred, and Fehr, Ernst. 2004. “The Neural Basis of Altruistic Punishment.” Science 305 (5688): 1254–58.
Druckman, James N., Green, Donald P., Kuklinski, James H., and Lupia, Arthur. 2006. “The Growth and Development of Experimental Research in Political Science.” American Political Science Review 100: 627–35.
Druckman, James N., and Lupia, Arthur. 2006. “Mind, Will and Choice.” In The Oxford Handbook on Contextual Political Analysis, eds. Tilly, Charles and Goodin, Robert E.. Oxford: Oxford University Press, 97–113.
Fehr, Ernst, and Fischbacher, Urs. 2003. “The Nature of Human Altruism.” Nature 425: 785–91.
Fehr, Ernst, and Gächter, Simon. 2002. “Altruistic Punishment in Humans.” Nature 415: 137–40.
Gerber, Alan, and Green, Donald P.. 2000. “The Effects of Canvassing, Telephone Calls, and Direct Mail on Voter Turnout: A Field Experiment.” American Political Science Review 94: 653–63.
Gigerenzer, Gerd. 1996. “On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky.” Psychological Review 103: 592–96.
Green, Donald P., and Gerber, Alan. 2002. “The Downstream Benefits of Experimentation.” Political Analysis 10: 394–402.
Kiesler, Charles A., Collins, Barry E., and Miller, Norman. 1969. Attitude Change: A Critical Analysis of Theoretical Approaches. New York: Wiley.
McDermott, Rose. 2002. “Experimental Methodology in Political Science.” Political Analysis 10: 325–42.
McDermott, Rose, and Cowden, Jonathan A.. 2001. “The Effects of Uncertainty and Sex in a Simulated Crisis Game.” International Interactions 27: 353–80.
McDermott, Rose, Tingley, Dustin, Cowden, Jonathan A., Frazzetto, Giovanni, and Johnson, Dominic D. P.. 2009. “Monoamine Oxidase A Gene (MAOA) Predicts Behavioral Aggression Following Provocation.” Proceedings of the National Academy of Sciences 106: 2118–23.
Miguel, Edward, Satyanath, Shanker, and Sergenti, Ernest. 2004. “Economic Shocks and Civil Conflict: An Instrumental Variable Approach.” Journal of Political Economy 112: 725–53.
Milgram, Stanley. 1974. Obedience to Authority. New York: Harper & Row.
Nickerson, David W. 2005. “Scalable Protocols Offer Efficient Design for Field Experiments.” Political Analysis 13: 233–52.
Roethlisberger, Fritz J., and Dickson, William J.. 1939. Management and the Worker. Cambridge, MA:Harvard University Press.
Roth, Alvin E. 1995. “Introduction to Experimental Economics.” In Handbook of Experimental Economics, eds. Kagel, John H. and Roth, Alvin E.. Princeton, NJ: Princeton University Press, 3–110.
Shadish, William R., Cook, Thomas D., and Campbell, Donald T.. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton-Mifflin.
Smith, Eliot R., and Mackie, Diane M.. 1995. Social Psychology. New York: Worth.
Sokol-Hessner, Peter, Hsu, Ming, Curley, Nina G., Delgado, Mauricio R., Camerer, Colin F., and Phelps, Elizabeth A.. 2009. “Thinking Like a Trader Selectively Reduces Individuals' Loss Aversion.” Proceedings of the National Academy of Sciences 106: 5035–40.
Sovey, Allison J., and Green, Donald P.. 2011. “Instrumental Variables Estimation in Political Science: A Reader's Guide.” American Journal of Political Science 55: 188–200.
Tversky, Amos, and Kahneman, Daniel. 1974. “Judgment under Uncertainty: Heuristics and Biases.” Science 185: 1124–31.
Walker, T. 1976. “Microanalytic Approaches to Political Decision Making.” American Behavioral Science 20: 93–110.