Skip to main content Accessibility help
×
Home
Hostname: page-component-55597f9d44-ssw5r Total loading time: 0.369 Render date: 2022-08-11T13:12:41.346Z Has data issue: true Feature Flags: { "shouldUseShareProductTool": true, "shouldUseHypothesis": true, "isUnsiloEnabled": true, "useRatesEcommerce": false, "useNewApi": true } hasContentIssue true

Putting Politics in the Lab: A Review of Lab Experiments in Political Science

Published online by Cambridge University Press:  10 July 2018

Abstract

Experiments are now common in political science. They are an excellent methodological tool to estimate the causal effect of a treatment on an outcome. In this article, I review the use of lab experiments in political science. After a brief report on their popularity and advantages, I distinguish two ideal-types (economics-based and psychology-based) and outline the main lines of division between them. In the final section, I discuss the main challenges that lab experimentalists are facing today.

Type
Review Article
Copyright
Copyright © The Author(s). Published by Government and Opposition Limited and Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

Damien Bol is Assistant Professor in the Department of Political Economy at King’s College London. Contact email: damien.bol@kcl.ac.uk.

References

Adida, C.L., Laitin, D.D. and Valfort, M.-A. (2016), ‘“One Muslim is Enough!” Evidence from a Field Experiment in France’, Annals of Economics and Statistics, 121/122: 121160.CrossRefGoogle Scholar
Amorim Neto, O. and Cox, G.W. (1997), ‘Electoral Institutions, Cleavage Structures, and the Number of Parties’, American Journal of Political Science, 41(1): 149174.CrossRefGoogle Scholar
Angrist, J.D. and Pischke, J.-S. (2010), ‘The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con out of Econometrics’, Journal of Economic Perspectives, 24(2): 330.CrossRefGoogle Scholar
Baker, M. (2016), ‘1,500 Scientists Lift the Lid on Reproducibility’, Nature, 533(7604): 452454.CrossRefGoogle ScholarPubMed
Bawn, K. (1993), ‘The Logic of Institutional Preferences: German Electoral Law as a Social Choice Outcome’, American Journal of Political Science, 37(4): 965989.CrossRefGoogle Scholar
Belot, M., Duch, R. and Miller, L. (2015), ‘A Comprehensive Comparison of Students and Non-students in Classic Experimental Games’, Journal of Economic Behavior and Organisation, 113(1): 2633.CrossRefGoogle Scholar
Benjamin, D.J., Berger, J.O., Johannesson, M. et al. (2018), ‘Redefining Statistical Significance’, Nature Human Behavior, 2: 610.CrossRefGoogle Scholar
Blais, A. and Carty, K.R. (1990), ‘Does Proportional Representation Foster Voter Turnout?’, European Journal of Political Research, 18(2): 167181.CrossRefGoogle Scholar
Blais, A., Labbé St-Vincent, S., Pilet, J.-B. and Treibich, R. (2016), ‘Voting Correctly in Lab Elections with Monetary Incentives: The Impact of District Magnitude’, Party Politics, 22(4): 544551.CrossRefGoogle Scholar
Boix, C. (1999), ‘Setting the Rules of the Game: The Choice of Electoral Systems in Advanced Democracies’, American Political Science Review, 93(3): 609624.CrossRefGoogle Scholar
Bol, D. (2019), ‘Experiments: A Tool to Test Causal Relationships’, in F. Morin, C. Olsson and E. Ozlem Atikcan (eds), Key Concepts in Research Methods (Cambridge: Routledge).Google Scholar
Bol, D., Labbé St-Vincent, S. and Lavoie, J.-M. (2016), ‘Recruiting for Laboratory Voting Experiments: Exploring the (Potential) Sampling Bias’, in A. Blais, J.-F. Laslier and K. Van der Straeten (eds), Voting Experiments (New York: Springer): 271286.CrossRefGoogle Scholar
Bol, D., Blais, A. and Labbé St-Vincent, S. (2018), ‘Which Matters Most: Party Strategic Exit or Voter Strategic Voting? A Laboratory Experiment’, Political Science Research and Methods, 6(2): 229244.CrossRefGoogle Scholar
Carey, J.M. and Hix, S. (2011), ‘The Electoral Sweet Spot: Low Magnitude Proportional Electoral Systems’, American Journal of Political Science, 55(2): 383397.CrossRefGoogle Scholar
Cliffort, S. and Jerit, J. (2014), ‘Is There a Cost to Convenience? An Experimental Comparison of Data Quality in Laboratory and Online Studies’, Journal of Experimental Political Science, 1(2): 120131.CrossRefGoogle Scholar
Coppock, A. and Green, D.P. (2015), ‘Assessing the Correspondence between Experimental Results Obtained in the Lab and Field: A Review of Recent Social Science Research’, Political Science Research and Methods, 3(1): 113131.CrossRefGoogle Scholar
Desposato, S. (2016) (ed.), Ethics in Experiments: Problems and Solutions for Social Scientists and Policy Professionals (London: Routledge).Google Scholar
Dickson, E.S. (2011), ‘Economics Versus Psychology Experiments: Stylization, Incentives, and Deception’, in J.N. Druckman, D.P. Green, J.H. Kuklinski and A. Lupia (eds), Cambridge Handbook of Experimental Political Science (Cambridge: Cambridge University Press): 5871.CrossRefGoogle Scholar
Dickson, E.S., Gordon, S.C. and Huber, G.A. (2015), ‘Institutional Sources of Legitimate Authority: An Experimental Investigation’, American Journal of Political Science, 59(1): 109127.CrossRefGoogle Scholar
Druckman, J.N., Green, D.P., Kuklinski, J.H. and Lupia, A. (2011), ‘Experimentations in Political Science’, in J.N. Druckman, D.P. Green, J.H. Kuklinski and A. Lupia (eds), Cambridge Handbook of Experimental Political Science (Cambridge: Cambridge University Press): 313.CrossRefGoogle Scholar
Druckman, J.N., Fein, J. and Leeper, T.J. (2012), ‘Source of Bias in Public Opinion Stability’, American Political Science Review, 106(2): 430454.CrossRefGoogle Scholar
Duffy, J. and Tavits, M. (2008), ‘Beliefs and Voting Decisions: A Test of the Pivotal Voter Model’, American Journal of Political Science, 52(3): 603618.CrossRefGoogle Scholar
Eldersveld, S.J. (1956), ‘Experimental Propaganda Techniques and Voting Behavior’, American Political Science Review, 50(1): 154165.CrossRefGoogle Scholar
Feddersen, T., Gailmard, S. and Sandron, A. (2009), ‘Moral Bias in Large Elections: Theory and Experimental Evidence’, American Political Science Review, 103(2): 175192.CrossRefGoogle Scholar
Gartner, S.S. (2008), ‘The Multiple Effects of Casualties on Public Support for War: An Experimental Approach’, American Political Science Review, 102(1): 95106.CrossRefGoogle Scholar
Gilligan, M.J., Pasquale, B.J. and Samii, C. (2014), ‘Civil War and Social Cohesion: Lab-in-the-Field Evidence from Nepal’, American Journal of Political Science, 58(3): 604619.CrossRefGoogle Scholar
Gelman, A. and Loken, E. (2013), ‘The Garden of Forking Paths: Why Multiple Comparisons Can Be a Problem, Even When There Is No “Fishing Expedition” or “P-Hacking” And the Research Hypothesis Was Posited Ahead of Time’, mimeo, Columbia University.Google Scholar
Gosnell, H.F. (1926), ‘An Experiment in the Stimulation of Voting’, American Political Science Review, 20(4): 869874.CrossRefGoogle Scholar
Gottlieb, J. (2017), ‘Explaining Variation in Broker Strategies: A Lab-in-the-Field Experiment in Senegal’, Comparative Political Studies, 50(11): 15561592.CrossRefGoogle Scholar
Herrera, H., Morelli, M. and Palfrey, T. (2014), ‘Turnout and Power Sharing’, Economic Journal, 124(574): 131162.CrossRefGoogle Scholar
Jerit, J., Barabas, J. and Clifford, S. (2013), ‘Comparing Contemporaneous Laboratory and Field Experiments on Media Effects’, Public Opinion Quarterly, 77(1): 256282.CrossRefGoogle Scholar
Kam, C.D. and Zechmeister, E.J. (2013), ‘Name Recognition and Candidate Support’, American Journal of Political Science, 57(4): 971986.Google Scholar
Kam, C.D., Wilking, J.R. and Zechmeister, E. (2007), ‘“Beyond the Narrow Data Base”: Another Convenience Sample for Experimental Research’, Political Behavior, 29(4): 415440.CrossRefGoogle Scholar
Kanthak, K. and Woon, J. (2015), ‘Women Don’t Run? Election Aversion and Candidate Entry’, American Journal of Political Science, 59(3): 595612.CrossRefGoogle Scholar
King, G., Keohane, R.O. and Verba, S. (1994), Designing Social Inquiry: Scientific Inference in Qualitative Research (Princeton: Princeton University Press).Google Scholar
Labbé St-Vincent, S., Blais, A. and Pilet, J.-B. (2016), ‘The Electoral Sweet Spot in the Lab’, Journal of Experimental Political Science, 3(1): 7583.CrossRefGoogle Scholar
Lau, R.R. and Redlawsk, D.P. (1997), ‘Voting Correctly’, American Political Science Review, 91(3): 585598.CrossRefGoogle Scholar
Levendusky, M.S. (2013), ‘Why Do Partisan Media Polarize Viewers?’, American Journal of Political Science, 57(3): 611623.CrossRefGoogle Scholar
Lijphart, A. (1971), ‘Comparative Politics and the Comparative Methods’, American Political Science Review, 65(3): 682693.CrossRefGoogle Scholar
Lowell, A.L. (1910), ‘The Physiology of Politics’, American Political Science Review, 4(1): 115.CrossRefGoogle Scholar
McCauley, J.F. (2014), ‘The Political Mobilization of Ethnic and Religious Identities in Africa’, American Political Science Review, 108(4): 801816.CrossRefGoogle Scholar
McClendon, G. (2012), ‘Ethics of Using Public Officials as Field Experiment Subjects’, Newsletter of the APSA Experiments Section, 3(1): 1320.Google Scholar
McDermott, R. (2002a), ‘Experimental Methodology in Political Science’, Political Analysis, 10(4): 325342.CrossRefGoogle Scholar
McDermott, R. (2002b), ‘Experimental Methods in Political Science’, Annual Review of Political Science, 5: 3161.CrossRefGoogle Scholar
Morton, R.B. and Williams, K.C. (2010), From Nature to the Lab: The Methodology of Experimental Political Science and the Study of Causality (Cambridge: Cambridge University Press).Google Scholar
Mutz, D.C. and Reeves, B. (2005), ‘The New Videomalaise: Effects of Televised Incivility on Political Trust’, American Political Science Review, 99(1): 115.CrossRefGoogle Scholar
Open Science Collaboration (2015), ‘Estimating the Reproducibility of Psychological Science’, Science, 349(6251): aac4716.CrossRefGoogle Scholar
Palfrey, T.R. (2009), ‘Laboratory Experiments in Political Economy’, Annual Review of Political Science, 12: 379388.CrossRefGoogle Scholar
Przeworski, A. and Teune, H. (1970), The Logic of Comparative Social Inquiry (Oxford: Wiley Interscience).Google Scholar
Ragin, C.C. (1989), The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies (Berkeley: University of California Press).Google Scholar
Sanders, D. (2012), ‘The Effects of Deliberative Polling in an EU-wide Experiment: Five Mechanisms in Search of an Explanation’, British Journal of Political Science, 42(3): 617640.CrossRefGoogle Scholar
Sauermann, J. and Kaiser, A. (2010), ‘Taking Others into Account: Self-interest and Fairness in Majority Decision Making’, American Journal of Political Science, 54(3): 667685.CrossRefGoogle Scholar
Schram, A. (2005), ‘Artificiality: The Tension Between Internal and External Validity in Economic Experiments’, Journal of Economic Methodology, 12(2): 225237.CrossRefGoogle Scholar
Terris, L.G. and Tykocinsky, O.E. (2016), ‘Inaction Inertia in International Negotiations: The Consequences of Missed Opportunities’, British Journal of Political Science, 46(3): 701717.CrossRefGoogle Scholar
White, I., Laird, C.N. and Allen, T.D. (2014), ‘Selling Out? The Politics of Navigating Conflicts between Racial Group Interest and Self-interest’, American Political Science Review, 108(4): 783800.CrossRefGoogle Scholar
Willis, D. (2014), ‘Professors’ Research Project Stirs Political Outrage in Montana’, New York Times, 29 October.Google Scholar
3
Cited by

Save article to Kindle

To save this article to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Putting Politics in the Lab: A Review of Lab Experiments in Political Science
Available formats
×

Save article to Dropbox

To save this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about saving content to Dropbox.

Putting Politics in the Lab: A Review of Lab Experiments in Political Science
Available formats
×

Save article to Google Drive

To save this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you used this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about saving content to Google Drive.

Putting Politics in the Lab: A Review of Lab Experiments in Political Science
Available formats
×
×

Reply to: Submit a response

Please enter your response.

Your details

Please enter a valid email address.

Conflicting interests

Do you have any conflicting interests? *