Skip to main content

Reporting Balance Tables, Response Rates and Manipulation Checks in Experimental Research: A Reply from the Committee that Prepared the Reporting Guidelines

  • Alan S. Gerber (a1), Kevin Arceneaux (a2), Cheryl Boudreau (a3), Conor Dowling (a4) and D. Sunshine Hillygus (a5)...
  • In response to commentaries on:
Hide All
Altman, Doug. 2005. Adjustment for Covariate Imbalance. In Encyclopedia of Biostatistics, eds. Armitage, P. and Colton, T.. Chichester, UK: John Wiley.
Barabas, Jason, Jerit, Jennifer, and Paez, Carlos. 2015. “Representative Experiments: Using Registration-Based Sampling to Explore the Generalizability of Causal Effects.” Presented at the 2015 Annual Meeting of the American Association of Public Opinion Researchers, Hollywood, FL.
Broockman, David, Kalla, J., and Aronow, P.. 2015. “Irregularities in LaCour (2014).” Stanford University.
Bruhn, Miriam and McKenzie, David. 2009. “In Pursuit of Balance: Randomization in Practice in Development Field Experiments.” American Economic Journal: Applied Economics 1 (4): 200–32.
Callegaro, Mario and DiSogra, Charles. 2008. “Computing Response Metrics for Online Panels.” Public Opinion Quarterly 72 (5): 10081032.
Callegaro, M., Baker, R., Bethlehem, J., Göritz, A., Krosnick, J. A., and Lavrakas, P. J., eds. 2014. Online Panel Research: A Data Quality Perspective. West Sussex, UK: John Wiley and Sons.
Chang, L. and Krosnick, J. A.. 2009. “National Surveys via RDD Telephone Interviewing vs. the Internet: Comparing Sample Representativeness and Response Quality.” Public Opinion Quarterly 73 (4): 641678.
LaCour, Michael J. and Green, Donald P.. 2014. “When Contact Changes Minds: An Experiment on Transmission of Support for Gay Equality.” Science 346 (6215): 1366–9.
Manski, Charles F. 2007. Identification for Prediction and Decision. Cambridge: Harvard University Press.
Mutz, Diana C. and Pemantle, Robin. 2015. “Standard for Experimental Research: Encouraging a Better Understanding of Experimental Methods.” Journal of Experimental Political Science 2 (2): 192215.
Rubin, Donald B. 2008. “Comment: The Design and Analysis of Gold Standard Randomized Experiments.” The Journal of the American Statistical Association 103 (484): 1350–3.
Schulz, Kenneth F., Altman, Douglas G., and Moher, David. 2010. “CONSORT 2010 Statement: Updated Guidelines for Reporting Parallel Group Randomized Trials.” Annals of Internal Medicine 152 (11): 726–32.
Yeager, David S., Krosnick, Jon A., Chang, LinChiat, Javitz, Harold S., Levendusky, Matthew S., Simpser, Alberto, and Wang, Rui. 2011. “Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and Non-Probability Samples.” Public Opinion Quarterly 75 (4): 709–47.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of Experimental Political Science
  • ISSN: 2052-2630
  • EISSN: 2052-2649
  • URL: /core/journals/journal-of-experimental-political-science
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
Type Description Title
Supplementary materials

Gerber supplementary material
Gerber supplementary material 1

 PDF (410 KB)
410 KB


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed