Skip to main content
×
×
Home

Measure for Measure: An Experimental Test of Online Political Media Exposure

  • Andrew M. Guess (a1)
Abstract

Self-reported measures of media exposure are plagued with error and questions about validity. Since they are essential to studying media effects, a substantial literature has explored the shortcomings of these measures, tested proxies, and proposed refinements. But lacking an objective baseline, such investigations can only make relative comparisons. By focusing specifically on recent Internet activity stored by Web browsers, this article's methodology captures individuals' actual consumption of political media. Using experiments embedded within an online survey, I test three different measures of media exposure and compare them to the actual exposure. I find that open-ended survey prompts reduce overreporting and generate an accurate picture of the overall audience for online news. I also show that they predict news recall at least as well as general knowledge. Together, these results demonstrate that some ways of asking questions about media use are better than others. I conclude with a discussion of survey-based exposure measures for online political information and the applicability of this article's direct method of exposure measurement for future studies.

    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Measure for Measure: An Experimental Test of Online Political Media Exposure
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Measure for Measure: An Experimental Test of Online Political Media Exposure
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Measure for Measure: An Experimental Test of Online Political Media Exposure
      Available formats
      ×
Copyright
References
Hide All
Althaus, S. L., and Tewksbury, D. H. 2007. Toward a new generation of media use measures for the ANES. Report to the Board of Overseers of the ANES.
Bartels, L. M. 1993. Messages received: The political impact of media exposure. American Political Science Review 87(2): 267–85.
Belli, R. F., Traugott, M. W., and Beckmann, M. N. 2001. What leads to voting overreports? Contrasts of overreporters to validated voters and admitted nonvoters in the American National Election Studies. Journal of Official Statistics 17(4): 479–98.
Berinsky, A., Huber, G., and Lenz, G. 2012. Evaluating online labor markets for experimental research: Amazon.com's Mechanical Turk. Political Analysis 20(3): 351–68.
Berinsky, A. J., Margolis, M. F., and Sances, M. W. 2013. Separating the shirkers from the workers? Making sure respondents pay attention on self-administered surveys. American Journal of Political Science.
Burton, S., and Blair, E. 1991. Task conditions, response formulation processes, and response accuracy for behavioral frequency questions in surveys. Public Opinion Quarterly 55(1): 5079.
Dilliplane, S., Goldman, S. K., and Mutz, D. C. 2013. Televised exposure to politics: New measures for a fragmented media environment. American Journal of Political Science 57(1): 236–48.
Gentzkow, M., and Shapiro, J. M. 2011. Ideological segregation online and offline. Quarterly Journal of Economics 126):1799–839.
Gerber, A. S., Gimpel, J. G., Green, D. P., and Shaw, D. R. 2011. How large and long-lasting are the persuasive effects of televised campaign ads? Results from a randomized field experiment. American Political Science Review 105(1): 135–50.
Graber, D. A. 1997. Mass media and American politics. Washington, DC: CQ Press.
Hindman, M. 2008. The myth of digital democracy. Princeton, NJ: Princeton University Press.
Humphreys, M., Sanchez de la Sierra, R., and van der Windt, P. 2013. Fishing, commitment, and communication: A proposal for comprehensive nonbinding research registration. Political Analysis 21(1): 120.
Iyengar, S. 2011. Experimental designs for political communication research: Using new technology and online participant pools to overcome the problem of generalizability. In Sourcebook for political communication research: Methods, measures, and analytical techniques, eds. Bucy, E. P. and Holbert, R. L. New York: Routledge.
Iyengar, S., and Kinder, D. R. 1987. News that matters: Television and American opinion. Chicago: University of Chicago Press.
Krosnick, J. A. 1991. Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology 5(3): 213–36.
LaCour, M. J. 2013. A balanced news diet, not selective exposure: Results from Erie to Arbitron. Paper presented at the Annual Meeting of the American Political Science Association Annual, Chicago.
Lazarsfeld, P. F., Berelson, B., and Gaudet, H. 1944. The people's choice: How the voter makes up his mind in a presidential campaign. New York: Columbia University Press.
Leeper, T. 2013. Crowdsourcing with R and the MTurk API. Political Methodologist 20(2): 27.
Mullainathan, S., and Shleifer, A. 2005. The market for news. American Economic Review 95(4): 1031–53.
Munson, S., Lee, S. Y., and Resnick, P. 2013. Encouraging reading of diverse political viewpoints with a browser widget. International Conference on Weblogs and Social Media.
Mutz, D., and Young, L. 2011. Communication and public opinion. Public Opinion Quarterly 75(5): 1018–44.
Pew Research Center for the People & the Press. 2012. In Changing News Landscape, Even Television is Vulnerable. http://www.people-press.org/2012/09/27/in-changing-news-landscape-even-television-is-vulnerable/(accessed November 24. 2013).
Price, V., and Zaller, J. 1993. Who gets the news? Alternative measures of news reception and their implications for research. Public Opinion Quarterly 57(2): 133–64.
Prior, M. 2009a. The immensely inflated news audience: Assessing bias in self-reported news exposure. Public Opinion Quarterly 73(1): 130–43.
Prior, M. 2009b. Improving media effects research through better measurement of news exposure. Journal of Politics 71(3): 893908.
Prior, M., and Lupia, A. 2008. Money, time, and political knowledge: Distinguishing quick recall and political learning skills. American Journal of Political Science 52(1): 169–83.
Romantan, A., Hornik, R., Price, V., Cappella, J., and Viswanath, K. 2008. A comparative analysis of the performance of alternative measures of exposure. Communication Methods and Measures 2(1–2): 8099.
Smyth, J., Dillman, D., Christian, L., and Stern, M. 2006. Comparing check-all and forced-choice question formats in Web surveys. Public Opinion Quarterly 70(1): 6677.
Sudman, S., and Bradburn, N. M. 1982. Asking questions: A practical guide to questionnaire design. San Francisco: Jossey-Bass.
Sudman, S., Bradburn, N. M., and Schwarz, N. 1996. Thinking about answers: The application of cognitive processes to survey methodology. San Francisco: Jossey-Bass.
Tourangeau, R., Rips, L. J., and Rasinski, K. 2000. The psychology of survey response. Cambridge, UK: Cambridge University Press.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×
MathJax
Type Description Title
PDF
Supplementary materials

Guess supplementary material
Appendix

 PDF (2.1 MB)
2.1 MB

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed