Skip to main content Accesibility Help

Hierarchical Item Response Models for Analyzing Public Opinion

  • Xiang Zhou (a1)

Opinion surveys often employ multiple items to measure the respondent’s underlying value, belief, or attitude. To analyze such types of data, researchers have often followed a two-step approach by first constructing a composite measure and then using it in subsequent analysis. This paper presents a class of hierarchical item response models that help integrate measurement and analysis. In this approach, individual responses to multiple items stem from a latent preference, of which both the mean and variance may depend on observed covariates. Compared with the two-step approach, the hierarchical approach reduces bias, increases efficiency, and facilitates direct comparison across surveys covering different sets of items. Moreover, it enables us to investigate not only how preferences differ among groups, vary across regions, and evolve over time, but also levels, patterns, and trends of attitude polarization and ideological constraint. An open-source R package, hIRT, is available for fitting the proposed models.

Corresponding author
Hide All

Author’s note: The author thanks Ken Bollen, Bryce Corrigan, Max Goplerud, Gary King, Jonathan Kropko, Jie Lv, Barum Park, Yunkyu Sohn, Yu-Sung Su, Dustin Tingley, Yu Xie, Teppei Yamamoto, and two anonymous reviewers for helpful comments on previous versions of this work. Replication data are available in Zhou (2018b).

Contributing Editor: Jeff Gill

Hide All
Abramowitz, A. 2010. The Disappearing Center: Engaged citizens, Polarization, and American Democracy . Yale University Press.
Abramowitz, A. I., and Saunders, K. L.. 2008. “Is Polarization a Myth?.” The Journal of Politics 70(2):542555.
Agresti, A. 2013. Categorical Data Analysis . Hoboken, NJ: John Wiley & Sons.
Aitkin, M. 1987. “Modelling Variance Heterogeneity in Normal Regression Using Glim.” Applied Statistics 36(3):332339.
Aldrich, J. H., and McKelvey, R. D.. 1977. “A Method of Scaling with Applications to the 1968 and 1972 Presidential Elections.” American Political Science Review 71(1):111130.
Andrich, D. 1978. “A Rating Formulation for Ordered Response Categories.” Psychometrika 43(4):561573.
Ansolabehere, S., Rodden, J., and Snyder, J. M.. 2008. “The Strength of Issues: Using Multiple Measures to Gauge Preference Stability, Ideological Constraint, and Issue Voting.” American Political Science Review 102(2):215232.
Armstrong, D. A., Bakker, R., Carroll, R., Hare, C., Poole, K. T., and Rosenthal, H.. 2014. Analyzing Spatial Models of Choice and Judgment with R . Boca Raton, FL: Chapman and Hall/CRC.
Bafumi, J., Gelman, A., Park, D. K., and Kaplan, N.. 2005. “Practical Issues in Implementing and Understanding Bayesian Ideal Point Estimation.” Political Analysis 13:171187.
Bafumi, J., and Herron, M. C.. 2010. “Leapfrog Representation and Extremism: A Study of American Voters and their Members in Congress.” American Political Science Review 104(3):519542.
Bailey, M. 2001. “Ideal Point Estimation with a Small Number of Votes: A Random-effects Approach.” Political Analysis 9(3):192210.
Bailey, M., and Chang, K. H.. 2001. “Comparing Presidents, Senators, and Justices: Interinstitutional Preference Estimation.” Journal of Law, Economics, and Organization 17(2):477506.
Bailey, M. A. 2007. “Comparable Preference Estimates Across Time and Institutions for the Court, Congress, and Presidency.” American Journal of Political Science 51(3):433448.
Baker, F. B., and Kim, S.-H.. 2004. Item Response Theory: Parameter Estimation Techniques . CRC Press.
Baldassarri, D., and Gelman, A.. 2008. “Partisans Without Constraint: Political Polarization and Trends in American Public Opinion.” American Journal of Sociology 114(2):408446.
Bock, R. D. 1972. “Estimating Item Parameters and Latent Ability When Responses are Scored in Two or More Nominal Categories.” Psychometrika 37(1):2951.
Bock, R. D., and Aitkin, M.. 1981. “Marginal Maximum Likelihood Estimation of Item Parameters: Application of an EM Algorithm.” Psychometrika 46(4):443459.
Broockman, D. E., and Butler, D. M.. 2017. “The Causal Effects of Elite Position-Taking on Voter Attitudes: Field Experiments with Elite Communication.” American Journal of Political Science 61(1):208221.
Carsey, T. M., and Layman, G. C.. 2006. “Changing Sides or Changing Minds? Party Identification and Policy Preferences in the American Electorate.” American Journal of Political Science 50(2):464477.
Caughey, D., Dunham, J., and Warshaw, C.. 2018. “The Ideological Nationalization of Partisan Subconstituencies in the American States.” Public Choice 176(1):133151.
Caughey, D., and Warshaw, C.. 2015. “Dynamic Estimation of Latent Opinion Using a Hierarchical Group-Level IRT Model.” Political Analysis 23(2):197211.
Caughey, D., and Warshaw, C.. 2016. “The Dynamics of State Policy Liberalism, 1936–2014.” American Journal of Political Science 60(4):899913.
Clinton, J., Jackman, S., and Rivers, D.. 2004. “The Statistical Analysis of Roll Call Data.” American Political Science Review 98(02):355370.
Converse, P. 1964. “The Nature of Belief Systems in Mass Publics.” In Ideology and Discontent , edited by David, A., 206261. New York: Free Press.
Cook, R. D., and Weisberg, S.. 1983. “Diagnostics for Heteroscedasticity in Regression.” Biometrika 70(1):110.
Delli Carpini, M. X., and Keeter, S.. 1996. What Americans Know about Politics and Why It Matters . New Haven, CT: Yale University Press.
DiMaggio, P., Evans, J., and Bryson, B.. 1996. “Have American’s Social Attitudes Become More Polarized?.” American Journal of Sociology 102(3):690755.
Evans, J. H. 2003. “Have Americans’ Attitudes Become More Polarized? - An Update.” Social Science Quarterly 84(1):7190.
Fiorina, M. P., Abrams, S. A., and Pope, J. C.. 2008. “Polarization in the American Public: Misconceptions and Misreadings.” The Journal of Politics 70(2):556560.
Fiorina, M. P., and Abrams, S. J.. 2012. Disconnect: The Breakdown of Representation in American Politics . Norman, OK: University of Oklahoma Press.
Fiorina, M. P., Abrams, S. J., and Pope, J.. 2006. Culture war?: The Myth of a Polarized America . New York: Longman Publishing Group.
Hare, C., Armstrong, D. A., Bakker, R., Carroll, R., and Poole, K. T.. 2015. “Using Bayesian Aldrich–McKelvey Scaling to Study Citizens’ Ideological Preferences and Perceptions.” American Journal of Political Science 59(3):759774.
Hill, S. J., and Tausanovitch, C.. 2015. “A Disconnect in Representation? Comparison of Trends in Congressional and Public Polarization.” The Journal of Politics 77(4):10581075.
Hoff, P. D., and Niu, X.. 2012. “A Covariance Regression Model.” Statistica Sinica 22:729753.
Hurwitz, J., and Peffley, M.. 1987. “How are Foreign Policy Attitudes Structured? A Hierarchical Model.” American Political Science Review 81(4):10991120.
Imai, K., Lo, J., and Olmsted, J.. 2016. “Fast Estimation of Ideal Points with Massive Data.” American Political Science Review 110(4):631656.
Inglehart, R., and Welzel, C.. 2005. Modernization, Cultural change, and Democracy: The Human Development Sequence . New York: Cambridge University Press.
Jackson, J. E. 1983. “The Systematic Beliefs of the Mass Public: Estimating Policy Preferences with Survey Data.” The Journal of Politics 45(4):840865.
Jacoby, W. G. 2006. “Value Choices and American Public Opinion.” American Journal of Political Science 50(3):706723.
Jessee, S. 2016. “How Can We Estimate the Ideology of Citizens and Political Elites on the Same Scale?.” American Journal of Political Science 60(4):11081124.
Jessee, S. A. 2009. “Spatial Voting in the 2004 Presidential Election.” American Political Science Review 103(1):5981.
Jöreskog, K. G., and Goldberger, A. S.. 1975. “Estimation of a Model with Multiple Indicators and Multiple Causes of a Single Latent Variable.” Journal of the American Statistical Association 70(351a):631639.
Judd, C. M., and Milburn, M. A.. 1980. “The Structure of Attitude Systems in the General Public: Comparisons of a Structural Equation Model.” American Sociological Review 45(4):627643.
King, G., Murray, C. J., Salomon, J. A., and Tandon, A.. 2004. “Enhancing the Validity and Cross-cultural Comparability of Measurement in Survey Research.” American Political Science Review 98(1):191207.
Lauderdale, B. E. 2010. “Unpredictable Voters in Ideal Point Estimation.” Political Analysis 18(2):151171.
Layman, G. C., and Carsey, T. M.. 2002. “Party Polarization and “Conflict Extension” in the American Electorate.” American Journal of Political Science 46(4):786802.
Layman, G. C., Carsey, T. M., and Horowitz, J. M.. 2006. “Party Polarization in American Politics: Characteristics, Causes, and Consequences.” Annual Review of Political Science 9:83110.
Lewis, J. B. 2001. “Estimating Voter Preference Distributions from Individual-level Voting Data.” Political Analysis 9(3):275297.
Londregan, J. 2000. “Estimating Legislator’s Preferred Points.” Political Analysis 8(1):3556.
Lord, F. M., Novick, M. R., and Birnbaum, A.. 1968. Statistical Theories of Mental Test Scores . Boston, MA: Addison-Wesley.
Martin, A. D., and Quinn, K. M.. 2002. “Dynamic Ideal Point Estimation via Markov Chain Monte Carlo for the U.S. Supreme Court, 1953–1999.” Political Analysis 10(2):134153.
Martin, A. D., Quinn, K. M., and Park, J. H.. 2011. “Mcmcpack: Markov Chain Monte Carlo in R.” Journal of Statistical Software 42(9):121.
Masters, G. N. 1982. “A Rasch Model for Partial Credit Scoring.” Psychometrika 47(2):149174.
McCarty, N., Poole, K. T., and Rosenthal, H.. 2016. Polarized America: The Dance of Ideology and Unequal Riches . Cambridge, MA: MIT Press.
Mendelberg, T., McCabe, K. T., and Thal, A.. 2017. “College Socialization and the Economic Views of Affluent Americans.” American Journal of Political Science 61(3):606623.
Mislevy, R. J. 1987. “Exploiting Auxiliary Infornlation about Examinees in the Estimation of Item Parameters.” Applied Psychological Measurement 11(1):8191.
Mouw, T., and Sobel, M. E.. 2001. “Culture Wars and Opinion Polarization: The Case of Abortion.” American Journal of Sociology 106(4):913943.
Muraki, E. 1992. “A Generalized Partial Credit Model: Application of an EM Algorithm.” Applied Psychological Measurement 16(2):159176.
Muthén, B. 1984. “A General Structural Equation Model with Dichotomous, Ordered Categorical, and Continuous Latent Variable Indicators.” Psychometrika 49(1):115132.
Norpoth, H., and Lodge, M.. 1985. “The Difference Between Attitudes and Nonattitudes in the Mass Public: Just Measurements.” American Journal of Political Science 29(2):291307.
Park, D. K., Gelman, A., and Bafumi, J.. 2004. “Bayesian Multilevel Estimation with Poststratification: State-level Estimates from National Polls.” Political Analysis 12(4):375385.
Peterson, B., and Harrell, F. E.. 1990. “Partial Proportional Odds Models for Ordinal Response Variables.” Applied statistics 39(2):205217.
Poole, K. T., and Rosenthal, H.. 1991. “Patterns of Congressional Voting.” American Journal of Political Science 35(1):228278.
Rasch, G. 1960. Probabilistic Models for Some Intelligence and Achievement Tests . Copenhagen: Danish Institute for Educational Research.
Rasch, G. 1961. “On General Laws and the Meaning of Measurement in Psychology.” In Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, vol. 4 , 321333. University of California Press Berkeley.
Rueda, D., and Stegmueller, D.. 2016. “The Externalities of Inequality: Fear of Crime and Preferences for Redistribution in Western Europe.” American Journal of Political Science 60(2):472489.
Samejima, F.1969. “Estimation of Latent Ability Using a Response Pattern of Graded Scores” (Psychometric Monograph No. 17). Richmond, VA: Psychometric Society. Retrieved from
Tausanovitch, C., and Warshaw, C.. 2013. “Measuring Constituent Policy Preferences in Congress, State Legislatures, and Cities.” The Journal of Politics 75(2):330342.
Treier, S., and Hillygus, D. S.. 2009. “The Nature of Political Ideology in the Contemporary Electorate.” Public Opinion Quarterly 73(4):679703.
Treier, S., and Jackman, S.. 2008. “Democracy as a Latent Variable.” American Journal of Political Science 52(1):201217.
Verbyla, A. P. 1993. “Modelling Variance Heterogeneity: Residual Maximum Likelihood and Diagnostics.” Journal of the Royal Statistical Society. Series B (Methodological) 55(2):493508.
Western, B., and Bloome, D.. 2009. “Variance Function Regressions for Studying Inequality.” Sociological Methodology 39(1):293326.
Zaller, J. 1992. The Nature and Origins of Mass Opinion . New York: Cambridge University Press.
Zhou, X. 2014. “Increasing Returns to Education, Changing Labor Force Structure, and the Rise of Earnings Inequality in Urban China, 1996–2010.” Social Forces 93(2):429455.
Zhou, X.2018a. hIRT: Hierarchical Item Response Theory Models. R package version 0.1.3, available at the Comprehensive R Archive Network (CRAN).
Zhou, X.2018b. “Replication Data for: Hierarchical Item Response Models for Analyzing Public Opinion.”, Harvard Dataverse, V1.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary materials

Zhou supplementary material
Zhou supplementary material 1

 Unknown (287 KB)
287 KB


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed