Skip to main content
×
Home
    • Aa
    • Aa

Bayesian Model Averaging: Theoretical Developments and Practical Applications

  • Jacob M. Montgomery (a1) and Brendan Nyhan (a2)
Abstract

Political science researchers typically conduct an idiosyncratic search of possible model configurations and then present a single specification to readers. This approach systematically understates the uncertainty of our results, generates fragile model specifications, and leads to the estimation of bloated models with too many control variables. Bayesian model averaging (BMA) offers a systematic method for analyzing specification uncertainty and checking the robustness of one's results to alternative model specifications, but it has not come into wide usage within the discipline. In this paper, we introduce important recent developments in BMA and show how they enable a different approach to using the technique in applied social science research. We illustrate the methodology by reanalyzing data from three recent studies using BMA software we have modified to respect statistical conventions within political science.

Copyright
Corresponding author
e-mail: bnyhan@umich.edu (corresponding author)
Footnotes
Hide All

Authors' note: A poster based on an earlier version of this paper was presented at the Society for Political Methodology Summer Conference, State College, PA, July 18–21, 2007. We thank James Adams, Benjamin G. Bishin, David W. Brady, Brandice Canes-Wrone, John F. Cogan, Jay K. Dow, James D. Fearon, and David D. Laitin for sharing their data and providing assistance with our replications of their work. We also thank John H. Aldrich, Michael C. Brady, Merlise Clyde, Josh Cutler, Scott de Marchi, Andrew Gelman, Daniel J. Lee, Efrén O. Pérez, Jill Rickershauser, David Sparks, Michael W. Tofias, T. Camber Warren, the editors, and two anonymous reviewers for helpful comments. All remaining errors are, of course, our own. Replication materials are available on the Political Analysis Web site.

Footnotes
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

Christopher H. Achen 2005. Let's put garbage-can regressions and garbage-can probits where they belong. Conflict Management and Peace Science 22: 327–39.

James Adams , Benjamin G. Bishin , and Jay K. Dow 2004. Representation in congressional campaigns: Evidence for discounting/directional voting in U.S. Senate elections. Journal of Politics 66: 348–73.

James Adams , and Samuel Merrill . 1999. Modeling party strategies and policy representation in multiparty elections: Why are strategies so extreme? American Journal of Political Science 43: 765–91.

Hirotugu Akaike . 1974. A new look at the statistical model identification. IEEE Transactions on Automatic Control 19: 716–23.

Larry M. Bartels 1997. Specification uncertainty and model averaging. American Journal of Political Science 41: 641–74.

Thomas Brambor , William Roberts Clark , and Matthew Golder . 2006. Understanding interaction models: Improving empirical analyses. Political Analysis 14: 6382.

Bear Braumoeller . 2004. Hypothesis testing and multiplicative interaction terms. International Organization 58: 807–20.

Brandice Canes-Wrone , David W. Brady , and John F. Cogan 2002. Out of step, out of office: Electoral accountability and House members’ voting. American Political Science Review 96: 127–40.

Kevin A. Clarke 2001. Testing nonnested models of international relations: Reevaluating realism. American Journal of Political Science 45: 724–44.

Kevin A. Clarke 2005. The phantom menace: Omitted variable bias in econometric research. Conflict Management and Peace Science 22: 341–52.

Daniel J. Elazar 1972. American federalism: A view from the states. 2nd ed. New York: Crowell.

James D. Fearon , and David D. Laitin 2003b. Ethnicity, insurgency, and civil war. American Political Science Review 97: 7590.

Carmen Fernandez , Eduardo Ley , and Mark F. J. Steel 2001. Model uncertainty in cross-country growth regressions. Journal of Applied Econometrics 16: 563–76.

John Geer , and Richard R. Lau 2006. Filling in the blanks: A new method for estimating campaign effects. British Journal of Political Science 36: 269–90.

Andrew Gelman , and Donald B. Rubin 1995. Avoiding model selection in Bayesian social research. Sociological Methodology 25: 165–73.

Alan Gerber , and Neil Malhotra . 2008. Do statistical reporting standards affect what is published? Publication bias in two leading political science journals. Quarterly Journal of Political Science 3: 313–26.

Jeff Gill . 1999. The insignificance of null hypothesis significance testing. Political Research Quarterly 52: 647–74.

Jeff Gill . 2004. Introduction to the special issue. Political Analysis 12: 323–37.

Frank E. Harrell 2001. Regression modeling strategies. New York: Springer.

Daniel E. Ho , Kosuke Imai , Gary King , and Elizabeth A. Stuart 2007. Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Political Analysis 15: 199236.

Kosuke Imai , and Gary King . 2004. Did illegal overseas absentee ballots decide the 2000 U.S. presidential election? Perspectives on Politics 2: 537–49.

Kosuke Imai , and Gary King . 2004. Did illegal overseas absentee ballots decide the 2000 U.S. presidential election? Perspectives on Politics 2: 537–49.

Torben Iversen . 1994. Political leadership and representation in west European democracies: A test of three models of voting. American Journal of Political Science 38: 4574.

Robert W. Jackman 1987. The politics of economic growth in the industrial democracies, 1974–80: Leftist strength or North Sea oil? Journal of Politics 49: 242–56.

Robert W. Jackman 1987. The politics of economic growth in the industrial democracies, 1974–80: Leftist strength or North Sea oil? Journal of Politics 49: 242–56.

Harold Jeffreys . 1935. Some tests of significance, treated by the theory of probability. Proceedings of the Cambridge Philosophical Society 31: 203–22.

Robert E. Kass , and Adrian E. Raftery 1995. Bayes factors. Journal of the American Statistical Association 90: 773–95.

Gary King , and Langche Zeng . 2006. The dangers of extreme counterfactuals. Political Analysis 14: 131–59.

Jouni Kuha . 2004. AIC and BIC: Comparisons of assumptions and performance. Sociological Methods Research 33: 188229.

Peter Lange , and Geoffrey Garrett . 1985. The politics of growth: Strategic interaction and economic performance in the advanced industrial democracies, 1974–1980. Journal of Politics 47: 792827.

Feng Liang , Rui Paulo , German Molina , Merlise A. Clyde , and Jim O. Berger 2008. Mixtures of g-priors for Bayesian variable selection. Journal of the American Statistical Association 103: 410–23.

Feng Liang , Rui Paulo , German Molina , Merlise A. Clyde , and Jim O. Berger 2008. Mixtures of g-priors for Bayesian variable selection. Journal of the American Statistical Association 103: 410–23.

David Madigan , and Adrian E. Raftery 1994. Model selection and accounting for model uncertainty in graphical models using Occam's Window. Journal of the American Statistical Association 89: 1535–46.

Samuel Merrill , and Bernard Grofman . 1999. A unified theory of voting: Directional and proximity spatial models. New York: Cambridge University Press.

Knashawn H. Morales , Joseph G. Ibrahim , Chien-Jen Chen , and Louise M. Ryan 2006. Bayesian model averaging with applications to benchmark dose estimation for arsenic in drinking water. Journal of the American Statistical Association 101: 917.

Adrian E. Raftery 1995. Bayesian model selection in social research. Sociological Methodology 25: 111–63.

David L. Weakliem 1999. A critique of the Bayesian information criterion for model selection. Sociological Methods & Research 27: 359–97.

David L. Weakliem 1999. A critique of the Bayesian information criterion for model selection. Sociological Methods & Research 27: 359–97.

B.A. Wintle , M.A. McCarthy , C. T. Volinsky , and R. P. Kavanagh 2003. The use of Bayesian model averaging to better represent uncertainty in ecological models. Conservation Biology 17: 1579–90.

Ka Yee Yeung , Roger E. Bumgarner , and Adrian E. Raftery 2005. Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data. Bioinformatics 21: 2394–402.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×
MathJax

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 14 *
Loading metrics...

Abstract views

Total abstract views: 46 *
Loading metrics...

* Views captured on Cambridge Core between 4th January 2017 - 22nd June 2017. This data will be updated every 24 hours.