Skip to main content
×
Home
    • Aa
    • Aa

Improving Predictions using Ensemble Bayesian Model Averaging

  • Jacob M. Montgomery (a1), Florian M. Hollenbach (a2) and Michael D. Ward (a2)
Abstract

We present ensemble Bayesian model averaging (EBMA) and illustrate its ability to aid scholars in the social sciences to make more accurate forecasts of future events. In essence, EBMA improves prediction by pooling information from multiple forecast models to generate ensemble predictions similar to a weighted average of component forecasts. The weight assigned to each forecast is calibrated via its performance in some validation period. The aim is not to choose some “best” model, but rather to incorporate the insights and knowledge implicit in various forecasting efforts via statistical postprocessing. After presenting the method, we show that EBMA increases the accuracy of out-of-sample forecasts relative to component models in three applied examples: predicting the occurrence of insurgencies around the Pacific Rim, forecasting vote shares in U.S. presidential elections, and predicting the votes of U.S. Supreme Court Justices.

Copyright
Corresponding author
e-mail: michael.d.ward@duke.edu (corresponding author)
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

J. S. Armstrong 2001. Combining forecasts. In Principles of forecasting: A handbook for researchers and practitioners, ed. J. S. Amstrong Norwell, MA: Kluwer Academic.

J. E. Berg , F. D. Nelson , and T. A. Rietz 2008. Prediction market accuracy in the long run. International Journal of Forecasting 24: 285300.

P. T. Brandt , M. Colaresi , and J. R. Freeman 2008. The dynamics of reciprocity, accountability, and credibility. Journal of Conflict Resolution 52: 343–74.

G. W. Brier 1950. Verification of forecasts expressed in terms of probability. Monthly Weather Review 78: 13.

W. A. Brock , S. N. Durlauf , and K. D. West 2007. Model uncertainty and policy evaluation: Some theory and empirics. Journal of Econometrics 136: 629–64.

B. Bueno de Mesquita 2011. A new model for predicting policy choices: Preliminary tests. Conflict Management and Peace Science 28: 6585.

J. E. Campbell , and K. A. Wink 1990. Trial-heat forecasts of the presidential vote. American Politics Research 18: 251–69.

A. P. Dawid 1982. The well-calibrated Bayesian (with discussion). Journal of the American Statistical Association 77: 605–13.

J. R. Freeman , and B. L. Job 1979. Scientific forecasts in international relations: Problems of definition and epistemology. International Studies Quarterly 23: 113–43.

D. A. Hibbs 2000. Bread and peace voting in U.S. presidential elections. Public Choice 104: 149–80.

B. Jerome , V. Jerome , and M. S. Lewis-Beck 1999. Polls fail in France: Forecasts of the 1997 legislative election. International Journal of Forecasting 15: 163–74.

B. Jerome , V. Jerome , and M. S. Lewis-Beck 1999. Polls fail in France: Forecasts of the 1997 legislative election. International Journal of Forecasting 15: 163–74.

D. E. Klein , and R. J. Hume 2003. Fear of reversal as an explanation of lower court compliance. Law & Society Review 37: 579606.

T. C. McCandless , S. E. Haupt , and G. S. Young 2011. The effects of imputing missing data on ensemble temperature forecasts. Journal of Computers 6: 162–71.

T. C. McCandless , S. E. Haupt , and G. S. Young 2011. The effects of imputing missing data on ensemble temperature forecasts. Journal of Computers 6: 162–71.

S.-K. Min , and A. Hense 2006. A Bayesian approach to climate model evaluation and multi-model averaging with an application to global mean surface temperatures from IPCC AR4 coupled climate models. Geophysical Research Letters 33: L08708.

M. D. Muhlbaier , and R. Polikar 2007. An ensemble approach for incremental learning in nonstationary environments. Multiple Classifier Systems 4472: 490500.

S. E. Page , L. M. Sander , and C. M. Schneider-Mizell 2007. Conformity and dissonance in generalized voter models. Journal of Statistical Physics 128: 1279–87.

S. E. Page , L. M. Sander , and C. M. Schneider-Mizell 2007. Conformity and dissonance in generalized voter models. Journal of Statistical Physics 128: 1279–87.

A. E. Raftery , and Y. Zheng 2003. Long-run performance of Bayesian model averaging. Journal of the American Statistical Association 98: 931–8.

A. Tomas 2011. A dynamic logistic multiple classifier system for online classification. Working paper. http://www.stats.ox.ac.uk/tomas/html_links/T2011.pdf (accessed June 1, 2011).

J. E. Vincent 1980. Scientific prediction versus crystal ball gazing: Can the unknown be known? International Studies Quarterly 24: 450–4.

J. A. Vrugt , M. P. Clark , C. G. Diks , Q. Duan , and B. A. Robinson 2006. Multi-objective calibration of forecast ensembles using Bayesian model averaging. Geophysical Research Letters 33: L19817.

J. A. Vrugt , C. G. Diks , and M. P. Clark 2008. Ensemble Bayesian model averaging using Markov chain Monte Carlo sampling. Environmental Fluid Mechanics 8: 579–95.

J. H. Wright 2008. Bayesian model averaging and exchange rate forecasts. Journal of Econometrics 146: 329–41.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Political Analysis
  • ISSN: 1047-1987
  • EISSN: 1476-4989
  • URL: /core/journals/political-analysis
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×
MathJax

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 13 *
Loading metrics...

Abstract views

Total abstract views: 79 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 29th May 2017. This data will be updated every 24 hours.