Hostname: page-component-848d4c4894-pftt2 Total loading time: 0 Render date: 2024-05-18T08:00:21.627Z Has data issue: false hasContentIssue false
  • English
  • Français

LARGE SAMPLE JUSTIFICATIONS FOR THE BAYESIAN EMPIRICAL LIKELIHOOD

Published online by Cambridge University Press:  05 December 2022

Naoya Sueishi Open the ORCID record for Naoya Sueishi [Opens in a new window]
Naoya Sueishi*
Affiliation:
Kobe University
*
Address correspondence to Naoya Sueishi, Graduate School of Economics, Kobe University, 2-1 Rokkodai-cho, Nada-ku, Kobe, Hyogo 657-8501, Japan; e-mail: sueishi@econ.kobe-u.ac.jp.
Get access Rights & Permissions [Opens in a new window]

Abstract

This study investigates the asymptotic properties of the Bayesian empirical likelihood (BEL), which uses the empirical likelihood as an alternative to a parametric likelihood for Bayesian inference. We establish two asymptotic equivalence results based on the Bernstein–von Mises (BvM) theorem by introducing a new formulation of the moment restriction model. First, the limiting posterior distribution of the BEL is the same as that of a parametric Bayesian method that uses the likelihood of a least favorable model of the moment restriction model. Second, the limiting posterior distribution is also the same as that of a semiparametric Bayesian method that places priors on both a finite-dimensional parameter of interest and an infinite-dimensional nuisance parameter. Because parametric and semiparametric Bayesian methods are legitimate Bayesian procedures, the equivalence results provide a large sample justification for the BEL as a Bayesian inference method. Moreover, the BvM theorem provides a frequentist justification for BEL posterior inference.

Type
MISCELLANEA
Information
Econometric Theory , First View , pp. 1 - 31
Copyright
© The Author(s), 2022. Published by Cambridge University Press.

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

I would like to thank Patrik Guggenberger and two anonymous referees for their comments and suggestions. I would also like to thank Mototsugu Shintani, Kohtaro Hitomi, Yoshihiko Nishiyama, and Takahide Yanagi for their comments. This research was supported by JSPS KAKENHI Grant Number 18K01547.

References

REFERENCES

Andrews, I. & Mikusheva, A. (2022) Optimal decision rules for weak GMM. Econometrica 90, 715–748.10.3982/ECTA18678CrossRefGoogle Scholar
Bedoui, A. & Lazar, N.A. (2020) Bayesian empirical likelihood for ridge and lasso regressions. Computational Statistics and Data Analysis 145, 106917.10.1016/j.csda.2020.106917CrossRefGoogle Scholar
Begun, J.M., Hall, W.J., Huang, W.-M., & Wellner, J.A. (1983) Information and asymptotic efficiency in parametric-nonparametric models. Annals of Statistics 11, 432–452.10.1214/aos/1176346151CrossRefGoogle Scholar
Bertail, P. (2006) Empirical likelihood in some semiparametric models. Bernoulli 12, 299–331.10.3150/bj/1145993976CrossRefGoogle Scholar
Bickel, P.J. & Kleijn, J.K. (2012) The semiparametric Bernstein–von Mises theorem. Annals of Statistics 40, 206–237.10.1214/11-AOS921CrossRefGoogle Scholar
Bornn, L., Shephard, N., & Solgi, R. (2019) Moment conditions and Bayesian non-parametrics. Journal of the Royal Statistical Society, Series B 81, 5–43.10.1111/rssb.12294CrossRefGoogle Scholar
Borwein, J.M. & Lewis, A.S. (1991) Duality relationships for entropy-like minimization problems. SIAM Journal on Control and Optimization 29, 325–338.10.1137/0329017CrossRefGoogle Scholar
Chae, M. (2015) The semiparametric Bernstein–von Mises theorem for models with symmetric error. PhD thesis, Seoul National University.Google Scholar
Chamberlain, G. (1987) Asymptotic efficiency in estimation with conditional moment restrictions. Journal of Econometrics 34, 305–334.10.1016/0304-4076(87)90015-7CrossRefGoogle Scholar
Chamberlain, G. & Imbens, G.W. (2003) Nonparametric applications of Bayesian inference. Journal of Business & Economic Statistics 21, 12–18.10.1198/073500102288618711Google Scholar
Chaudhuri, S., Mondal, D., & Yin, T. (2017) Hamiltonian Monte Carlo sampling in Bayesian empirical likelihood computation. Journal of the Royal Statistical Society, Series B 79, 293–320.10.1111/rssb.12164CrossRefGoogle Scholar
Chen, X., Hong, H., & Shum, M. (2007) Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models. Journal of Econometrics 141, 109–140.10.1016/j.jeconom.2007.01.010CrossRefGoogle Scholar
Cheng, Y. & Zhao, Y. (2019) Bayesian jackknife empirical likelihood. Biometrika 106, 981–988.10.1093/biomet/asz031CrossRefGoogle Scholar
Chernozhukov, V. & Hong, H. (2003) An MCMC approach to classical estimation. Journal of Econometrics 115, 293–346.10.1016/S0304-4076(03)00100-3CrossRefGoogle Scholar
Chib, S., Shin, M., & Simoni, A. (2018) Bayesian estimation and comparison of moment condition models. Journal of the American Statistical Association 113, 1656–1668.10.1080/01621459.2017.1358172Google Scholar
Csiszár, I. (1995) Generalized projections for non-negative functions. Acta Mathematica Hungarica 68, 161–185.10.1007/BF01874442Google Scholar
DiCiccio, T.J. & Romano, J.P. (1990) Nonparametric confidence limits by resampling methods and least favorable families. International Statistical Review 58, 59–76.10.2307/1403474CrossRefGoogle Scholar
Dovonon, P. & Atchadé, Y.F. (2020) Efficiency bounds for semiparametric models with singular score functions. Econometric Reviews 39, 612–648.10.1080/07474938.2019.1701809Google Scholar
Fang, K.-T. & Mukerjee, R. (2006) Empirical-type likelihoods allowing posterior credible sets with frequentist validity: Higher-order asymptotics. Biometrika 93, 723–733.10.1093/biomet/93.3.723CrossRefGoogle Scholar
Fernández-Villaverde, J. (2010) The econometrics of DSGE models. SERIEs 1, 3–49.10.1007/s13209-009-0014-7CrossRefGoogle Scholar
Florens, J. & Simoni, A. (2021) Gaussian processes and Bayesian moment estimation. Journal of Business & Economic Statistics 39, 482–492.10.1080/07350015.2019.1668799Google Scholar
Ghosal, S. & van der Vaart, A. (2017) Fundamentals of Nonparametric Bayesian Inference . Cambridge University Press.10.1017/9781139029834CrossRefGoogle Scholar
Hansen, L.P. (1982) Large sample properties of generalized method of moments estimators. Econometrica 50, 1029–1054.10.2307/1912775CrossRefGoogle Scholar
Imbens, G.W., Spady, R.H., & Johnson, P. (1998) Information theoretic approaches to inference in moment condition models. Econometrica 66, 333–357.10.2307/2998561CrossRefGoogle Scholar
Kim, J.-Y. (2002) Limited information likelihood and Bayesian analysis. Journal of Econometrics 107, 175–193.Google Scholar
Kitamura, Y. (2007) Empirical likelihood methods in econometrics: Theory and practice. In Blundell, R., Newey, W. K., & Persson, T. (eds.), Advances in Economics and Econometrics , pp. 174–237. Cambridge University Press.Google Scholar
Kitamura, Y. & Otsu, T. (2011) Bayesian analysis of moment condition models using nonparametric priors. Unpublished Manuscript, Yale University.Google Scholar
Kitamura, Y. & Stutzer, M. (1997) An information-theoretic alternative to generalized method of moments estimation. Econometrica 65, 861–874.10.2307/2171942CrossRefGoogle Scholar
Kleijn, B.J.K. & van der Vaart, A.W. (2006) Misspecification in infinite-dimensional Bayesian statistics. Annals of Statistics 34, 837–877.10.1214/009053606000000029CrossRefGoogle Scholar
Kleijn, B.J.K. & van der Vaart, A.W. (2012) The Bernstein–von-Mises theorem under misspecification. Electronic Journal of Statistics 6, 354–381.10.1214/12-EJS675CrossRefGoogle Scholar
Komunjer, I. & Ragusa, G. (2016) Existence and characterization of conditional density projections. Econometric Theory 32, 947–987.10.1017/S0266466615000158CrossRefGoogle Scholar
Lazar, N.A. (2003) Bayesian empirical likelihood. Biometrika 90, 319–326.10.1093/biomet/90.2.319CrossRefGoogle Scholar
Lehmann, E.L. & Casella, G. (1998) Theory of Point Estimation . Springer.Google Scholar
Monahan, J.F. & Boos, D.D. (1992) Proper likelihood for Bayesian analysis. Biometrika 79, 271–278.CrossRefGoogle Scholar
Newey, W.K. (1994) The asymptotic variance of semiparametric estimators. Econometrica 62, 1349–1382.10.2307/2951752CrossRefGoogle Scholar
Newey, W.K. & Smith, R.J. (2004) Higher order properties of GMM and generalized empirical likelihood estimator. Econometrica 72, 219–255.10.1111/j.1468-0262.2004.00482.xCrossRefGoogle Scholar
Owen, A.B. (1990) Empirical likelihood ratio confidence regions. Annals of Statistics 18, 90–120.CrossRefGoogle Scholar
Owen, A.B. (2001) Empirical Likelihood . Chapman & Hall/CRC.Google Scholar
Pollard, D. (2010) Hellinger differentiability. http://www.stat.yale.edu/~pollard/Courses/618.fall2010/Handouts/prelim_version_DQM.pdf.Google Scholar
Qin, J. & Lawless, J. (1994) Empirical likelihood and generalized estimating equations. Annals of Statistics 22, 300–325.CrossRefGoogle Scholar
Ragusa, G. (2007) Bayesian Likelihoods for Moment Condition Models . University of California.Google Scholar
Rubin, D.B. (1981) The Bayesian bootstrap. Annals of Statistics 9, 130–134.10.1214/aos/1176345338CrossRefGoogle Scholar
Schennach, S.M. (2005) Bayesian exponentially tilted empirical likelihood. Biometrika 92, 31–46.10.1093/biomet/92.1.31CrossRefGoogle Scholar
Schennach, S.M. (2007) Point estimation with exponentially tilted empirical likelihood. Annals of Statistics 35, 634–672.10.1214/009053606000001208CrossRefGoogle Scholar
Severini, T.A. (1999) On the relationship between Bayesian and non-Bayesian elimination of nuisance parameters. Statistica Sinica 9, 713–724.Google Scholar
Severini, T.A. & Tripathi, G. (2001) A simplified approach to computing efficiency bounds in semiparametric models. Journal of Econometrics 2001, 23–66.10.1016/S0304-4076(00)00090-7CrossRefGoogle Scholar
Shin, M. (2015) Bayesian GMM. PhD thesis, University of Pennsylvania.Google Scholar
Smith, R.J. (1997) Alternative semi-parametric likelihood approaches to generalised method of moments estimation. Economic Journal 107, 503–519.10.1111/j.0013-0133.1997.174.xCrossRefGoogle Scholar
Sueishi, N. (2013) Identification problem of the exponential tilting estimator under misspecification. Economics Letters 118, 509–511.CrossRefGoogle Scholar
Sueishi, N. (2016) A simple derivation of the efficiency bound for conditional moment restriction models. Economics Letters 138, 57–59.10.1016/j.econlet.2015.11.028CrossRefGoogle Scholar
van der Vaart, A.W. (1998) Asymptotic Statistics . Cambridge University Press.10.1017/CBO9780511802256CrossRefGoogle Scholar
van der Vaart, A.W. & Wellner, J.A. (1996) Weak Convergence and Empirical Processes . Springer.CrossRefGoogle Scholar
Vexler, A., Tao, G., & Hutson, A.D. (2014) Posterior expectation based on empirical likelihoods. Biometrika 101, 711–718.10.1093/biomet/asu018CrossRefGoogle Scholar
Wu, Y. & Ghosal, S. (2008) Kullback Leibler property of kernel mixture priors in Bayesian density estimation. Electronic Journal of Statistics 2, 298–331.10.1214/07-EJS130Google Scholar
Yang, Y. & He, X. (2012) Bayesian empirical likelihood for quantile regression. Annals of Statistics 40, 1102–1131.Google Scholar
Supplementary material: PDF

Sueishi supplementary material

Sueishi supplementary material

Download Sueishi supplementary material(PDF)
PDF 94.3 KB