Skip to main content Accessibility help
×
×
Home

EXISTENCE AND CHARACTERIZATION OF CONDITIONAL DENSITY PROJECTIONS

  • Ivana Komunjer (a1) and Giuseppe Ragusa (a2)
Abstract

In this paper we propose primitive conditions under which a projection of a conditional density onto a set defined by conditional moment restrictions exists and is unique. Moreover, we provide an analytic expression of the obtained projection. The range of applications where conditional density projections are used is wide. The derived results are potentially useful in a variety of areas including: semiparametric efficient estimation and optimal testing in (conditional) moment models, Bayesian prior determination and inference in semiparametric models, density forecasting, and simulation-based econometric analysis.

Regarding existence, we propose three different combinations of assumptions that are all sufficient to show that the projection exists and is unique. The proposed conditions exhibit a clear trade off between restrictions put on the divergence between the conditional densities and on the moment function which defines the projection set. Depending on the nature of the application, the researcher can pick and choose which set of conditions to use. Our second set of results characterizes the projection. The expression for the projected density is new though not surprising given the previously obtained results for the unconditional case. The projection is characterized by the dual of the original projection problem. In establishing the strong duality, however, we work with a constraint qualification condition that is weaker than that used by Borwein and Lewis (1991a, 1992a, 1993 in their seminal work concerning the unconditional case.

    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      EXISTENCE AND CHARACTERIZATION OF CONDITIONAL DENSITY PROJECTIONS
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      EXISTENCE AND CHARACTERIZATION OF CONDITIONAL DENSITY PROJECTIONS
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      EXISTENCE AND CHARACTERIZATION OF CONDITIONAL DENSITY PROJECTIONS
      Available formats
      ×
Copyright
Corresponding author
*Address correspondence to Ivana Komunjer, Department of Economics, University of California, San Diego, 9500 Gilman Drive MC 0508, La Jolla, CA 92093-0508; e-mail: komunjer@ucsd.edu
References
Hide All
Ali, S.M. & Silvey, S.D. (1966) A general class of coefficients of divergence of one distribution from another. Journal of the Royal Statistical Society Ser. B, 28, 131142.
Aliprantis, C.D. & Border, K.C. (2007) Infinite Dimensional Analysis, Berlin: Springer-Verlag, 3rd ed.
Bernardo, J. (1979) Reference Posterior Distributions for Bayesian Inference. Journal of the Royal Statistical Society. Series B (Methodological), 41, 113147.
Bernardo, J. (2005) Reference analysis, Handbook of Statistics, 25, 1790.
Borwein, J.M. & Lewis, A.S. (1991a) Duality Relationships for Entropy-Like Minimization Problems. SIAM Journal on Control and Optimization, 29, 325338.
Borwein, J.M. & Lewis, A.S. (1991b) On the Convergence of Moment Problems. Transactions of the American Mathematical Society, 325, pp. 249271.
Borwein, J.M. & Lewis, A.S. (1992a) Partially finite convex programming, part I: quasi relative interiors and duality theory, interiors and duality theory. Math. Program., 57, 1548.
Borwein and Lewis (1992b) Partially finite convex programming, part II: explicit lattice models, Math. Program., 57, 4983.
Borwein, J.M. & Lewis, A.S. (1993) Partially-finite Programming in L 1 and the Existence of Maximum Entropy Estimates. SIAM Journal on Optimization, 3, 248267.
Buck, B. & Macaulay, V. (1991) Maximum entropy in action: a collection of expository essays, Oxford University Press.
Burg, J. (1967) Maximum Entropy Spectrum Analysis, Paper presented at 37th Annual Mtg. of Exploration Geophyslcrists, Oklahoma City.
Chor-Yiu, S. & White, H. (1996) Information criteria for selecting possibly misspecified parametric models. Journal of Econometrics, 71, 207225.
Cressie, N. & Read, T. (1984) Multinomial goodness-of-fit tests. Journal of the Royal Statistical Society. Series B (Methodological), 440464.
Csiszár, I. (1967) Information-type measures of the difference of probability distributions and indirect observations, Studia Scientiarum Mathematicarum Hungarica, 299318.
Csiszár, I. (1975) I-Divergence Geometry of Probability Distributions and Minimization Problems. Annals of Probability, 3, 146–58.
Csiszár, I. (1995) Generalized projections for non-negative functions, Acta Mathematica Hungarica, 68, 161186.
Ekeland, I. & Témam, R. (1987) Convex Analysis and Variational Problems, Society for Industrial and Applied Mathematics.
Giacomini, R. & Ragusa, G. (2013) Theory-coherent forecasting. Journal of Econometrics (in press).
Gourieroux, C. & Monfort, A. (1997) Simulation-Based Econometric Methods, Oxford University Press.
Gowda, M. & Teboulle, M. (1990) A Comparison of Constraint Qualifications in Infinite-Dimensional Convex Programming. SIAM Journal on Control and Optimization, 28, 925935.
Hiriart-Urruty, J.B. & Lemarechal, C. (1993) Convex Analysis and Minimization Algorithms I: Fundamentals (Grundlehren Der Mathematischen Wissenschaften), Springer.
Holmes, R.D. (1974) Geometric Functional Analysis and Its Applications. Springer-Verlag.
Kim, J. (2002) Limited information likelihood and Bayesian analysis. Journal of Econometrics, 107, 175193.
Kitamura, Y. (2001) Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions. Econometrica, 69, 16611672.
Kitamura, Y., Otsu, T., & Evdokimov, K. (2009) Robustness, Infinitesimal Neighborhoods, and Moment Restrictions, Cowles Foundation Discussion Papers .
Kitamura, Y. & Stutzer, M. (1997) An Information-Theoretic Alternative to Generalized Method of Moments Estimation. Econometrica, 65, 861874.
Kitamura, Y., Tripathi, G., & Ahn, H. (2004) Empirical Likelihood-Based Inference in Conditional Moment Restriction Models. Econometrica, 72, 16671714.
Komunjer, I. & Vuong, Q. (2009) Semiparametric Efficiency Bound in Time-Series Models for Conditional Quantiles, Econometric Theory, forthcoming.
Krasnosel’skii, M. & Rutickii, Y. (1961) Convex Functions and Orlicz Spaces, P.Noordhoff Ltd.
Kullback, S. & Khairat, M.A. (1966) A Note on Minimum Discrimination Information. The Annals of Mathematical Statistics, 37, 279280.
Liese, F. (1975) On the existence of f – projections, Colloquia of Mathematical Society Janos Bolyai, 16, 431446, budapest.
Liese, F. & Vajda, I. (1987) Convex Statistical distances. Leipzig: Teubner.
Newey, W. & Smith, R.J. (2004) Higher Order Properties of GMM and Generalized Empirical Likelihood Estimators. Econometrica, 72, 219256.
Otsu, T., Seo, M.H., & Whang, Y.-J. (2008) Testing for Non-Nested Conditional Moment Restrictions using Unconditional Empirical Likelihood, Cowles Foundation Discussion Paper No. 1660.
Ragusa, G. (2011) Minimum divergence, generalized empirical likelihoods, and higher order expansions. Econometric Reviews, 30, 406456.
Rockafellar, R.T. (1968) Integrals which are convex functionals. Pacific Journal of Mathematics, 24, 525539.
Rockafellar, R.T. (1970) Convex Analysis. Princeton, New Jersey: Princeton University Press.
Rockafellar, R.T. (1971) Integrals which are convex functionals. II. Pacific Journal of Mathematics, 39, 439469.
Rockafellar, R.T. (1974) Conjugate Duality and Optimization, volume 16 of Regional Conferences Series in Applied Mathematics, SIAM, Philadelphia.
Sawa, T. (1978) Information Criteria for Discriminating Among Alternative Regression Models. Econometrica, 46, 12731291.
Schennach, S.M. (2014) Entropic Latent Variable Integration via Simulation. Econometrica, 82, 345385.
Shi, X. (2014) A Non-Degenerate Vuong Test, Manuscript.
Stein, C. (1956) Efficient Nonparametric Testing and Estimation, In Proceedings of the Third Berkeley Symposium in Mathematical Statistics and Probability, Berkeley: University of California Press, vol. 1, 187–196.
Stinchcombe, M.B. & White, H. (1998) Consistent Specification Testing with Nuisance Parameters Present Only under the Alternative. Econometric Theory, 14, pp. 295325.
Tang, Y. & Ghosal, S. (2007) Posterior Consistency of Dirichlet Mixtures for Estimating a Transition Density. Journal of Statistical Planning and Inference, 137, 17111726.
Ullah, A. (1996) Entropy, divergence and distance measures with econometric applications. Journal of Statistical Planning and Inference, 49, 137162.
Vuong, Q. (1989) Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses. Econometrica, 57, 307333.
White, H. (1982) Maximum Likelihood Estimation of Misspecified Models. Econometrica, 50, 125.
White, H. (1994) Estimation, Inference and Specification Analysis. Cambridge University Press.
Zellner, A. (1996): Models, prior information, and Bayesian analysis. Journal of Econometrics, 75, 5168.
Zellner, A. (2002) Information processing and Bayesian analysis, Journal of Econometrics, 107, 4150.
Zellner, A. (2003) Some Recent Developments in Econometric Inference. Econometric Reviews, 22, 203215.
Zellner, A. & Tobias, J. (2001) Further Results on Bayesian Method of Moments Analysis of the Multiple Regression Model. International Economic Review, 42, 121139.
Zălinescu, C. (1999) A comparison of constraint qualifications in infinite-dimensional convex programming revisited, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics, 40, 353378.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Econometric Theory
  • ISSN: 0266-4666
  • EISSN: 1469-4360
  • URL: /core/journals/econometric-theory
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed