Hostname: page-component-89b8bd64d-5bvrz Total loading time: 0 Render date: 2026-05-09T13:01:14.300Z Has data issue: false hasContentIssue false

Bayesian Estimation with Informative Priors is Indistinguishable from Data Falsification

Published online by Cambridge University Press:  23 October 2019

Miguel Ángel García-Pérez*
Affiliation:
Universidad Complutense (Spain)
*
*Correspondence concerning this article should be addressed to Miguel Ángel García-Pérez. Departamento de Metodología de la Facultad de Psicología de la Universidad Complutense. Campus de Somosaguas 28223 Madrid (Spain). E-mail: miguel@psi.ucm.es Phone: +34–913 943061. Fax: +34–913943189.
Rights & Permissions [Opens in a new window]

Abstract

Criticism of null hypothesis significance testing, confidence intervals, and frequentist statistics in general has evolved into advocacy of Bayesian analyses with informative priors for strong inference. This paper shows that Bayesian analysis with informative priors is formally equivalent to data falsification because the information carried by the prior can be expressed as the addition of fabricated observations whose statistical characteristics are determined by the parameters of the prior. This property of informative priors makes clear that only the use of non-informative, uniform priors in all types of Bayesian analyses is compatible with standards of research integrity. At the same time, though, Bayesian estimation with uniform priors yields point and interval estimates that are identical or nearly identical to those obtained with frequentist methods. At a qualitative level, frequentist and Bayesian outcomes have different interpretations but they are interchangeable when uniform priors are used. Yet, Bayesian interpretations require either the assumption that population parameters are random variables (which they are not) or an explicit acknowledgment that the posterior distribution (which is thus identical to the likelihood function except for a scale factor) only expresses the researcher’s beliefs and not any information about the parameter of concern.

Information

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Universidad Complutense de Madrid and Colegio Oficial de Psicólogos de Madrid 2019
Figure 0

Figure 1. Effect of informative beta priors on point and interval estimates of the binomial parameter with n = 18 actual observations in which the number of successes is X = 14, so that the frequentist ML estimate is 0.778. The horizontal axis in each panel denotes prior characteristics along one of two orthogonal dimensions: The number (or proportion) of successes in a fixed number of fabricated observations (left panel) and the number of fabricated observations with a fixed proportion of successes (right panel). In the left panel, the priors are such that v + w = 12 (implying nf = 10 fabricated observations) and the abscissa represents the number v – 1 of successes in them; in the right panel, the priors are such that (v − 1)/(v + w − 2) = 0.778 (implying that the proportion of successes in fabricated data equals that in actual data) and the abscissa represents the number of fabricated observations (nf = v + w − 2). In both panels the blue horizontal line is the frequentist ML point estimate and the light blue horizontal stripe indicates the frequentist 95% score CI, neither of which varies across priors. The vertical line in each panel denotes the condition in which results in both panels meet along the two orthogonal dimensions. The continuous red line in each panel indicates the MAP Bayes estimate for each prior, and note that it sits on the blue horizontal line in the right panel; the dashed red lines in each panel indicate the lower and upper limits of the 95% HDI for each prior.