Skip to main content
    • Aa
    • Aa
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 13
  • Cited by
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Ashton, Robert H. 2016. The Value of Expert Opinion in the Pricing of Bordeaux Wine Futures. Journal of Wine Economics, p. 1.

    Cardebat, Jean-Marie and Livat, Florine 2016. Wine experts’ rating: a matter of taste?. International Journal of Wine Business Research, Vol. 28, Issue. 1, p. 43.

    Dressler, Marc 2016. Strategic winery reputation management – exploring German wine guides. International Journal of Wine Business Research, Vol. 28, Issue. 1, p. 4.

    Palma, David Ortúzar, Juan de Dios Rizzi, Luis Ignacio Guevara, Cristian Angelo Casaubon, Gerard and Ma, Huiqin 2016. Modelling choice when price is a queue for quality: A case study with Chinese wine consumers. Journal of Choice Modelling, Vol. 19, p. 24.

    Almaraz, P 2015. Bordeaux wine quality and climate fluctuations during the last century: changing temperatures and changing industry. Climate Research, Vol. 64, Issue. 3, p. 187.

    Marks, Denton 2015. Seeking the Veritas about the Vino: fine wine ratings as wine knowledge. Journal of Wine Research, Vol. 26, Issue. 4, p. 319.

    Outreville, J. François 2015. The market structure–performance relationship applied to the Canadian wine industry. Applied Economics Letters, Vol. 22, Issue. 18, p. 1486.

    Hodgson, Robert and Cao, Jing 2014. Criteria for Accrediting Expert Wine Judges. Journal of Wine Economics, Vol. 9, Issue. 01, p. 62.

    Lewis, Geoffrey and Zalan, Tatiana 2014. Strategic Implications of the Relationship Between Price and Willingness to Pay: Evidence from a Wine-Tasting Experiment. Journal of Wine Economics, Vol. 9, Issue. 02, p. 115.

    Ashton, Robert H. 2013. Is There Consensus Among Wine Quality Ratings of Prominent Critics? An Empirical Analysis of Red Bordeaux, 2004–2010. Journal of Wine Economics, Vol. 8, Issue. 02, p. 225.

    Ashton, Robert H. 2012. Reliability and Consensus of Experienced Wine Judges: Expertise Within and Between?. Journal of Wine Economics, Vol. 7, Issue. 01, p. 70.

    Taber, George M. 2012. The Judgment of Princeton. Journal of Wine Economics, Vol. 7, Issue. 02, p. 143.

    Cross, Robin Plantinga, Andrew J. and Stavins, Robert N. 2011. The Value of Terroir: Hedonic Estimation of Vineyard Sale Prices. Journal of Wine Economics, Vol. 6, Issue. 01, p. 1.


How Expert are “Expert” Wine Judges?*

  • Robert T. Hodgson (a1)
  • DOI:
  • Published online: 01 June 2012

Recent papers by Hodgson (2008) and Gawel and Godden (2008) have questioned the consistency of expert wine judges in a wine competition setting. In the latter paper, a methodology introduced in psychometric research to measure judge reliability corrected for chance was used to quantify judge consistency (Cohen, 1968). This paper extends that notion, suggesting a value of 0.7 for Cohen's weighted kappa might be used to define an expert wine judge. With that criterion, less than 30% of judges who participated in either of the two studies would be considered “expert.” (JEL Classification: C1, L15)

Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

O. Ashenfelter and R. Quandt (1999). Analyzing a wine tasting statistically. Chance, 12, 1620.

J. Cohen (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 3746.

J. Cohen (1968). Weighted kappa: nominal scale agreement with provision for scaled disagreement of partial credit. Psychological Bulletin, 70(4), 213220.

D.V. Cicchetti (2004). Who won the 1976 blind tasting of French Bordeaux and U.S. Cabernets? Parametrics to the rescue. Journal of Wine Research, 15(3), 211220.

R. Gawel and P.W. Godden (2008). Evaluation of the consistency of wine quality assessments from expert wine tasters. Australian Journal of Grape and Wine Research, 14, 18.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of Wine Economics
  • ISSN: 1931-4361
  • EISSN: 1931-437X
  • URL: /core/journals/journal-of-wine-economics
Please enter your name
Please enter a valid email address
Who would you like to send this to? *