Skip to main content

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
Cancel
×
×
Home
  • Home
Article
  • Cited by 59
  • Cited by
    Crossref Citations
    Crossref logo
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.
    Hulkower, Neal D. 2018. I taste red: the science of tasting wine. Journal of Wine Research, p. 1.
    Kwong, Lester M.K. Sun, Ling Bruwer, Johan and Bruwer, Johan 2018. On linear wine score aggregators and the preservation of group preferences. International Journal of Wine Business Research, p. 00.
    Bazen, Stephen and Cardebat, Jean-Marie 2018. Forecasting Bordeaux wine prices using state-space methods. Applied Economics, p. 1.
    Luxen, Marc F. 2018. Consensus between Ratings of Red Bordeaux Wines by Prominent Critics and Correlations with Prices 2004–2010 and 2011–2016: Ashton Revisited and Expanded. Journal of Wine Economics, Vol. 13, Issue. 01, p. 83.
    Vidal, Leticia Antúnez, Lucía Giménez, Ana Medina, Karina Boido, Eduardo and Ares, Gastón 2018. Astringency evaluation of Tannat wines: Comparison of assessments from trained assessors and experts. Journal of Sensory Studies, Vol. 33, Issue. 3, p. e12330.
    Storchmann, Karl 2017. Introduction to the Issue. Journal of Wine Economics, Vol. 12, Issue. 03, p. 219.
    Bodington, Jeffrey C. 2017. The Distribution of Ratings Assigned to Blind Replicates. Journal of Wine Economics, Vol. 12, Issue. 04, p. 363.
    Osório, António 2017. Judgement and ranking: living with hidden bias. Annals of Operations Research, Vol. 253, Issue. 1, p. 501.
    Ashton, Robert H. 2017. Dimensions of Expertise in Wine Evaluation. Journal of Wine Economics, Vol. 12, Issue. 01, p. 59.
    Breeden, Joseph L. and Liang, Sisi 2017. Auction-Price Dynamics for Fine Wines from Age-Period-Cohort Models. Journal of Wine Economics, Vol. 12, Issue. 02, p. 173.
    Bodington, Jeffrey and Malfeito-Ferreira, Manuel 2017. The 2016 Wines of Portugal Challenge: general implications of more than 8400 wine-score observations. Journal of Wine Research, Vol. 28, Issue. 4, p. 313.
    Jackson, Ronald S. 2017. Wine Tasting. p. 253.
    Bodington, Jeffrey 2017. Disentangling Wine Judges’ Consensus, Idiosyncratic, and Random Expressions of Quality or Preference. Journal of Wine Economics, Vol. 12, Issue. 03, p. 267.
    Torregrossa, Clotilde 2017. A defence of experimental philosophy in aesthetics. Inquiry, p. 1.
    Rodríguez Donate, Mª Carolina Cano Fernández, Víctor J. and Guirao Pérez, Ginés 2017. Comparative evaluation of malvasia wines: concordance and reliability of judgments. Journal of Wine Research, Vol. 28, Issue. 2, p. 144.
    Dressler, Marc 2016. Strategic winery reputation management – exploring German wine guides. International Journal of Wine Business Research, Vol. 28, Issue. 1, p. 4.
    Chen, Natalie and Juvenal, Luciana 2016. Quality, trade, and exchange rate pass-through. Journal of International Economics, Vol. 100, Issue. , p. 61.
    Chen, Natalie and Juvenal, Luciana 2016. Quality and the Great Trade Collapse. IMF Working Papers, Vol. 16, Issue. 30, p. 1.
    Wallentin, Erik 2016. Demand for cinema and diverging tastes of critics and audiences. Journal of Retailing and Consumer Services, Vol. 33, Issue. , p. 72.
    Ashton, Robert H. 2016. The Value of Expert Opinion in the Pricing of Bordeaux Wine Futures. Journal of Wine Economics, Vol. 11, Issue. 02, p. 261.
    Download full list
    ×
  • Get access
    Add to cart €23.00
    Check if you have access via personal or institutional login
    Log in Register

An Examination of Judge Reliability at a major U.S. Wine Competition*

  • Robert T. Hodgson (a1)
Abstract

Wine judge performance at a major wine competition has been analyzed from 2005 to 2008 using replicate samples. Each panel of four expert judges received a flight of 30 wines imbedded with triplicate samples poured from the same bottle. Between 65 and 70 judges were tested each year. About 10 percent of the judges were able to replicate their score within a single medal group. Another 10 percent, on occasion, scored the same wine Bronze to Gold. Judges tend to be more consistent in what they don't like than what they do. An analysis of variance covering every panel over the study period indicates only about half of the panels presented awards based solely on wine quality. (JEL Classification: Q13, Q19)

Copyright
COPYRIGHT: © American Association of Wine Economists 2008
References
Hide All
Ashenfelter, O. and Quandt, R.E.. (1999). Analyzing wine tasting statistically. Chance, 12, 16–20.
Ashenfelter, O. (2006). Tales from the crypt: Bruce Kaiser tells us about the trials and tribulations of a wine judge. Journal of Wine Economics, 1(2), 173–175.
Bartko, J.J. (1966). The intraclass correlation coefficient as a measure of reliability. Psychological Reports, 19, 3–11.
Cicchetti, D.V. (2004a). Who won the 1976 wine tasting of French Bordeaux and U.S. cabernets? Parametrics to the rescue. Journal of Wine Research, 15, 211–220.
Cicchetti, D.V. (2004b). On designing experiments and analyzing data to assess the reliability and accuracy of blind wine tastings. Journal of Wine Research, 15, 221–226.
Cicchetti, D.V. (2006). The Paris 1976 tastings revisited once more: Comparing ratings of consistent and inconsistent tasters. Journal of Wine Economics, 1(2), 125–140.
Cliff, M.A. and King, M.C. (1996). A proposed approach for evaluating expert judge performance using descriptive statistics. Journal of Wine Research, 7, 83–90.
Cliff, M.A. and King, M.C. (1997). The evaluation of judges at wine competitions: The application of eggshell plots. Journal of Wine Research, 8(2), 75–80.
Lima, Tony. (2006). Price and quality in the California wine industry: an empirical investigation. Journal of Wine Economics, 1(2), 176–190.
Shrout, P.E. and Fleiss, J.L.. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.
Thach, L. (2008). How American consumers select wine. Wine Business Monthly (June 2008), 66–71.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of Wine Economics
  • ISSN: 1931-4361
  • EISSN: 1931-437X
  • URL: /core/journals/journal-of-wine-economics
Please enter your name
Please enter a valid email address
Who would you like to send this to? *

CAPTCHA *

Skip to the audio challenge
×

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed

Cancel
Confirm
×