Skip to main content

W.S. Gosset and Some Neglected Concepts in Experimental Statistics: Guinnessometrics II*

  • Stephen T. Ziliak (a1)

Student's exacting theory of errors, both random and real, marked a significant advance over ambiguous reports of plant life and fermentation asserted by chemists from Priestley and Lavoisier down to Pasteur and Johannsen, working at the Carlsberg Laboratory. One reason seems to be that William Sealy Gosset (1876–1937) aka “Student” – he of Student's t-table and test of statistical significance – rejected artificial rules about sample size, experimental design, and the level of significance, and took instead an economic approach to the logic of decisions made under uncertainty. In his job as Apprentice Brewer, Head Experimental Brewer, and finally Head Brewer of Guinness, Student produced small samples of experimental barley, malt, and hops, seeking guidance for industrial quality control and maximum expected profit at the large scale brewery. In the process Student invented or inspired half of modern statistics. This article draws on original archival evidence, shedding light on several core yet neglected aspects of Student's methods, that is, Guinnessometrics, not discussed by Ronald A. Fisher (1890–1962). The focus is on Student's small sample, economic approach to real error minimization, particularly in field and laboratory experiments he conducted on barley and malt, 1904 to 1937. Balanced designs of experiments, he found, are more efficient than random and have higher power to detect large and real treatment differences in a series of repeated and independent experiments. Student's world-class achievement poses a challenge to every science. Should statistical methods – such as the choice of sample size, experimental design, and level of significance – follow the purpose of the experiment, rather than the other way around? (JEL classification codes: C10, C90, C93, L66)

Hide All
Banerjee, A. and Duflo, E. (2011). Poor Economics: A Radical Rethinking of the Way to Fight Global Poverty. New York: Public Affairs.
Beaven, E.S. (1947). Barley: Fifty Years of Observation and Experiment. London: Duckworth.
Brown, H.T., (ed.) (1903). Transactions of the Guinness Research Laboratory, Vol. I, Part I. Dublin: Arthur Guinness, Son and Co., Ltd.
Bruhn, M. and McKenzie, D. (2009). In pursuit of balance: randomization in practice in development economics. American Economic Journal: Applied Economics, 4, 200232.
Dennison, S.R. and MacDonagh, O. (1998). Guinness 1886–1939. Cork: Cork University Press.
Duflo, E., Glennerster, R. and Kremer, M. (2006). Using Randomization in Development Economics Research: A Toolkit. December 12, 2006, J-PAL Poverty Action Lab, MIT.
Fisher, I. (1926). Prohibition at its Worst. New York: The Macmillan Company.
Fisher, R.A. (1925a [1941]). Statistical Methods for Research Workers. New York: G.E. Stechart and Co.
Fisher, R.A. (1926). Arrangement of Field Experiments. Journal of Ministry of Agriculture, 23, 503513.
Fisher, R.A. (1935). The Design of Experiments, Edinburgh: Oliver & Boyd. Reprinted in eight editions and in at least four different languages.
Fisher, R.A. (1939). Student. Annals of Eugenics, 9, 19.
Fisher, R.A. and Yates, F. (1938 [1963]). Statistical Tables for Biological, Agricultural and Medical Research, Edinburgh: Oliver and Boyd. Sixth edition.
Friedman, M. (1953). The effects of a full-employment policy on economic stability: a formal analysis. In: Friedman, M., Essays in Positive Economics. Chicago: University of Chicago Press, 117132.
Geison, G.L. (1995). The Private Science of Louis Pasteur. Princeton: Princeton University Press.
Gosset, W.S. [see “Student”, below] (1904). The Application of the ‘Law of Error’ to the Work of the Brewery. Laboratory Report, 8, Arthur Guinness & Son, Ltd., Diageo, Guinness Archives, 3–16 and unnumbered appendix.
Gosset, W.S. (1905). Letter from W.S. Gosset to K. Pearson, Guinness Archives, GDB/BRO/1102 (partially reprinted in Pearson (1939), 215216).
Gosset, W.S. (1908). The present position of our knowledge of the connection between life and hops in the experimental brewery. Laboratory Report, 10, Arthur Guinness & Son, Ltd., Diageo, Guinness Archives, 137–150.
Gosset, W.S. (1909). The brewing of the experimental hop farm hops, 1907 Crop (Part II), Together with a note on the present method of hop analysis. Laboratory Report, 10, Arthur Guinness & Son, Ltd., Diageo, Guinness Archives, 202–220.
Gosset, W.S. (1936). Co-operation in large-scale experiments. Supplement to the Journal of the Royal Statistical Society, 3, 115–36.
Gosset, W.S. (1962). Letters of William Sealy Gosset to R.A. Fisher. Vols. 1–5, Eckhart Library, University of Chicago. Private circulation.
Harrison, G. (2011). Randomization and its discontents. Journal of African Economies, 20, 626652.
Heckman, J.J. and Vytlacil, E.J. (2007). Econometric evaluation of social programs, Part I: causal models, structural models and econometric policy evaluation. In: Heckman, J.J. and Leamer, E. (eds.), Handbook of Econometrics 6B. Amsterdam: Elsevier, 48365143.
Herberich, D.H., Levitt, S.D. and List, J.A. (2009). Can field experiments return agricultural economics to the glory days? American Journal of Agricultural Economics, 91, 12591265.
Holmes, F.L. (1985). Lavoisier and the Chemistry of Life: An Exploration of Scientific Creativity. Madison: University of Wisconsin Press.
Holter, H. and Møller, K.M. (eds.) (1976). The Carlsberg Laboratory, 1876–1976, Copenhagen: Rhodos and the Carlsberg Foundation.
Jeffreys, H. 1939 [1961]. Theory of Probability, London: Oxford University Press.
Karlan, D. and List, J. (2007). Does price matter in charitable giving? Evidence from a large-scale natural field experiment. American Economic Review, 97, 17741793.
Lanham, R.A. (1991). A Handlist of Rhetorical Terms. Los Angeles: University of California Press.
Leonard, A. (2009). Celebrate the history of statistics: drink a Guinness. How a master brewer forged new ground in the quantitative progress of science. Salon, September 28.
Levitt, S.D. and List, J.A. (2009). Field experiments in economics: the past, the present, and the future. European Economic Review, 53, 118.
McCloskey, D.N. and Ziliak, S.T. (1996). The standard error of regressions. Journal of Economic Literature, 34, 97114.
McCloskey, D.N. and Ziliak, S.T. (2010). Brief of Amici Curiae By Statistics Experts Professors Deirdre N. McCloskey and Stephen T. Ziliak in Support of Respondents (Vol. No. 09–1156, Matrixx v. Siracusano, p. 22), Washington DC: Supreme Court of the United States. Edward Labaton et al., Counsel of Record (ed.)
McMullen, L. (1950). The sources and nature of statistical information in special fields of statistics. Journal of the Royal Statistical Society, Series A (General), 113, 230237.
Mercer, W.B. and Hall, A.D. (1911). The experimental error of yield trials. Journal of Agricultural Science, 4, 107127.
Neyman, J. and Pearson, E.S. (1938). Note on some points on ‘Student's’ paper on ‘comparison between balanced and random arrangements of field plots. Biometrika, 29, 379–88.
Nye, J. (2007). War, Wine, and Taxes. Princeton: Princeton University Press.
Pasteur, L. (1879). Studies of Fermentation: The Diseases of Beer – Their Causes and the Means of Preventing Them. London: Macmillan. (Faulkner, F. and Robb, D. Constable, transl.)
Pearson Papers (Containing files on K., Pearson, E.S., Pearson, W.S., Gosset, R.A., Fisher, and J., Neyman), University College London (UCL), Special Collections Library.
Pearson, E.S. (1938). Some aspects of the problem of randomization: II. An illustration of “Student's” inquiry into the effect of “balancing” in agricultural experiment. Biometrika, 30, 159179.
Pearson, E.S. (1939). ‘Student’ as statistician. Biometrika, 30, 210–50.
Pearson, E.S. (1968). Studies in the history of probability and statistics. XX: some early correspondence between W.S. Gosset, R.A. Fisher and Karl Pearson, with notes and comments. Biometrika, 55, 445–57.
Pearson, E.S. (1990) [posthumous]. ‘Student’: A Statistical Biography of William Sealy Gosset. Oxford: Clarendon Press. R.L., Plackett (ed.), with the assistance of Barnard G.
Press, S.J. (2003). Subjective and Objective Bayesian Statistics. New York: Wiley.
Priestley, J. (1806). Memoirs of Dr. Joseph Priestley, to the Year 1795, Written by Himself. London: J. Johnson.
Rothman, K.J., Greenland, S. and Lash, T.L. (2008). Modern Epidemiology, Philadelphia: Lippincott, Williams & Wilkins.
Savage, L.J. (1954). The Foundations of Statistics. New York: Dover.
Savage, L.J. (1971). [1976 posthumous]. On re-reading R.A. Fisher. Annals of Statistics, 4, 441500.
Schabas, M. (2006). The Natural Origins of Economics. Chicago: University of Chicago Press.
Schofield, R.E. (1966). A Scientific Autobiography of Joseph Priestley, 1733–1804: Selected Scientific Correspondence, with Commentary. Cambridge, MA: The MIT Press.
Stewart, G.G. (2009). The Horace Brown Medal Lecture: forty years of brewing research. Journal of the Institute of Brewing, 115, 329.
Student [see also: Gosset, W.S.] (1907). On the error of counting with a haemacytometer. Biometrika, 5, 351–60.
Student, (1908a). The probable error of a mean. Biometrika, 6, 124.
Student, (1908b). The probable error of a correlation coefficient. Biometrika, 6, 300310.
Student, (1911). Appendix to Mercer and Hall's paper on ‘the experimental error of field trials’. Journal of Agricultural Science, 4, 128131.
Student, (1923). On testing varieties of cereals. Biometrika, 15, 271293.
Student, (1925). New tables for testing the significance of observations. Metron, 5, 105108.
Student, (1931a). The Lanarkshire milk experiment. Biometrika, 23, 398406.
Student, (1931b). On the ‘z’ test. Biometrika, 23, 407–8.
Student, (1931c). Yield Trials. Bailliere's Encyclopedia of Scientific Agriculture, 1342–1360; Reprinted: pp. 150168 in Pearson E.S. and Wishart|J. (eds.) (194). Student's Collected Papers. London: Biometrika Office.
Student, (1938, posthumous). Comparison between balanced and random arrangements of field plots. Biometrika, 29, 363–78.
Student, (1942, posthumous). Student's Collected Papers. London: Biometrika Office. Pearson, E.S. and Wishart, J. (eds.).
Swinnen, J. and Vandemoortele, T. (2011). Beeronomics: the economics of beer and brewing. In: Swinnen, J.F.M. (ed.), The Economics of Beer. Oxford: Oxford University Press, 335355.
Zellner, A. (2005). Statistics, Econometrics, and Forecasting. The Stone Lectures in Economics. Cambridge, UK: Cambridge University Press.
Zellner, A. (2010). Personal communication. University of Chicago, Quadrangle Club.
Ziliak, S.T. (2008). Guinnessometrics: the economic foundation of Student'st. Journal of Economic Perspectives, 22, 199216.
Ziliak, S.T. (2010). The validus medicus and a new gold standard. The Lancet, 376, 324325.
Ziliak, S.T. (2011a). Field experiments in economics: comment on an article by Levitt and List. CREATES Research Paper No. 2011–25, Aarhus: Center for Research in Econometric Analysis of Times Series, Aarhus University, Denmark.
Ziliak, S.T. (2011b). Matrixx v. Siracusano and Student v. Fisher: statistical significance on trial. Significance, 8, 131134.
Ziliak, S.T. and McCloskey, D.N. (2008). The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives. Ann Arbor: University of Michigan Press.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of Wine Economics
  • ISSN: 1931-4361
  • EISSN: 1931-437X
  • URL: /core/journals/journal-of-wine-economics
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed