Hostname: page-component-7d684dbfc8-tvhzr Total loading time: 0 Render date: 2023-09-25T13:55:41.814Z Has data issue: false Feature Flags: { "corePageComponentGetUserInfoFromSharedSession": true, "coreDisableEcommerce": false, "coreDisableSocialShare": false, "coreDisableEcommerceForArticlePurchase": false, "coreDisableEcommerceForBookPurchase": false, "coreDisableEcommerceForElementPurchase": false, "coreUseNewShare": true, "useRatesEcommerce": true } hasContentIssue false

ON NORMATIVITY AND EPISTEMIC INTUITIONS: FAILURE OF REPLICATION

Published online by Cambridge University Press:  08 December 2014

Abstract

The field of experimental philosophy has received considerable attention, essentially for producing results that seem highly counter-intuitive and at the same time question some of the fundamental methods used in philosophy. One of the earlier influential papers that gave rise to the experimental philosophy movement titled ‘Normativity and Epistemic Intuitions’ by Jonathan M. Weinberg, Shaun Nichols and Stephen Stich (2001), reported that respondents displayed different epistemic intuitions depending on their ethnic background as well as socioeconomic status. These findings, if robust, would have important implications for philosophical methodology in general and epistemology in particular. Because of the important implication of its findings, Weinberg et al. (2001) has been very influential – currently with more than four hundred citations – and the subject of extensive debate. Despite the paper's significance and despite all the debates this paper has generated, there has not been a replication attempt of its experiments. We collected data from four different sources (two on-line and two in-person) to replicate the experiments. Despite several different data sets and in various cases larger sample sizes, we failed to detect significant differences between the above-mentioned groups. Our results suggest that epistemic intuitions are more uniform across ethnic and socioeconomic groups than Weinberg et al. (2001) indicates. Given our data, we believe that the notion of differences in epistemic intuitions among different ethnic and socioeconomic groups advanced by Weinberg et al. (2001) and accepted by many researchers needs to be corrected.

Type
Articles
Copyright
Copyright © Cambridge University Press 2014 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Alexander, J. 2012. Experimental Philosophy: An Introduction: Cambridge: Polity Press.Google Scholar
Alexander, J., Mallon, R., and Weinberg, J. M. 2010. ‘Accentuate the Negative.’ Review of Philosophy and Psychology, 1: 297314.CrossRefGoogle Scholar
Alexander, J. and Weinberg, J. M. 2007. ‘Analytic Epistemology and Experimental Philosophy.’ Philosophy Compass, 2: 5680.CrossRefGoogle Scholar
Amir, Y. and Sharon, I. 1991. ‘Replication Research: A ‘Must’ for the Scientific Advancement of Psychology.’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 5171. Newbury Park, CA: Sage.Google Scholar
Bakker, M., van Dijk, A., and Wicherts, J. M. 2012. ‘The Rules of the Game Called Psychological Science.’ Perspectives on Psychological Science, 7: 543–54.CrossRefGoogle ScholarPubMed
Bealer, G. 1996. ‘A Priori Knowledge and the Scope of Philosophy.’ Philosophical Studies, 81(2–3), 121–42.CrossRefGoogle Scholar
Bealer, G. 2000. ‘A Theory of the A Priori.’ Pacific Philosophical Quarterly, 81: 130.CrossRefGoogle Scholar
Beebe, J. R. and Buckwalter, W. 2010. ‘The Epistemic Side-Effect Effect.’ Mind and Language, 25: 474–98.CrossRefGoogle Scholar
Bishop, M. and Trout, J. 2005. ‘The Pathologies of Standard Analytic Epistemology.’ Nous, 39: 696714.CrossRefGoogle Scholar
Bozarth, J. D. and Roberts, R. R. 1972. ‘Signifying Significant Significance.’ American Psychologist, 27: 774–5.CrossRefGoogle Scholar
Braude, S. E. 1979. ESP and Psychokinesis: A Philosophical Examination. Philadelphia, PA: Temple University Press.Google Scholar
Buckwalter, W. 2010. ‘Knowledge isn't Closed on Saturday: A Study in Ordinary Language.’ Review of Philosophy and Psychology, 1: 395406.CrossRefGoogle Scholar
Buckwalter, W. and Stich, S. Forthcoming. ‘Gender and Philosophical Intuition.’ In Knobe, J. and Nichols, S. (eds), Experimental Philosophy (Vol. 2). Oxford: Oxford University Press.Google Scholar
Burnyeat, M. 1990. The Theaetetus of Plato. Indianapolis, IN: Hackett Publishing.Google Scholar
Cappelen, H. 2012. Philosophy without Intuitions. Oxford: Oxford University Press.CrossRefGoogle Scholar
Chudnoff, E. 2011. ‘The Nature of Intuitive Justification.’ Philosophical Studies, 153: 313–33.CrossRefGoogle Scholar
Collins, H. M. 1992. Changing Order: Replication and Induction in Scientific Practice. Chicago, IL: University of Chicago Press.Google Scholar
Colaço, D.Buckwalter, W.Stich, S. and Machery, E. (2014). Epistemic intuitions in fake-barn thought experiments. Episteme, 11(02), 199212. doi: doi:10.1017/epi.2014.7CrossRefGoogle Scholar
Cullen, S. 2010. ‘Survey-driven Romanticism.’ Review of Philosophy and Psychology, 1: 275–96.CrossRefGoogle Scholar
Cummins, R. 1998. ‘Reflection on Reflective Equilibrium.’ In DePaul, M. R. & Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 113–29. Lanham, MD: Rowman & Littlefield.Google Scholar
Deutsch, M. 2009. ‘Experimental Philosophy and the Theory of Reference.’ Mind and Language, 24: 445–66.CrossRefGoogle Scholar
Deutsch, M. 2010. ‘Intuitions, Counter-examples, and Experimental Philosophy.’ Review of Philosophy and Psychology, 1: 447–60.CrossRefGoogle Scholar
Doris, J. M. 2005. ‘Replies: Evidence and Sensibility.’ Philosophy and Phenomenological Research, 71: 656–77.CrossRefGoogle Scholar
Dowell, J. 2008. ‘Empirical Metaphysics: The Role of Intuitions about Possible Cases in Philosophy.’ Philosophical Studies, 140: 1946.CrossRefGoogle Scholar
Evans, K., Rotello, C. M., Li, X., and Rayner, K. 2009. ‘Scene Perception and Memory Revealed by Eye Movements and Receiver-operating Characteristic Analyses: Does a Cultural Difference Truly Exist?Quarterly Journal of Experimental Psychology, 62: 276–85.CrossRefGoogle ScholarPubMed
Feltz, A. 2008. ‘Problems with the Appeal to Intuition in Epistemology.’ Philosophical Explorations, 11: 131–41.CrossRefGoogle Scholar
Feltz, A. 2009. ‘Experimental Philosophy.’ Analyse und Kritik – Zeitschrift fur Sozialwissenschaften, 31: 201.Google Scholar
Francis, G. 2012. ‘The Psychology of Replication and Replication in Psychology.’ Perspectives on Psychological Science, 7: 585–94.CrossRefGoogle Scholar
Gendler, T. S. 2007. ‘Philosophical Thought Experiments, Intuitions, and Cognitive Equilibrium.’ Midwest Studies in Philosophy, 31: 6889.CrossRefGoogle Scholar
Gettier, E. L. 1963. ‘Is Justified True Belief Knowledge?Analysis, 23: 121–3.CrossRefGoogle Scholar
Goldman, A. I. 2007. ‘Philosophical Intuitions: Their Target, their Source, and their Epistemic Status.’ Grazer Philosophische Studien, 74: 126.Google Scholar
Goldman, A. and Pust, J. 1998. ‘Philosophical Theory and Intuitional Evidence.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 179201. Lanham, MD: Rowman & Littlefield.Google Scholar
Gopnik, A. and Schwitzgebel, E. 1998. ‘Whose Concepts are They, Anyway? The Role of Philosophical Intuition in Empirical Psychology.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 7595. Lanham, MD: Rowman & Littlefield.Google Scholar
Grundmann, T. 2010. ‘Some Hope for Intuitions: A Reply to Weinberg.’ Philosophical Psychology, 23: 481509.CrossRefGoogle Scholar
Gutting, G. 1998. ‘‘Rethinking intuition’: A Historical and Metaphilosophical Introduction.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 317. Lanham, MD: Rowman & Littlefield.Google Scholar
Hendrick, C. 1991. ‘Replications, Strict Replications, and Conceptual Replications: Are They Important?’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 4151. Newbury Park, CA: Sage.Google Scholar
Ichikawa, J. 2014. ‘Who needs Intuitions? Two Experimentalist Critiques.’ In Booth, A. and Rowbottom, D. (eds), Intuitions. Oxford: Oxford University Press.Google Scholar
Ioannidis, J. P. A. 2005. ‘Why Most Published Research Findings are False.’ PloS Medicine, 2: 696701.CrossRefGoogle ScholarPubMed
Ioannidis, J. P. A. 2012. ‘Why Science Is Not Necessarily Self-Correcting.’ Perspectives on Psychological Science, 7: 645–54.CrossRefGoogle Scholar
Knobe, J. 2007. ‘Experimental Philosophy.’ Philosophy Compass, 2: 8192.CrossRefGoogle Scholar
Knobe, J. and Nichols, S. 2008. Experimental Philosophy. Oxford: Oxford University Press.Google Scholar
Koole, S. L. and Lakens, D. 2012. ‘Rewarding Replications: A Sure and Simple Way to Improve Psychological Science.’ Perspectives on Psychological Science, 7: 608–14.CrossRefGoogle ScholarPubMed
Koppl, R. 2011. ‘Against Representative Agent Methodology.’ Review of Austrian Economics, 24: 4355.CrossRefGoogle Scholar
Kornblith, H. 1998. ‘The Role of Intuition in Philosophical Inquiry: An Account with no Unnatural Ingredients.’ In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 129–43. Lanham, MD: Rowman & Littlefield.Google Scholar
Lamal, P. A. 1991. ‘On the Importance of Replication.’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 31–7. Newbury Park, CA: Sage.Google Scholar
Levin, J. 2005. ‘The Evidential Status of Philosophical Intuition.’ Philosophical Studies, 121: 193224.CrossRefGoogle Scholar
Liao, S. M. 2008. ‘A Defense of Intuitions.’ Philosophical Studies, 140: 247–62.CrossRefGoogle Scholar
Löwe, B., Müller, T., and Müller-Hill, E. 2009. ‘Mathematical Knowledge: A Case Study in Empirical Philosophy of Mathematics.’ In Van Kerkhove, B., De Vuyst, J., and Van Bendegem, J. P. (eds), Philosophical Perspectives on Mathematical Practice. London: College Publications.Google Scholar
Lu, Z., Daneman, M., and Reingold, E. M. 2008. ‘Cultural Differences in Cognitive Processing Styles: Evidence from Eye Movements during Scene Perception.’ In Love, B. C., McRae, K., and Sloutsky, V. M. (eds), Proceedings of the 30th Annual Conference of the Cognitive Science Society, pp. 24282432. Austin, TX: Cognitive Science Society.Google Scholar
Machery, E., Mallon, R., Nichols, S., and Stich, S. P. 2004. ‘Semantics, Cross-cultural Style.Cognition, 92(3): B1B12.CrossRefGoogle ScholarPubMed
Makel, M. C., Plucker, J. A., and Hegarty, B. 2012. ‘Replications in Psychology Research: How Often Do They Really Occur?Perspectives on Psychological Science, 7: 537–42.CrossRefGoogle ScholarPubMed
Mallon, R., Machery, E., Nichols, S., and Stich, S. 2009. ‘Against Arguments from Reference.’ Philosophy and Phenomenological Research, 79: 332–56.CrossRefGoogle Scholar
Miellet, S., Zhou, X., He, L., Rodger, H., and Caldara, R. 2010. ‘Investigating Cultural Diversity for Extrafoveal Information Use in Visual Scenes.’ Journal of Vision, 10(6): 21.CrossRefGoogle ScholarPubMed
Minsun, K., and Yuan, Y. Manuscript. No Cross-Cultural Differences in Gettier Car Case Intuition: A Replication Study of Weinberg et al. 2001.Google Scholar
Nadelhoffer, T. and Nahmias, E. 2007. ‘The Past and Future of Experimental Philosophy.’ Philosophical Explorations, 10: 123–49.CrossRefGoogle Scholar
Nagel, J. 2012. ‘Intuitions and Experiments: A Defense of the Case Method in Epistemology.’ Philosophy and Phenomenological Research, 85: 495527.CrossRefGoogle Scholar
Nagel, J. 2013. ‘Defending the Evidential Value of Epistemic Intuitions: A Reply to Stich.’ Philosophy and Phenomenological Research, 87: 179–99.CrossRefGoogle Scholar
Nagel, J., Juan, V. S., and Mar, R. A. 2013. ‘Lay Denial of Knowledge for Justified True Beliefs.’ Cognition, 129: 652–61.CrossRefGoogle ScholarPubMed
Neuliep, J. W. and Crandall, R. 1991. ‘Editorial Bias Against Replication Research.’ In Neuliep, J. W. (ed.), Replication Research in the Social Sciences, pp. 31–7. Newbury Park, CA: Sage.Google Scholar
Nichols, S. 2004. ‘Folk Concepts and Intuitions: From Philosophy to Cognitive Science.’ Trends in Cognitive Sciences, 8: 514–18.CrossRefGoogle ScholarPubMed
Nisbett, R. E., Peng, K., Choi, I., and Norenzayan, A. 2001. ‘Culture and Systems of Thought: Holistic versus Analytic Cognition.’ Psychological Review, 108: 291.CrossRefGoogle ScholarPubMed
Nosek, B. A. 2012. ‘Reproducibility Project.’ https://openscienceframework.org/project/EZcUj/statistics.Google Scholar
Nosek, B. A., Spies, J. R., and Motyl, M. 2012. ‘Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability.’ Perspectives on Psychological Science, 7: 615–31.CrossRefGoogle ScholarPubMed
Osbeck, L. M. 1999. ‘Conceptual Problems in the Development of a Psychological Notion of ‘Intuition’.’ Journal for the Theory of Social Behaviour, 29: 229–49.CrossRefGoogle Scholar
Pardo, M. S. 2005. ‘The Field of Evidence and the Field of Knowledge.’ Law and Philosophy, 24: 321–92.CrossRefGoogle Scholar
Pashler, H. and Harris, C. R. 2012. ‘Is the Replicability Crisis Overblown? Three Arguments Examined.’ Perspectives on Psychological Science, 7: 531–6.CrossRefGoogle ScholarPubMed
Pashler, H. and Wagenmakers, E. J. 2012. ‘Editors' Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?Perspectives on Psychological Science, 7: 528–30.CrossRefGoogle ScholarPubMed
Popper, K. R. 2002. The Logic of Scientific Discovery. London: Routledge.Google Scholar
Ramsey, W. 1992. ‘Prototypes and Conceptual Analysis.’ Topoi, 11: 5970.CrossRefGoogle Scholar
Rayner, K., Li, X., Williams, C. C., Cave, K. R., and Well, A. D. 2007. ‘Eye Movements During Information Processing Tasks: Individual Differences and Cultural Effects.’ Vision Research, 47: 2714–26.CrossRefGoogle ScholarPubMed
Rayner, K., Castelhano, M. S., and Yang, J. 2009. ‘Eye Movements when Looking at Unusual/Weird Scenes: Are There Cultural Differences?Journal of Experimental Psychology: Learning, Memory, and Cognition, 35: 254.Google ScholarPubMed
Ritchie, S. J., Wiseman, R., and French, C. C. 2012. ‘Replication, Replication, Replication.’ Psychologist, 25: 346–8.Google Scholar
Shafir, E. 1998. Philosophical intuitions and cognitive mechanisms. In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 5975. Lanham, MD: Rowman & Littlefield.Google Scholar
Shieber, J. 2010. ‘On the Nature of Thought Experiments and a Core Motivation of Experimental Philosophy.’ Philosophical Psychology, 23: 547–64.CrossRefGoogle Scholar
Smith, N. C. 1970. ‘Replication Studies: A Neglected Aspect of Psychological Research.’ American Psychologist, 25: 970.CrossRefGoogle Scholar
Sosa, D. 2006. ‘Scepticism about Intuition.’ Philosophy, 318: 633.CrossRefGoogle Scholar
Sosa, E. 1998. Minimal Intuition. In DePaul, M. R. and Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 257–71. Lanham, MD: Rowman & Littlefield.Google Scholar
Sosa, E. 2007. ‘Experimental Philosophy and Philosophical Intuition.’ Philosophical Studies, 132: 99107.CrossRefGoogle Scholar
Sosa, E. 2009. ‘A Defense of the Use of Intuitions in Philosophy.’ In Bishop, M. and Murphy, D. (eds), Stich and His Critics, pp. 101–12. Oxford: Blackwell.Google Scholar
Starmans, C. and Friedman, O. 2012. ‘The Folk Conception Of Knowledge.’ Cognition, 124: 272–83.CrossRefGoogle Scholar
Stich, S. 1988. ‘Reflective Equilibrium, Analytic Epistemology and the Problem of Cognitive Diversity.’ Synthese, 74: 391413.CrossRefGoogle Scholar
Stich, S. 2001. ‘Plato's Method Meets Cognitive Science.’ http://www.rci.rutgers.edu/~stich/Publications/Papers/Plato_Method.pdf.Google Scholar
Symons, J. 2008. ‘Intuition and Philosophical Methodology.’ Axiomathes, 18: 6789.CrossRefGoogle Scholar
Turri, J. 2013. A Conspicuous Art: Putting Gettier to the Test. Ann Arbor, MI: Michigan Publishing, University of Michigan Library.Google Scholar
Weatherson, B. 2003. ‘What Good are Counterexamples?Philosophical Studies, 115: 131.CrossRefGoogle Scholar
Weinberg, J. M., Nichols, S., and Stich, S. 2001. ‘Normativity and Epistemic Intuitions.’ Philosophical Topics, 29: 429–60.CrossRefGoogle Scholar
Wild, K. W. 1938. Intuition. Cambridge: Cambridge University Press.Google Scholar
Williamson, T. 2004. ‘Philosphical ‘Intuitions’ and Scepticism about Judgement.' Dialectica, 58: 109–53.CrossRefGoogle Scholar
Williamson, T. 2011. ‘Philosophical Expertise and the Burden of Proof.’ Metaphilosophy, 42: 215–29.CrossRefGoogle Scholar
Wisniewski, E. J. 1998. ‘The Psychology of Intuition.’ In DePaul, M. R. & Ramsey, W. (eds), Rethinking Intuition: The Psychology of Intuition and its Role in Philosophical Inquiry, pp. 4559. Lanham, MD: Rowman and Littlefield.Google Scholar
Wright, J. C. 2010. ‘On Intuitional Stability: The Clear, the Strong, and the Paradigmatic.’ Cognition, 115: 491503.CrossRefGoogle ScholarPubMed
Zamzow, J. L. and Nichols, S. 2009. ‘Variations in Ethical Intuitions.’ Philosophical Issues, 19: 368–88.CrossRefGoogle Scholar
Zhou, J., Gotch, C., Zhou, Y., and Liu, Z. 2008. ‘Perceiving an object in its context: Is the Context Cultural or Perceptual?Journal of Vision, 8: 2.15.CrossRefGoogle ScholarPubMed