Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-10-30T10:46:36.076Z Has data issue: false hasContentIssue false

9 - The simplicity model of unsupervised categorization

Published online by Cambridge University Press:  05 June 2012

Emmanuel M. Pothos
Affiliation:
Swansea University
Andy J. Wills
Affiliation:
University of Exeter
Get access

Summary

Summary

The main objective of the simplicity model of unsupervised categorization is to predict the relative intuitiveness of different classifications of items, based on their similarity. The model derives from the minimum description length framework, which is an algorithmic formalization of Ockham's razor. It generally prefers classifications which maximize within- category similarity, while minimizing between-category similarity.

Description of the model

The simplicity model of categorization can be viewed as one route to the formalization of Rosch and Mervis's (1975) proposal concerning the nature of ‘basic level’ categories, that is, the categories with which we prefer to classify objects (as opposed to corresponding superordinate or subordinate categories). According to Rosch and Mervis, basic level categories are those that maximize within-category similarity and minimize between-category similarity. Pothos and Chater (2002) examined whether this proposal may be suitable for predicting category preference generally, within a computational framework based on the simplicity principle.

The application of the simplicity principle in psychology has its origins in theories of perception (e.g., Hochberg & McAlister, 1953; Mach, 1959/1906). Informally, the simplicity principle states that simple explanations should be preferred – here ‘explanation’ refers to a pattern or structure in the data. The intuition is that the degree to which a pattern is suggested by the data can be quantified by assessing how briefly the data can be encoded, using that pattern.

Type
Chapter
Information
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anderson, J. R. (1991). The adaptive nature of human categorization. Psychological Review, 98, 409–429.CrossRefGoogle Scholar
Ashby, G. F., Alfonso-Reese, L. A., Turken, A. U., & Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning. Psychological Review, 105, 442–481.CrossRefGoogle ScholarPubMed
Attneave, F. (1959). Applications of Information Theory to Psychology. New York: Holt, Rinehart & Winston.Google Scholar
Barlow, B. H. (1974). Inductive inference, coding, perception, and language. Perception, 3, 123–134.CrossRefGoogle Scholar
Brent, M. R., & Cartwright, T. A. (1996). Distributional regularity and phonotactic constraints are useful for segmentation. Cognition, 61, 93–125.CrossRefGoogle ScholarPubMed
Busemeyer, J. R., Matthew, M., & Wang, Z. A. (2006). Quantum game theory explanation of disjunction effects. In Sun, R. & Miyake, N. (eds.), Proceedings of the 28th Annual Conference of the Cognitive Science Society (pp. 131–135). Mahwah, NJ: Erlbaum.Google Scholar
Chater, N. (1996). Reconciling simplicity and likelihood principles in perceptual organization. Psychological Review, 103, 566–591.CrossRefGoogle ScholarPubMed
Chater, N. (1999). The search for simplicity: a fundamental cognitive principle?Quarterly Journal of Experimental Psychology, 52A, 273–302.CrossRefGoogle Scholar
Colreavy, E., & Lewandowsky, S. (2008). Strategy development and learning differences in supervised and unsupervised categorization. Memory & Cognition, 36, 762–775.CrossRefGoogle ScholarPubMed
Compton, B. J., & Logan, G. D. (1993). Evaluating a computational model of perceptual grouping. Perception & Psychophysics, 53, 403–421.CrossRefGoogle ScholarPubMed
Compton, B. J. & Logan, G. D. (1999). Judgments of perceptual groups: reliability and sensitivity to stimulus transformation. Perception & Psychophysics, 61, 1320–1335.CrossRefGoogle ScholarPubMed
Comtet, L. (1974). Advanced Combinatorics, the Art of Finite and Infinite Expansions. Dordrecht: Reidel.Google Scholar
Feldman, J. (2000). Minimization of Boolean complexity in human concept learning. Nature, 407, 630–633.CrossRefGoogle ScholarPubMed
Fraboni, M., & Cooper, D. (1989). Six clustering algorithms applied to the WAIS-R: the problem of dissimilar cluster analysis. Journal of Clinical Psychology, 45, 932–935.3.0.CO;2-T>CrossRefGoogle Scholar
Garner, W. R. (1974). The Processing of Information and Structure. Potomac, MD: LEA.Google Scholar
Gosselin, F. & Schyns, P. G. (2001). Why do we SLIP to the basic-level? Computational constraints and their implementation. Psychological Review, 108, 735–758.CrossRefGoogle ScholarPubMed
Gureckis, T. M., & Goldstone, R. L. (2008). The effect of the internal structure of categories on perception. In Proceedings of the 30th Annual Meeting of the Cognitive Science Society. Mahwah, NJ: Lawrence Erlbaum.Google Scholar
Hahn, U., Chater, N., & Richardson, L. B. C. (2003). Similarity as transformation. Cognition, 87, 1–32.CrossRefGoogle ScholarPubMed
Hines, P., Pothos, E. M., & Chater, N. (2007). A non-parametric approach to simplicity clustering. Applied Artificial Intelligence, 21, 729–752.CrossRefGoogle Scholar
Hochberg, J. E., & McAlister, E. (1953). A quantitative approach to figural goodness. Journal of Experimental Psychology, 46, 361–364.CrossRefGoogle ScholarPubMed
Kurtz, K. J. (2007). The divergent autoencoder (DIVA) model of category learning. Psychonomic Bulletin & Review, 14, 560–576.CrossRefGoogle Scholar
Leeuwenberg, E. (1969). Quantitative specification of information in sequential patterns. Psychological Review, 76, 216–220.CrossRefGoogle ScholarPubMed
Li, M., & Vitányi, P. (1997). An Introduction to Kolmogorov Complexity and its Applications (2nd edition). Berlin: Springer-Verlag.CrossRefGoogle Scholar
Love, B. C., Medin, D. L., & Gureckis, T. M. (2004). SUSTAIN: a network model of category learning. Psychological Review, 111, 309–332.CrossRefGoogle ScholarPubMed
Mach, E. (1959/1906). The Analysis of Sensations and the Relation of the Physical to the Psychical. New York: Dover Publications.Google Scholar
Milton, F., Longmore, C. A., & Wills, A. J. (2008). Processes of overall similarity sorting in free classification. Journal of Experimental Psychology: Human Perception and Performance, 34, 676–692.Google ScholarPubMed
Milton, F., & Wills, A. J. (2004). The influence of stimulus properties on category construction. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 407–415.Google ScholarPubMed
Milton, F., Wills, A. J., & Hodgson, T. L. (2009). The neural basis of overall similarity sorting. NeuroImage, 46, 319–326.CrossRefGoogle Scholar
Murphy, G. L. (1991). Parts in object concepts: experiments with artificial categories. Memory & Cognition, 19, 423–438.CrossRefGoogle ScholarPubMed
Murphy, G. L., & Allopenna, P. D. (1994). The locus of knowledge effects in concept learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 904–919.Google ScholarPubMed
Nielsen, M. A., & Chuang, L. L. (2000). Quantum Computation and Quantum Information. Cambridge: Cambridge University Press.Google Scholar
Oaksford, M., & Chater, N. (1994). A rational analysis of the selection task as optimal data selection. Psychological Review, 101, 608–631.CrossRefGoogle Scholar
Op de Beeck, H., Torfs, K., & Wagemans, J. (2008). Perceived shape similarity among unfamiliar objects and the organization of the human object vision pathway. Journal of Neuroscience, 28, 10111–10123.CrossRefGoogle ScholarPubMed
Pomerantz, J. R., & Kubovy, M. (1986). Theoretical approaches to perceptual organization: simplicity and likelihood principles. In Boff, K. R., Kaufman, L., & Thomas, J. P. (Eds.), Handbook of Perception and Human Performance, Vol. II: Cognitive Processes and Performance (pp. 1–45). New York: Wiley.Google Scholar
Pothos, E. M. (2007). Occam and Bayes in predicting category intuitiveness. Artificial Intelligence Review, 21 (8), 729–752.Google Scholar
Pothos, E. M., & Bailey, T. M. (2009). Predicting category intuitiveness with the rational model, the simplicity model, and the Generalized Context Model. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1062–1080.Google ScholarPubMed
Pothos, E. M., & Chater, N. (2002). A simplicity principle in unsupervised human categorization. Cognitive Science, 26, 303–343.CrossRefGoogle Scholar
Pothos, E. M., & Chater, N. (2005). Unsupervised categorization and category learning. Quarterly Journal of Experimental Psychology, 58A, 733–752.CrossRefGoogle Scholar
Pothos, E. M., & Close, J. (2008). One or two dimensions in spontaneous classification: a simplicity approach. Cognition, 107, 581–602.CrossRefGoogle ScholarPubMed
Pothos, E. M., Perlman, A., Edwards, D. J., Gureckis, T. M., Hines, P. M., & Chater, N. (2008). Modeling category intuitiveness. In Proceedings of the 30th Annual Conference of the Cognitive Science Society. Mahwah, NJ: LEA.Google Scholar
Pothos, E. M., & Wolff, J. G. (2006). The simplicity and power model for inductive inference. Artificial Intelligence Review, 26, 211–225.CrossRefGoogle Scholar
Rissanen, J. (1978). Modeling by shortest data description. Automatica, 14, 465–471.CrossRefGoogle Scholar
Rissanen, J. (1986). Stochastic complexity and modeling. Annals of Statistics, 14, 1080–1100.CrossRefGoogle Scholar
Rosch, E., & Mervis, C. B. (1975). Family resemblances: studies in the internal structure of categories. Cognitive Psychology, 7, 573–605.CrossRefGoogle Scholar
Sanborn, A. N., Griffiths, T. L., & Navarro, D. (2006). A more rational model of categorization. In Sun, R. & Miyake, N. (eds.), Proceedings of the 28th Annual Conference of the Cognitive Science Society. Mahwah, NJ: Erlbaum.Google Scholar
Stewart, N., & Brown, G. D. A. (2005). Similarity and dissimilarity as evidence in perceptual categorization. Journal of Mathematical Psychology, 49, 403–409.CrossRefGoogle Scholar
Tversky, A. (1977). Features of similarity. Psychological Review, 84, 327–352.CrossRefGoogle Scholar
Wallace, C. S., & Freeman, P. R. (1987). Estimation and inference by compact coding. Journal of the Royal Statistical Society, Series B, 49, 240–251.Google Scholar
Wolff, J. G. (1977). The discovery of segmentation in natural language. British Journal of Psychology, 67, 377–390.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×