Skip to main content
×
×
Home
  • Print publication year: 2006
  • Online publication date: June 2012

9 - Evaluating Theories

Summary

All theories are false (Popper, 1959). So in one sense evaluating theories is a straightforward matter. However, some theories are more false than others. Furthermore, some theories have characteristics that tend to promote the advance of scientific knowledge. In this chapter, we examine what some of those characteristics are and how one goes about the process of identifying and building useful theories.

A theory is a concise statement about how we believe the world to be. Theories organize observations of the world and allow researchers to make predictions about what will happen in the future under certain conditions. Science is about the testing of theories, and the data that we collect as scientists should either implicitly or explicitly bear on theory.

There is, however, a great difference between theories in the hard sciences and theories in the soft sciences in their formal rigor. Formal theories are well established and incredibly successful in physics, but they play a lesser role in biology, and even less in psychology, where theories are often stated in verbal form. This has certainly been true historically, but some scientists, especially physicists, as well as laypeople, construe this fact to mean that formal theories are restricted to the hard sciences, particularly physics, while formalization is unattainable in the soft sciences. There is absolutely no reason to think so. Indeed, this is a pernicious idea that would permanently relegate psychology to second-class status.

Recommend this book

Email your librarian or administrator to recommend adding this book to your organisation's collection.

Critical Thinking in Psychology
  • Online ISBN: 9780511804632
  • Book DOI: https://doi.org/10.1017/CBO9780511804632
Please enter your name
Please enter a valid email address
Who would you like to send this to *
×
References
Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In Petrox, B. N. & Caski, F. (Eds.), Second international symposium on information theory (pp. 267–281). Budapest, Hungary: Akadémiai Kiadṍ.
Anderson, J. R. (1990). The adaptive character of thought. Hillsdale, NJ: Erlbaum.
Anderson, J. R., & Lebiere, C. (1998). The atomic components of thought. Mahwah, NJ: Erlbaum.
Anderson, J. R., & Schooler, L. J. (1991). Reflections of the environment in memory. Psychological Science, 2, 396–408.
Bozdogan, H. (1990). On the information-based measure of covariance complexity and its application to the evaluation of multivariate linear models. Communications in Statistics: Theory and Methods, 19, 221–278.
Broadbent, D. (1987). Simple models for experimental situations. In Morris, P. (Ed.), Modeling cognition (pp. 169–185). London: Wiley.
Brown, S. C., & Craik, F. I. M. (2000). Encoding and retrieval of information. In Tulving, E. and Craik, F. I. M. (Eds.), The Oxford handbook of memory (pp. 93–108). New York: Oxford University Press.
Bush, V. (1945). Science – The endless frontier, appendix 3. (Report of the Committee on Science and the Public Welfare). Washington, DC: U.S. Government Printing Office.
Cary, M., & Reder, L. M. (2003). A dual-process account of the list-length and strength-based mirror effects in recognition. Journal of Memory and Language, 49, 231–248.
Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49, 997–1003.
Dennis, S., & Humphreys, M. S. (2001). A context noise model of episodic word recognition. Psychological Review, 108, 452–477.
Gilbert, G. N., & Mulkay, (1984). Opening Pandora's box: A sociological analysis of scientists' discourse. Cambridge, England: Cambridge University Press.
Gillund, G., & Shiffrin, R. M. (1984). A retrieval model for both recognition and recall. Psychological Review, 91, 1–67.
Gronlund, S. D., & Elam, L. E. (1994). List-length effect: Recognition accuracy and variance of underlying distributions. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 1355–1369.
Hintzman, D. L. (1984). MINERVA2: A simulation model of human memory. Behavior Research Methods, Instruments, and Computers, 16, 96–101.
Hintzman, D. L. (1991). Why are formal models useful in psychology? In Hockley, W. E. and Lewandowsky, S. (Eds.), Relating theory and data: Essays on human memory in honor of Bennet B. Murdock (pp. 39–56). Hillsdale, NJ: Erlbaum.
Humphreys, M. S., Bain, J. D., & Pike, R. (1989). Different ways to cue a coherent memory system: A theory for episodic, semantic and procedural tasks. Psychological Review, 96, 208–233.
Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795.
Kintsch, W. (1977). Memory and Cognition. New York: Wiley.
Kintsch, W. (1998). Comprehension: A paradigm for cognition. New York: Cambridge University Press.
Kuhn, T. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press.
Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction and representation of knowledge. Psychological Review, 104, 211–240.
Landauer, T. K., Laham, D., & Foltz, P. W. (2000). The Intelligent Essay Assessor. IEEE Intelligent Systems, 15(5), 27–31.
Leahey, T. H., & Harris, R J. (1985). Human learning. Englewood Cliffs, NJ: Prentice-Hall.
Murdock, B. B. Jr. (1982). A theory for the storage and retrieval of items and associative information. Psychological Review, 89, 609–626.
Myung, I. J., Balasubramanian, V., & Pitt, M. A. (2000). Counting probability distributions: Differential geometry and model selection. Proceedings of the National Academy of Sciences USA, 97, 11,170–11,175.
Myung, I. J., Kim, C., & Pitt, M. A. (2000). Towards an explanation of the power law artifact: Insights from response surface analysis. Memory & Cognition, 28, 832–840.
Myung, I. J., & Pitt, M. A. (1997). Applying Occam's razor in modeling cognition: A Bayesian approach. Psychonomic Bulletin & Review, 4, 79–95.
Navarro, D. J., & Lee, M. D. (in press). Common and distinctive features in stimulus representation: A modified version of the contrast model. Psychonomic Bulletin & Review.
Navarro, D. J., Myung, I. J., Pitt, M. A., & Kim, W. (2003). Global model analysis by landscaping. In R. Alterman & D. Kirsh (Eds.), Proceedings of the 25th Annual Conference of the Cognitive Science Society. Mahwah, NJ: Lawrence Erlbaum.
Newell, A. (1973). You can't play twenty questions with nature and win. In Chase, W. C. (Ed.), Visual information processing (pp. 283–308). New York: Academic Press.
Newell, A. (1990). Unified theories of cognition. Cambridge, MA: Harvard University Press.
Pitt, M. A., & Myung, I. J. (2002). When a good fit can be bad. Trends in Cognitive Sciences, 6, 421–425.
Pitt, M. A., Myung, I. J., & Zhang, S. (2002). Towards a method of selecting amoung computational models of cognition. Psychological Review, 109, 472–491.
Popper, K. R. (1959). The logic of scientific discovery. London: Hutchinson.
Ratcliff, R., Clarke, S., & Shiffrin, R. (1990). The list strength effect: I. Data and discussion. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 163–178.
Rescorla, R. A. (1970). Reduction in the effectiveness of reinforcement after prior excitatory conditioning. Learning and Motivation, 1, 372–381.
Rissanen, J. (1996). Fisher information and stochastic complexity. IEEE Transactions in Information Theory, 42, 40–47.
Roberts, S., & Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107, 358–367.
Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464.
Stokes, D. E. (1997). Pasteur's quadrant: Basic science and technological innovation. Washington, DC: Brookings Institution Press.
Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions (with discussion). Journal of the Royal Statistical Society Series B, 36, 111–147.
Wagenmakers, E. J., Ratcliff, R.Gomez, P., & Iverson, G. J. (2004). Assessing model mimicry using the parametric bootstrap. Journal of Mathematical Psychology, 48, 28–50.
Watkins, M. J. (1990). Mediationism and the obfuscation of memory. American Psychologist, 45, 328–335.
Wilkinson, L., and the Task Force on Statistical Inference APA Board of Scientific Affairs. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594–604.