Skip to main content
    • Aa
    • Aa

Kinds versus continua: a review of psychometric approaches to uncover the structure of psychiatric constructs

  • D. Borsboom (a1), M. Rhemtulla (a1), A. O. J. Cramer (a1), H. L. J. van der Maas (a1), M. Scheffer (a2) and C. V. Dolan (a3)...

The question of whether psychopathology constructs are discrete kinds or continuous dimensions represents an important issue in clinical psychology and psychiatry. The present paper reviews psychometric modelling approaches that can be used to investigate this question through the application of statistical models. The relation between constructs and indicator variables in models with categorical and continuous latent variables is discussed, as are techniques specifically designed to address the distinction between latent categories as opposed to continua (taxometrics). In addition, we examine latent variable models that allow latent structures to have both continuous and categorical characteristics, such as factor mixture models and grade-of-membership models. Finally, we discuss recent alternative approaches based on network analysis and dynamical systems theory, which entail that the structure of constructs may be continuous for some individuals but categorical for others. Our evaluation of the psychometric literature shows that the kinds–continua distinction is considerably more subtle than is often presupposed in research; in particular, the hypotheses of kinds and continua are not mutually exclusive or exhaustive. We discuss opportunities to go beyond current research on the issue by using dynamical systems models, intra-individual time series and experimental manipulations.

Corresponding author
*Address for correspondence: D. Borsboom, Department of Psychology, University of Amsterdam, Weesperplein 4, Amsterdam 1018 XA, The Netherlands. (Email:
Hide All
AO Ahmed , PF Buckley , PA Mabe (2012). Latent structure of psychotic experiences in the general population. Acta Psychiatrica Scandinavia 125, 5465.

G Arminger , P Stein , J Wittenberg (1999). Mixtures of conditional mean- and covariance-structure models. Psychometrika 64, 475494.

SM Boker , PCM Molenaar , JR Nesselroade (2009). Issues in intraindividual variability: individual differences in equilibria and dynamics over multiple time scales. Psychology and Aging 24, 858862.

D Borsboom (2005). Measuring the Mind: Conceptual Issues in Contemporary Psychometrics. Cambridge University Press: Cambridge.

D Borsboom , AOJ Cramer (2013). Networks: an integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology 9, 91121.

D Borsboom , GJ Mellenbergh , J Van Heerden (2003). The theoretical status of latent variables. Psychological Review 110, 203219.

LF Bringmann , N Vissers , M Wichers , N Geschwind , P Kuppens , F Peeters , D Borsboom , F Tuerlinckx (2013). A network approach to psychopathology: new insights into clinical longitudinal data. PLOS ONE 8, e60188.

SL Clark , B Muthén , J Kaprio , BM D'Onofrio , R Viken , RJ Rose (2013). Models and strategies for factor mixture analysis: an example concerning the structure underlying psychological disorders. Structural Equation Modeling: A Multidisciplinary Journal 20, 681703.

G Cooper , SM Humphry (2012). The ontological distinction between units and entities. Synthese 187, 393401.

AOJ Cramer , S van der Sluis , A Noordhof , M Wichers , N Geschwind , SH Aggen , KS Kendler , D Borsboom (2012 b). Dimensions of normal personality as networks in search of equilibrium: you can't like parties if you don't like people. European Journal of Personality 26, 414431.

LJ Cronbach , PE Meehl (1955). Construct validity in psychological tests. Psychological Bulletin 52, 281302.

MA Croon (1990). Latent class analysis with ordered latent classes. British Journal of Mathematical and Statistical Psychology 43, 171192.

P De Boeck , M Wilson , GS Acton (2005). A conceptual and psychometric framework for distinguishing categories and dimensions. Psychological Review 112, 129158.

CV Dolan , HLJ Van der Maas (1998). Fitting multivariate normal finite mixtures subject to structural equation modeling. Psychometrika 63, 227253.

S Epskamp , AOJ Cramer , LJ Waldorp , VD Schmittmann , D Borsboom (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software 48, 118.

EA Erosheva (2005). Comparing latent structures of the grade of membership, Rasch, and latent class models. Psychometrika 70, 619628.

D Forbes , N Haslam , BJ Williams , M Creamer (2005). Testing the latent structure of posttraumatic stress disorder: a taxometric study of combat veterans. Journal of Traumatic Stress 18, 647656.

PF Halpin , CV Dolan , RPPP Grasman , P De Boeck (2011). On the relation between the linear factor model and the latent profile model. Psychometrika 76, 564583.

EL Hamaker , JR Nesselroade , CM Molenaar (2007). The integrated trait–state model. Journal of Research in Personality 41, 295315.

ME Hyland (2011). The Origins of Health and Disease. Cambridge University Press: Cambridge, UK.

A Jablensky (2006). Subtyping schizophrenia: implications for genetic research. Molecular Psychiatry 11, 815836.

R Kindermann , JL Snell (1980). Markov Random Fields and their Applications. American Mathematical Society: Providence, RI.

P Kuppens , NB Allen , LB Sheeber (2010). Emotional inertia and psychological maladjustment. Psychological Science 21, 984991.

GH Lubke , B Muthén (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods 10, 2139.

GH Lubke , M Neale (2006). Distinguishing between latent classes and continuous factors: resolution by maximum likelihood. Multivariate Behavioral Research 41, 499532.

GH Lubke , M Neale (2008). Distinguishing between latent classes and continuous factors with categorical outcomes: class invariance of parameters of factor mixture models. Multivariate Behavioral Research 43, 592620.

RC MacCallum , S Zhang , KJ Preacher , DD Rucker (2002). On the practice of dichotomization of quantitative variables. Psychological Methods 7, 1940.

MD Maraun , K Slaney (2005). An analysis of Meehl's MAXCOV-HITMAX procedure for continuous indicators. Multivariate Behavioral Research 40, 489518.

MD Maraun , K Slaney , L Goddyn (2003). An analysis of Meehl's MAXCOV-HITMAX procedure for dichotomous indicators. Multivariate Behavioral Research 38, 81112.

KA Markus , D Borsboom (2012). The cat came back: evaluating arguments against psychological measurement. Theory and Psychology 22, 452466.

K Masyn , C Henderson , P Greenbaum (2010). Exploring the latent structures of psychological constructs in social development using the dimensional–categorical spectrum. Social Development 19, 470493.

AL McCutcheon (1987). Latent Class Analysis. Quantitative Applications in the Social Sciences Series no. 64. Sage: Thousand Oaks, CA.

RE McGrath , GD Walters (2012). Taxometric analysis as a general strategy for distinguishing categorical from dimensional latent structure. Psychological Methods 17, 284293.

G McLachlan , D Peel (2000). Finite Mixture Models. Wiley: New York.

PE Meehl (1992). Factors and taxa, traits and types, difference of degree and differences in kind. Journal of Personality 60, 117174.

PE Meehl (1995). Bootstraps taxometrics: solving the classification problem in psychopathology. American Psychologist 50, 266275.

GJ Mellenbergh (1989). Item bias and item response theory. International Journal of Educational Research 13, 127143.

GJ Mellenbergh (1994). Generalized linear item response theory. Psychological Bulletin 115, 300307.

W Meredith (1993). Measurement invariance, factor analysis, and factorial invariance. Psychometrika 58, 525543.

J Michell (1997). Quantitative science and the definition of measurement in psychology. British Journal of Psychology 88, 355383.

J Michell (1999). Measurement in Psychology: A Critical History of a Methodological Concept. Cambridge University Press: Cambridge, UK.

D Molenaar , CV Dolan , ND Verhelst (2010). Testing and modeling non-normality within the one factor model. British Journal of Mathematical and Statistical Psychology 63, 293317.

PCM Molenaar , CG Campbell (2009). The new person-specific paradigm in psychology. Current Directions in Psychology 18, 112117.

MA Montpetit , CS Bergeman , PR Deboeck , SS Tiberio , SM Boker (2010). Resilience-as-process: negative affect, stress, and coupled dynamical systems. Psychology and Aging 25, 631640.

B Muthén (2006). Should substance use disorders be considered as categorical or dimensional? Addiction 101 (Suppl. 1), 616.

HG Nurnberg , MA Woodbury , MP Bogenschutz (1999). A mathematical typology analysis of DSM-III-R personality disorder. Comprehensive Psychiatry 40, 6171.

ML Pe , K Kircanski , RJ Thompson , LF Bringmann , F Tuerlinckx , M Mestdagh , J Mata , SM Jaeggi , M Buschkuehl , J Jonides , P Kuppens , IH Gotlib (2015). Emotion-network density in major depressive disorder. Clinical Psychological Science 3, 292300.

J Pearl (2009). Causality: Models, Reasoning, and Inference, 2nd edn.Cambridge University Press: Cambridge, UK.

SP Reise , NG Waller (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology 5, 2748.

J Ruscio , AM Ruscio , M Meron (2007). Applying the bootstrap to taxometric analysis: generating empirical sampling distributions to help interpret results. Multivariate Behavioral Research 42, 349386.

M Scheffer , J Bascompte , WA Brock , V Brovkin , SR Carpenter , V Dakos , H Held , EH van Nes , M Rietkerk , G Sugihara (2009). Early-warning signals for critical transitions. Nature 461, 5359.

M Scheffer , SR Carpenter , TM Lenton , J Bascompte , W Brock , V Dakos , J van de Koppel , IA van de Leemput , SA Levin , EH van Nes , M Pascual , J Vandermeer (2012). Anticipating critical transitions. Science 338, 344348.

JE Schmitt , SH Aggen , PD Mehta , TS Kubarych , MC Neale (2006). Semi-nonparametric methods for detecting latent non-normality: a fusion of latent trait and ordered latent class modeling. Multivariate Behavioral Research 41, 427443.

SS Stevens (1946). On the theory of scales of measurement. Science 103, 667680.

G Trendler (2009). Measurement theory, psychology, and the revolution that cannot happen. Theory and Psychology 19, 579599.

CD Van Borkulo , D Borsboom , S Epskamp , TF Blanken , L Boschloo , RA Schoevers , LJ Waldorp (2014). A new method for constructing networks from binary data. Scientific Reports 4, 5918.

IA Van de Leemput , M Wichers , AOJ Cramer , D Borsboom , F Tuerlinckx , P Kuppens , EH Van Nes , W Viechtbauer , EJ Giltay , SH Aggen , C Derom , N Jacobs , KS Kendler , HLJ Van der Maas , MC Neale , F Peeters , E Thiery , P Zachar , M Scheffer (2014). Critical slowing down as early warning for the onset and termination of depression. Proceedings of the National Academy of Sciences USA 111, 8792.

HLJ Van der Maas , PCM Molenaar (1992). Stagewise cognitive development: an application of catastrophe theory. Psychological Review 99, 395417.

S Van der Sluis , D Posthuma , MG Nivard , M Verhage , CV Dolan (2013). Power in GWAS: lifting the curse of the clinical cut-off. Molecular Psychiatry 18, 23.

JK Vermunt (2001). The use of restricted latent class models for defining and testing nonparametric and parametric item response theory models. Applied Psychological Measurement 25, 283294.

MA Woodbury , KG Manton (1989). Grade of membership analysis of depression-related psychiatric disorders. Sociological Methods and Research 18, 126163.

YF Yung (1997). Finite mixtures in confirmatory factor-analysis models. Psychometrika 62, 297330.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Psychological Medicine
  • ISSN: 0033-2917
  • EISSN: 1469-8978
  • URL: /core/journals/psychological-medicine
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Altmetric attention score

Full text views

Total number of HTML views: 11
Total number of PDF views: 184 *
Loading metrics...

Abstract views

Total abstract views: 525 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 17th October 2017. This data will be updated every 24 hours.