Hostname: page-component-76fb5796d-9pm4c Total loading time: 0 Render date: 2024-04-29T04:04:53.895Z Has data issue: false hasContentIssue false
  • English
  • Français

Psychometric evaluation of the DSM-IV criterion B mania symptoms in an Australian national sample

Published online by Cambridge University Press:  14 May 2012

N. Carragher ,
L. M. Weinstock  and
D. Strong
N. Carragher*
Affiliation:
National Drug and Alcohol Research Centre, University of New South Wales, Sydney, NSW, Australia
L. M. Weinstock
Affiliation:
Warren Alpert Medical School of Brown University, Butler Hospital, Providence, RI, USA
D. Strong
Affiliation:
Department of Family and Preventive Medicine, UCSD Moores Cancer Center, La Jolla, CA, USA
*
*Address for correspondence: Dr N. Carragher, National Drug and Alcohol Research Centre, University of New South Wales, Sydney, NSW 2031, Australia. (Email: n.carragher@unsw.edu.au)
Get access Rights & Permissions [Opens in a new window]

Abstract

Background

Although numerous studies have examined the latent structure of major depression, less attention has focused on mania. This paper presents the first investigation outside the USA to evaluate the psychometric properties of the DSM-IV criterion B mania symptoms using item response theory (IRT).

Method

Data were drawn from the Australian 2007 National Survey of Mental Health and Well-Being (NSMHWB, n = 8841). The psychometric performance of the mania symptoms was evaluated using a two-parameter logistic model. Because substance use disorders (SUDs) frequently co-occur with mania and can influence manic symptom expression, differential item functioning (DIF) between mania respondents with/without a SUD diagnosis was also assessed.

Results

Factor analysis supported a unidimensional trait underlying mania. The grandiosity symptom displayed the highest discrimination whereas discrimination was lowest for decreased need for sleep. Relatively speaking, grandiosity tapped the severe end and increased goal-oriented activities tapped the mild end of the mania severity continuum. The symptoms generally performed equivalently between those with/without a SUD diagnosis, with one exception; the activities with painful consequences symptom was endorsed at lower levels of severity, and hence more frequently, by those with a SUD diagnosis versus those without a SUD diagnosis.

Conclusions

Accurate conceptualization of latent structure has crucial theoretical, statistical and clinical implications. The symptoms generally performed well in distinguishing between respondents with differing levels of liability, but others did not, suggesting modification is warranted to ensure optimal use in epidemiological samples. Given the dearth of psychometric evaluation studies of mania, further research replicating these results is necessary.

Keywords

DIFDSM-IVepidemiologicitem response theorymaniaNSMHWB
Type
Original Articles
Information
Psychological Medicine , Volume 43 , Issue 2 , February 2013 , pp. 433 - 443
Copyright
Copyright © Cambridge University Press 2012

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aggen, SH, Neale, MC, Kendler, KS (2005). DSM criteria for major depression: evaluating symptom patterns using latent trait item response models. Psychological Medicine 35, 475–487.CrossRefGoogle ScholarPubMed
Agrawal, A, Nurnberger, JI, Lynskey, MT (2010). Item response modeling of DSM-IV mania symptoms in two representative US epidemiological samples. Psychological Medicine 40, 1549–1558.CrossRefGoogle ScholarPubMed
APA (1994). Diagnostic and Statistical Manual of Mental Disorders, 4th edn. American Psychiatric Association: Washington, DC.Google Scholar
Baillie, AJ, Teesson, M (2010). Continuous, categorical and mixture models of DSM-IV alcohol and cannabis use disorders in the Australian community. Addiction 105, 1246–1253.CrossRefGoogle ScholarPubMed
Balsis, S, Cully, JA (2008). Comparing depression diagnostic symptoms across younger and older adults. Aging and Mental Health 12, 800–806.CrossRefGoogle ScholarPubMed
Benjamini, Y, Hochberg, Y (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B 57, 289–300.Google Scholar
Bentler, PM (1990). Comparative fit indexes in structural models. Psychological Bulletin 107, 238–246.CrossRefGoogle ScholarPubMed
Birnbaum, A (1968). Some latent trait models and their use in inferring an examinee's ability. In Statistical Theories of Mental Test Scores (ed. Lord, F. M. and Novick, M. R.), pp. 397–472. Addison-Wesley: Reading, MA.Google Scholar
Brown, TA (2006). Confirmatory Factor Analysis for Applied Research. Guilford Press: New York.Google Scholar
Brown, TA, Barlow, DH (2005). Dimensional versus categorical classification of mental disorders in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders and beyond: comment on the Special Section. Journal of Abnormal Psychology 114, 551–556.CrossRefGoogle ScholarPubMed
Browne, MW, Cudeck, R (1992). Alternative ways of assessing model fit. Sociological Methods and Research 21, 230–258.CrossRefGoogle Scholar
Carragher, N, Mewton, L, Slade, T, Teesson, M (2011). An item response analysis of the DSM-IV criteria for major depression: findings from the Australian National Survey of Mental Health and Wellbeing. Journal of Affective Disorders 130, 92–98.CrossRefGoogle ScholarPubMed
Carragher, N, Mills, K, Slade, T, Teesson, M, Silove, D (2010). Factor structure of posttraumatic stress disorder symptoms in the Australian general population. Journal of Anxiety Disorders 24, 520–527.CrossRefGoogle ScholarPubMed
Cassano, GB, Mula, M, Rucci, P, Miniati, M, Frank, E, Kupfer, DJ, Oppo, A, Calugi, S, Maggi, L, Gibbons, R, Fagiolini, A (2009). The structure of lifetime manic-hypomanic spectrum. Journal of Affective Disorders 112, 59–70.CrossRefGoogle ScholarPubMed
Cassidy, F, Forest, K, Murry, E, Carroll, BJ (1998). A factor analysis of the signs and symptoms of mania. Archives of General Psychiatry 55, 27–32.CrossRefGoogle ScholarPubMed
Diler, RS, Uguz, S, Seydaoglu, G, Avci, A (2008). Mania profile in a community sample of prepubertal children in Turkey. Bipolar Disorders 10, 546–553.CrossRefGoogle Scholar
Edelen, MO, Reeve, BB (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research 16, 5–18.CrossRefGoogle ScholarPubMed
Edelen, MO, Thissen, D, Teresi, JA, Kleinman, M, Ocepek-Welikson, K (2006). Identification of differential item functioning using item response theory and the likelihood-based model comparison approach. Application to the Mini-Mental State Examination. Medical Care 44, S134–S142.CrossRefGoogle Scholar
Flora, D, Thissen, D (2002). IRTScore: Item Response Theory Score Approximation Software. Thurstone Psychometric Laboratory: Chapel Hill, NC.Google Scholar
Freeman, AJ, Youngstrom, EA, Freeman, MJ, Youngstrom, JK, Findling, RL (2011). Is caregiver-adolescent disagreement due to differences in thresholds for reporting manic symptoms? Journal of Child and Adolescent Ppsychopharmacology 21, 425–432.CrossRefGoogle ScholarPubMed
Gelhorn, H, Hartman, C, Sakai, J, Mikulich-Gilbertson, S, Stallings, M, Young, S, Rhee, S, Corley, R, Hewitt, J, Hopfer, C, Crowley, T (2009). An item response theory analysis of DSM-IV conduct disorder. Journal of the American Academy of Child and Adolescent Psychiatry 48, 42–50.CrossRefGoogle ScholarPubMed
Ghaemi, SN, Boiman, EE, Goodwin, FK (2000). Diagnosing bipolar disorder and the effect of antidepressants: a naturalistic study. Journal of Clinical Psychiatry 61, 804–808.CrossRefGoogle ScholarPubMed
Grant, BF, Dawson, DA, Stinson, FS, Chou, PS, Kay, W, Pickering, R (2003).## The Alcohol Use Disorder and Associated Disabilities Interview Schedule-IV (AUDADIS-IV): reliability of alcohol consumption, tobacco use, family history of depression and psychiatric diagnostic modules in a general population sample. Drug and Alcohol Dependence 71, 7–16.CrossRefGoogle Scholar
Grant, BF, Stinson, FS, Dawson, DA, Chou, SP, Dufour, MC, Compton, W, Pickering, RP, Kaplan, K (2004). Prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Archives of General Psychiatry 61, 807–816.CrossRefGoogle ScholarPubMed
Gupta, SC, Sinha, VK, Praharaj, SK, Gandotra, S (2009). Factor structure of manic symptoms. Australian and New Zealand Journal of Psychiatry 43, 1141–1146.CrossRefGoogle ScholarPubMed
Henry, DB, Pavuluri, MN, Youngstrom, E, Birmaher, B (2008). Accuracy of brief and full forms of the Child Mania Rating Scale. Journal of Clinical Psychology 64, 368–381.CrossRefGoogle ScholarPubMed
Hirschfeld, RM, Lewis, L, Vornik, LA (2003). Perceptions and impact of bipolar disorder: how far have we really come? Results of the National Depressive and Manic-Depressive Association 2000 Survey of Individuals with Bipolar Disorder. Journal of Clinical Psychiatry 64, 161–174.CrossRefGoogle ScholarPubMed
Hu, L, Bentler, PM (1998). Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychological Methods 3, 424–453.CrossRefGoogle Scholar
Judd, LL, Akiskal, HS, Schettler, PJ, Endicott, J, Maser, JD, Solomon, DA, Leon, AC, Rice, JA, Keller, MB (2002). The long-term natural history of the weekly symptomatic status of bipolar-I disorder. Archives of General Psychiatry 59, 530–537.CrossRefGoogle ScholarPubMed
Kendler, KS, Eaves, LJ, Walters, EE, Neale, MC, Heath, AC, Kessler, RC (1996). The identification and validation of distinct depressive syndromes in a population-based sample of female twins. Archives of General Psychiatry 53, 391–399.CrossRefGoogle Scholar
Kessler, RC, Chiu, WT, Demler, O, Merikangas, KR, Walters, EE (2005). Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry 62, 617–627.CrossRefGoogle ScholarPubMed
Kessler, RC, Rubinow, DR, Holmes, C, Abelson, JM, Zhao, S (1997). The epidemiology of DSM-III-R bipolar I disorder in a general population survey. Psychological Medicine 27, 1079–1089.CrossRefGoogle Scholar
Kessler, RC, Üstün, TB (2004). The World Mental Health (WMH) Survey Initiative Version of the World Health Organization (WHO) Composite International Diagnostic Interview (CIDI). International Journal of Methods in Psychiatric Research 13, 93–121.CrossRefGoogle ScholarPubMed
Krueger, FR, Finger, MS (2001). Using item response theory to understand comorbidity among anxiety and unipolar mood disorders. Psychological Assessment 13, 140–151.CrossRefGoogle ScholarPubMed
Kupfer, DJ, Angst, J, Berk, M, Dickerson, F, Frangou, S, Frank, E, Goldstein, BI, Harvey, A, Laghrissi-Thode, F, Leboyer, M, Ostacher, MJ, Sibille, E, Strakowski, SM, Suppes, T, Tohen, M, Yolken, RH, Young, LT, Zarate, CA (2011). Advances in bipolar disorder: selected sessions from the 2011 International Conference on Bipolar Disorder. Annals of the New York Academy of Sciences 1242, 1–25.CrossRefGoogle ScholarPubMed
Lord, FM (1980). Applications of Item Response Theory to Practical Testing Problems. Erlbaum: Hillsdale, NJ.Google Scholar
Murray, CJ, Lopez, AD (1996). The Global Burden of Disease: A Comprehensive Assessment of Mortality and Disability from Diseases, Injuries and Risk Factors in 1990 and Projected to 2020. Harvard University Press: Cambridge, MA.Google Scholar
Muthén, BO, Grant, B, Hasin, D (1993). The dimensionality of alcohol abuse and dependence: factor analysis of DSM-III-R and proposed DSM-IV criteria in the 1988 National Health Interview Survey. Addiction 88, 1079–1090.CrossRefGoogle ScholarPubMed
Muthén, LK, Muthén, BO (1998–2011). Mplus User's Guide Version 6. Muthén & Muthén: Los Angeles.Google Scholar
Orlando, M, Sherbourne, CD, Thissen, D (2000). Summed-score linking using item response theory: application to depression measurement. Psychological Assessment 12, 354–359.CrossRefGoogle ScholarPubMed
Picardi, A, Battisti, F, de Girolamo, G, Morosini, P, Norcio, B, Bracco, R, Biondi, M (2008). Symptom structure of acute mania: a factor study of the 24-item Brief Psychiatric Rating Scale in a national sample of patients hospitalized for a manic episode. Journal of Affective Disorders 108, 183–189.CrossRefGoogle Scholar
Plante, DT, Winkelman, JW (2008). Sleep disturbance in bipolar disorder: therapeutic implications. American Journal of Psychiatry 165, 830–843.CrossRefGoogle ScholarPubMed
Prisciandaro, JJ, Roberts, JE (2011). Evidence for the continuous latent structure of mania in the epidemiologic catchment area from multiple latent structure and construct validation methodologies. Psychological Medicine 41, 575–588.CrossRefGoogle ScholarPubMed
Proudfoot, H, Baillie, AJ, Teesson, M (2006). The structure of alcohol dependence in the community. Drug and Alcohol Dependence 81, 21–26.CrossRefGoogle ScholarPubMed
Robins, LN (2004). Using survey results to improve the validity of the standard psychiatric nomenclature. Archives of General Psychiatry 61, 1188–1194.CrossRefGoogle ScholarPubMed
Sato, T, Bottlender, R, Kleindienst, N, Möller, HJ (2002). Syndromes and phenomenological subtypes underlying acute mania: a factor analytic study of 576 manic patients. American Journal of Psychiatry 159, 968–974.CrossRefGoogle Scholar
Simon, GE, Von Korff, M (2006). Medical comorbidity and validity of DSM-IV depression criteria. Psychological Medicine 36, 27–36.CrossRefGoogle ScholarPubMed
Slade, T, Johnston, A, Oakley Browne, MA, Andrews, G, Whiteford, H (2009). 2007 National Survey of Mental Health and Wellbeing: methods and key findings. Australian and New Zealand Journal of Psychiatry 43, 594–605.CrossRefGoogle ScholarPubMed
Stapleton, LM (2008). Variance estimation using replication methods in structural equation modeling with complex sample data. Structural Equation Modeling 15, 183–210.CrossRefGoogle Scholar
Stark, S (2001). MODFIT: A Computer Program for Model-Data Fit. University of Illinois: Urbana-Champaign.Google Scholar
Steiger, JH (1990). Structural model evaluation and modification: an internal estimation approach. Multivariate Behavioral Research 25, 173–180.CrossRefGoogle Scholar
Sunderland, M, Mewton, L, Slade, T, Baillie, AJ (2010). Investigating differential symptom profiles in major depressive episode with and without generalized anxiety disorder: true co-morbidity or symptom similarity? Psychological Medicine 40, 1113–1123.CrossRefGoogle ScholarPubMed
Thissen, D (2001). IRTLRDIF v.2.0b. Software for the Computation of the Statistics Involved in Item Response Theory Likelihood-Ratio Tests for Differential Item Functioning. Thurstone Psychometric Laboratory, University of North Carolina at Chapel Hill: Chapel Hill, NC.Google Scholar
Thissen, D (2003). Multilog User's Guide: Multiple Categorical Item Analysis and Test Scoring using Item Response Theory. Scientific Software: Chicago, IL.Google Scholar
Thissen, D, Steinberg, L, Kuang, D (2002). Quick and easy implementation of the Benjamini–Hochberg procedure for controlling the false positive rate in multiple comparisons. Journal of Educational and Behavioral Statistics 27, 77–83.CrossRefGoogle Scholar
Tohen, M, Greenfield, SF, Weiss, RD, Zarate, CA, Vagge, LM (1998). The effect of comorbid substance use disorders on the course of bipolar disorder: a review. Harvard Review of Psychiatry 6, 133–141.CrossRefGoogle ScholarPubMed
Tondo, L, Isacsson, G, Baldessarini, R (2003). Suicidal behaviour in bipolar disorder: risk and prevention. CNS Drugs 17, 491–511.CrossRefGoogle ScholarPubMed
Tucker, LR, Lewis, C (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika 38, 1–10.CrossRefGoogle Scholar
Uebelacker, LA, Strong, D, Weinstock, LM, Miller, IW (2009). Use of item response theory to understand differential functioning of DSM-IV major depression symptoms by race, ethnicity and gender. Psychological Medicine 39, 591–601.CrossRefGoogle ScholarPubMed
Vandenberg, RJ, Lance, CE (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organizational Research Methods 3, 4–70.CrossRefGoogle Scholar
Weinstock, LM, Strong, D, Uebelacker, LA, Miller, IW (2009). Differential item functioning of DSM-IV depressive symptoms in individuals with a history of mania versus those without: an item response theory analysis. Bipolar Disorders 11, 289–297.CrossRefGoogle ScholarPubMed
Weinstock, LM, Strong, D, Uebelacker, LA, Miller, IW (2010). Use of item response theory methodology to evaluate differences between bipolar and unipolar depression. US Psychiatry 3, 15–20.Google Scholar
Wolf, EJ, Millier, MW, Brown, TA (2011). The structure of personality disorders in individuals with posttraumatic stress disorder. Personality Disorders: Theory, Research, and Treatment 2, 261–278.CrossRefGoogle ScholarPubMed
Woods, CM (2008 a). Likelihood-ratio DIF testing: effects of nonnormality. Applied Psychological Measurement 32, 511–526.CrossRefGoogle Scholar
Woods, CM (2008 b). IRT-LR-DIF with estimation of the focal-group density as an empirical histogram. Educational and Psychological Measurement 88, 571–586.CrossRefGoogle Scholar
Woods, CM (2009). Empirical selection of anchors for tests of differential item functioning. Applied Psychological Measurement 33, 42–57.CrossRefGoogle Scholar