Hostname: page-component-8448b6f56d-cfpbc Total loading time: 0 Render date: 2024-04-23T17:05:02.165Z Has data issue: false hasContentIssue false
  • English
  • Français

Comparing psychotic experiences in low-and-middle-income-countries and high-income-countries with a focus on measurement invariance

Published online by Cambridge University Press:  07 October 2020

Edo S. Jaya Open the ORCID record for Edo S. Jaya [Opens in a new window] ,
Caroline Wüsten ,
Behrooz Z. Alizadeh ,
Therese van Amelsvoort ,
Agna A. Bartels-Velthuis ,
Nico J. van Beveren ,
Richard Bruggeman ,
Wiepke Cahn ,
Lieuwe de Haan  and
Philippe Delespaul
...Show all authors
Edo S. Jaya*
Affiliation:
Psychosis Studies Research Group, Faculty of Psychology, Universitas Indonesia, Depok, Indonesia
Caroline Wüsten
Affiliation:
Clinical Psychology and Psychotherapy, Institute of Psychology, Universität Hamburg, Hamburg, Germany
Behrooz Z. Alizadeh
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators University of Groningen, University Medical Center Groningen, University Center for Psychiatry, Rob Giel Research Center, The Netherlands
Therese van Amelsvoort
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry and Neuropsychology, Maastricht University Medical Center, School for Mental Health and Neuroscience, Maastricht, The Netherlands
Agna A. Bartels-Velthuis
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators University of Groningen, University Medical Center Groningen, University Center for Psychiatry, Rob Giel Research Center, The Netherlands
Nico J. van Beveren
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Antes Center for Mental Health Care, Rotterdam, The Netherlands Department of Psychiatry, Erasmus MC, Rotterdam, The Netherlands Department of Neuroscience, Erasmus MC, Rotterdam, The Netherlands
Richard Bruggeman
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators University of Groningen, University Medical Center Groningen, University Center for Psychiatry, Rob Giel Research Center, The Netherlands Department of Clinical and Developmental Neuropsychology, University of Groningen, Groningen, The Netherlands
Wiepke Cahn
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry, University Medical Center Utrecht, Brain Centre Rudolf Magnus, Utrecht University, Utrecht, The Netherlands Altrecht, General Mental Health Care, Utrecht, The Netherlands
Lieuwe de Haan
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands Arkin, Institute for Mental Health, Amsterdam, The Netherlands
Philippe Delespaul
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry and Neuropsychology, Maastricht University Medical Center, School for Mental Health and Neuroscience, Maastricht, The Netherlands
Jurjen J. Luykx
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry, University Medical Center Utrecht, Brain Centre Rudolf Magnus, Utrecht University, Utrecht, The Netherlands Department of Translational Neuroscience, University Medical Center Utrecht, Brain Center Rudolf Magnus, Utrecht, The Netherlands
Inez Myin-Germeys
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Neuroscience, Research Group Psychiatry, KU Leuven, Leuven, Belgium
Rene S. Kahn
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry, University Medical Center Utrecht, Brain Centre Rudolf Magnus, Utrecht University, Utrecht, The Netherlands Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, NY, USA
Frederike Schirmbeck
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands Arkin, Institute for Mental Health, Amsterdam, The Netherlands
Claudia J. P. Simons
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry and Neuropsychology, Maastricht University Medical Center, School for Mental Health and Neuroscience, Maastricht, The Netherlands GGzE Institute for Mental Health Care, Eindhoven, The Netherlands
Neeltje E. van Haren
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry, University Medical Center Utrecht, Brain Centre Rudolf Magnus, Utrecht University, Utrecht, The Netherlands Department of Child and Adolescent Psychiatry/Psychology, Erasmus MC, Rotterdam, The Netherlands
Jim van Os
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry, University Medical Center Utrecht, Brain Centre Rudolf Magnus, Utrecht University, Utrecht, The Netherlands Department of Psychosis Studies, King's College London, King's Health Partners, Institute of Psychiatry, London, UK
Ruud van Winkel
Affiliation:
Genetic Risk and Outcome of Psychosis (GROUP) Investigators Department of Psychiatry and Neuropsychology, Maastricht University Medical Center, School for Mental Health and Neuroscience, Maastricht, The Netherlands Department of Neuroscience, Research Group Psychiatry, KU Leuven, Leuven, Belgium
Eduardo Fonseca-Pedrero
Affiliation:
Department of Educational Sciences, University of La Rioja, La Rioja, Spain Centro de Investigación Biomédica en Red de Salud Mental, Oviedo, Spain
Emmanuelle Peters
Affiliation:
Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK South London and Maudsley NHS Foundation Trust, London, UK
Hélène Verdoux
Affiliation:
University Bordeaux, U1219 Bordeaux Population Health Research Center, Bordeaux, France
Todd S. Woodward
Affiliation:
Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada BC Mental Health and Addictions Research Institute, Vancouver, BC, Canada
Tim B. Ziermans
Affiliation:
Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
Tania M. Lincoln
Affiliation:
Clinical Psychology and Psychotherapy, Institute of Psychology, Universität Hamburg, Hamburg, Germany
*
Author for correspondence: Edo S. Jaya, E-mail: edo.jaya@ui.ac.id
Get access Rights & Permissions [Opens in a new window]

Abstract

Background

The prevalence of psychotic experiences (PEs) is higher in low-and-middle-income-countries (LAMIC) than in high-income countries (HIC). Here, we examine whether this effect is explicable by measurement bias.

Methods

A community sample from 13 countries (N = 7141) was used to examine the measurement invariance (MI) of a frequently used self-report measure of PEs, the Community Assessment of Psychic Experiences (CAPE), in LAMIC (n = 2472) and HIC (n = 4669). The CAPE measures positive (e.g. hallucinations), negative (e.g. avolition) and depressive symptoms. MI analyses were conducted with multiple-group confirmatory factor analyses.

Results

MI analyses showed similarities in the structure and understanding of the CAPE factors between LAMIC and HIC. Partial scalar invariance was found, allowing for latent score comparisons. Residual invariance was not found, indicating that sum score comparisons are biased. A comparison of latent scores before and after MI adjustment showed both overestimation (e.g. avolition, d = 0.03 into d = −0.42) and underestimation (e.g. magical thinking, d = −0.03 into d = 0.33) of PE in LAMIC relative to HIC. After adjusting the CAPE for MI, participants from LAMIC reported significantly higher levels on most CAPE factors but a significantly lower level of avolition.

Conclusion

Previous studies using sum scores to compare differences across countries are likely to be biased. The direction of the bias involves both over- and underestimation of PEs in LAMIC compared to HIC. Nevertheless, the study confirms the basic finding that PEs are more frequent in LAMIC than in HIC.

Keywords

Cross-culturalcross-culturecross-nationalpsychosisschizophreniavalidity
Type
Original Article
Information
Psychological Medicine , Volume 52 , Issue 8 , June 2022 , pp. 1509 - 1516
Check for updates
Copyright
Copyright © The Author(s), 2020. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ahmed, A. O., Kirkpatrick, B., Galderisi, S., Mucci, A., Rossi, A., Bertolino, A., … Strauss, G. P. (2019). Cross-cultural validation of the 5-factor structure of negative symptoms in schizophrenia. Schizophrenia Bulletin, 45, 305–314.CrossRefGoogle Scholar
Al-Issa, I. (1995). The illusion of reality or the reality of illusion: Hallucinations and culture. The British Journal of Psychiatry, 166, 368–373.CrossRefGoogle ScholarPubMed
Baas, K. D., Cramer, A. O. J., Koeter, M. W. J., van de Lisdonk, E. H., van Weert, H. C., & Schene, A. H. (2011). Measurement invariance with respect to ethnicity of the patient health questionnaire-9 (PHQ-9). Journal of Affective Disorders, 129, 229–235.CrossRefGoogle Scholar
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588.CrossRefGoogle Scholar
Brenner, K., Schmitz, N., Pawliuk, N., Fathalli, F., Joober, R., Ciampi, A., & King, S. (2007). Validation of the English and French versions of the community assessment of psychic experiences (CAPE) with a Montreal community sample. Schizophrenia Research, 95, 86–95.CrossRefGoogle ScholarPubMed
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 464–504.CrossRefGoogle Scholar
Cicero, D. C., Krieg, A., & Martin, E. A. (2019a). Measurement invariance of the prodromal questionnaire–brief among white, Asian, Hispanic, and multiracial populations. Assessment, 26, 294–304.CrossRefGoogle Scholar
Cicero, D. C., Martin, E. A., & Krieg, A. (2019b). Differential item functioning of the full and brief wisconsin schizotypy scales in Asian, White, Hispanic, and multiethnic samples and between sexes. Assessment, 26, 1001–1013.CrossRefGoogle Scholar
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New Jersey: L. Erlbaum Associates.Google Scholar
DeVylder, J. E., & Koyanagi, A. (2018). Evaluating the clinical relevance of psychotic experiences in low- and middle-income countries. Schizophrenia Bulletin, 44, 1167–1169.CrossRefGoogle ScholarPubMed
Fonseca-Pedrero, E., Ortuño-Sierra, J., Lucas-Molina, B., Debbané, M., Chan, R. C. K., Cicero, D. C., … Voracek, M. (2018). Brief assessment of schizotypal traits: A multinational study. Schizophrenia Research, 197, 182–191.CrossRefGoogle ScholarPubMed
Fonseca-Pedrero, E., Paino, M., Lemos-Giráldez, S., & Muñiz, J. (2012). Validation of the community assessment psychic experiences −42 (CAPE-42) in Spanish college students and patients with psychosis. Actas Españolas de Psiquiatría, 40, 169–176.Google ScholarPubMed
Heuvelman, H., Nazroo, J., & Rai, D. (2018). Investigating ethnic variations in reporting of psychotic symptoms: A multiple-group confirmatory factor analysis of the psychosis screening questionnaire. Psychological Medicine, 48, 2757–2765.CrossRefGoogle ScholarPubMed
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55.CrossRefGoogle Scholar
Jablensky, A. (2000). Epidemiology of schizophrenia: The global burden of disease and disability. European Archives of Psychiatry and Clinical Neuroscience, 250, 274–285.CrossRefGoogle ScholarPubMed
Jablensky, A., Sartorius, N., Ernberg, G., Anker, M., Korten, A., Cooper, J. E., … Bertelsen, A. (1992). Schizophrenia: Manifestations, incidence and course in different cultures. A World Health Organization ten-country study. Psychological Medicine Monograph, 20, 1–97.CrossRefGoogle ScholarPubMed
Jaya, E. S. (2017). Confirmatory factor analysis of the Indonesian version of community assessment of psychic experiences. Makara Human Behavior Studies in Asia, 9, 1–12.CrossRefGoogle Scholar
Korver, N., Quee, P. J., Boos, H. B. M., Simons, C. J. P., & de Haan, L., & GROUP investigators (2012). Genetic risk and outcome of psychosis (GROUP), a multi site longitudinal cohort study focused on gene–environment interaction: Objectives, sample characteristics, recruitment and assessment methods. International Journal of Methods in Psychiatric Research, 21, 205–221.CrossRefGoogle ScholarPubMed
Luhrmann, T. M., Padmavati, R., Tharoor, H., & Osei, A. (2015). Differences in voice-hearing experiences of people with psychosis in the USA, India and Ghana: Interview-based study. The British Journal of Psychiatry: The Journal of Mental Science, 206, 41–44.CrossRefGoogle ScholarPubMed
Mark, W., & Toulopoulou, T. (2016). Psychometric properties of ‘community assessment of psychic experiences’: Review and meta-analyses. Schizophrenia Bulletin, 42, 34–44.Google Scholar
McGrath, J. J., Saha, S., Al-Hamzawi, A., Alonso, J., Bromet, E. J., Bruffaerts, R., … Kessler, RC (2015) Psychotic experiences in the general population: A cross-national analysis based on 31 261 respondents from 18 countries. JAMA Psychiatry, 72, 697–705.Google ScholarPubMed
McGrath, J. J., Saha, S., Al-Hamzawi, A., Andrade, L., Benjet, C., Bromet, E. J., … Kessler, R. C. (2016). The bi-directional associations between psychotic experiences and DSM-IV mental disorders. The American Journal of Psychiatry, 173, 997–1006.CrossRefGoogle Scholar
McGrath, J. J., Saha, S., Chant, D., & Welham, J. (2008). Schizophrenia: A concise overview of incidence, prevalence, and mortality. Epidemiologic Reviews, 30, 67–76.CrossRefGoogle Scholar
Merz, E. L., Malcarne, V. L., Roesch, S. C., Riley, N., & Sadler, G. R. (2011). A multigroup confirmatory factor analysis of the patient health questionnaire-9 among English- and Spanish-speaking Latinas. Cultural Diversity & Ethnic Minority Psychology, 17, 309–316.CrossRefGoogle ScholarPubMed
Murphy, J., McBride, O., Fried, E., & Shevlin, M. (2018). Distress, impairment and the extended psychosis phenotype: A network analysis of psychotic experiences in a US general population sample. Schizophrenia Bulletin, 44, 768–777.CrossRefGoogle Scholar
Patel, V., Saxena, S., Lund, C., Thornicroft, G., Baingana, F., Bolton, P., … Jü, U. (2018). The lancet commission on global mental health and sustainable development. The Lancet, 392, 1553–1598.CrossRefGoogle ScholarPubMed
Peters, E., Ward, T., Jackson, M., Morgan, C., Charalambides, M., McGuire, P., … Garety, P. A. (2016). Clinical, socio-demographic and psychological characteristics in individuals with persistent psychotic experiences with and without a ‘need for care’. World Psychiatry, 15, 41–52.CrossRefGoogle Scholar
Pignon, B., Peyre, H., Ferchiou, A., van Os, J., Rutten, B. P. F., Murray, R. M., … Szöke, A., & EU-GEI WP2 Group Author (2018) Assessing cross-national invariance of the Community Assessment of Psychic Experiences (CAPE). Psychological Medicine, 49, 2600–2607.CrossRefGoogle Scholar
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90.CrossRefGoogle ScholarPubMed
Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.CrossRefGoogle Scholar
Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514.CrossRefGoogle Scholar
Schlier, B., Jaya, E. S., Moritz, S., & Lincoln, T. M. (2015). The community assessment of psychic experiences measures nine clusters of psychosis-like experiences: A validation of the German version of the CAPE. Schizophrenia Research, 169, 274–279.CrossRefGoogle ScholarPubMed
Siddi, S., Ochoa, S., Laroi, F., Cella, M., Raballo, A., Saldivia, S., … Preti, A. (2019). A cross-national investigation of hallucination-like experiences in 10 countries: The E-CLECTIC study. Schizophrenia Bulletin, 45, S43–S55.CrossRefGoogle ScholarPubMed
Stefanis, N. C., Hanssen, M., Smirnis, N. K., Avramopoulos, D. A., Evdokimidis, I. K., Stefanis, C. N., … van Os, J. (2002). Evidence that three dimensions of psychosis have a distribution in the general population. Psychological Medicine, 32, 347–358.CrossRefGoogle ScholarPubMed
van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9, 486–492.CrossRefGoogle Scholar
van Os, J. (2016). Measures of psychosis proneness and genetic risk for schizophrenia. JAMA Psychiatry, 73, 638.CrossRefGoogle ScholarPubMed
van Os, J., & Reininghaus, U. (2016). Psychosis as a transdiagnostic and extended phenotype in the general population. World Psychiatry, 15, 118–124.CrossRefGoogle ScholarPubMed
Verdoux, H., Sorbara, F., Gindre, C., Swendsen, J. D., & van Os, J. (2003). Cannabis use and dimensions of psychosis in a nonclinical population of female subjects. Schizophrenia Research, 59, 77–84.CrossRefGoogle Scholar
Vermeiden, M., Janssens, M., Thewissen, V., Akinsola, E., Peeters, S., Reijnders, J., … Lataster, J. (2019). Cultural differences in positive psychotic experiences assessed with the Community Assessment of Psychic Experiences-42 (CAPE-42): A comparison of student populations in the Netherlands, Nigeria and Norway. BMC Psychiatry, 19, 244.CrossRefGoogle ScholarPubMed
World Bank (2016). World Bank Country and Lending Groups. Available at: https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.Google Scholar
World Health Organization (2011). Mental health atlas 2011. Italy: WHO Press.Google Scholar
Wüsten, C., Schlier, B., Jaya, E. S., Genetic Risk and Outcome of Psychosis (GROUP) Investigators, Fonseca-Pedrero, E., Peters, E., Verdoux, H., … Lincoln, T. M. (2018) Psychotic experiences and related distress: A cross-national comparison and network analysis based on 7141 participants from 13 countries. Schizophrenia Bulletin, 44, 1185–1194.CrossRefGoogle ScholarPubMed
Yoon, M., & Lai, M. H. C. (2018). Testing factorial invariance with unbalanced samples. Structural Equation Modeling: A Multidisciplinary Journal, 25, 201–213.CrossRefGoogle Scholar
Zhang, B., Fokkema, M., Cuijpers, P., Li, J., Smits, N., & Beekman, A. (2011). Measurement invariance of the center for epidemiological studies depression scale (CES-D) among Chinese and Dutch elderly. BMC Medical Research Methodology, 11, 74.CrossRefGoogle Scholar
Ziermans, T. B. (2013). Working memory capacity and psychotic-like experiences in a general population sample of adolescents and young adults. Frontiers in Psychiatry, 4, 161. doi: 10.3389/fpsyt.2013.00161.CrossRefGoogle Scholar
Supplementary material: File

Jaya et al. supplementary material

Tables S1-S3

Download Jaya et al. supplementary material(File)
File 38.4 KB