Skip to main content
×
×
Home

Cross-Cultural Invariance of Emotional Skills and Competence Questionnaire between Portugal and Croatia

  • Ana Costa (a1), Luísa Faria (a1) and Vladimir Takšić (a2)
Abstract

Emotional intelligence (EI) and its measures have been widespread across several countries and cultures and the need for valid and robust measures that could expand research on international settings is on the current agenda. This study aimed to assess the measurement invariance of a widely used self-report EI measure, Emotional Skills and Competence Questionnaire (ESCQ), in two cultural contexts (Portugal vs. Croatia). The ESCQ, a 42-item self-report EI scale which comprises three dimensions – Perceive and Understand Emotion, Express and Label Emotion and Manage and Regulate Emotion - was administered to 1,188 Portuguese and Croatian secondary students. The results showed that the ESCQ had satisfactory reliability and the three-factor structure was replicated on both country samples. Configural (χ2 = 308.71, df = 220, p < .01; RMSEA = .030, CFI = .956, TLI = .948) and partial metric (Δχ2 = 9.102, Δdf = 10, p = .522; ΔCFI = −.01, ΔRMSEA = .002) and scalar (Δχ2 = 15.290, Δdf = 21, p = .083; ΔCFI = .001, ΔRMSEA = .006) invariances were supported across groups. This EI measure invariance cross-cultural study highlighted cultural particularities related to emotional competence in Portugal and Croatia contexts and contributed to bring awareness to the validity of cross-cultural studies in the emotional abilities field.

Copyright
Corresponding author
*Correspondence concerning this article should be addressed to Luísa Faria. Faculty of Psychology and Educational Sciences. Universidade do Porto. Rua Alfredo Allen. 4200–135. Porto (Portugal). Phone: +351–226079700. E-mail: lfaria@fpce.up.pt
References
Hide All
Batista-Foguet, J. M., Saris, W., Boyatzis, R., Guillén, L., & Serlavós, R. (2009). Effect of response scale on assessment of emotional intelligence competencies. Personality and Individual Differences, 46, 575580. http://dx.doi.org/10.1016/j.paid.2008.12.011
Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: John Wiley & Sons, Inc.
Bollen, K. A., & Barb, K. H. (1981). Pearson’s r and coarsely categorized measures. American Sociological Review, 46, 232239. http://dx.doi.org/10.2307/2094981
Boyatzis, R., Goleman, D., & Rhee, K. (2000). Clustering competence in emotional intelligence: Insights from the Emotional Competence Inventory (ECI). In Bar-On, R. & Parker, J. D. A. (Eds.), Handbook of emotional intelligence (pp. 343362). San Francisco, CA: Jossey-Bass.
Brown, G. T. L. (2004). Measuring attitudes with positively packed self-report ratings: Comparison of agreement and frequency scales. Psychological Reports, 94, 10151024. http://dx.doi.org/10.2466/pr0.94.3.1015-1024
Brown, J. D. (2001). Statistics corner. Questions and answers about language testing statistics: Can we use the Spearman-Brown prophecy formula to defend low reliability? Shiken: JALT Testing & Evaluation SIG Newsletter , 4, 79.
Byrne, B. M. (2004). Testing for multigroup invariance using AMOS graphics: A road less traveled. Structural Equation Modeling, 11, 272300. http://dx.doi.org/10.1207/s15328007sem1102_8
Byrne, B. M., & Campbell, T. L. (1999). Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface. Journal of Cross-Cultural Psychology, 30, 555574. http://dx.doi.org/10.1177/0022022199030005001
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464504. http://dx.doi.org/10.1080/10705510701301834
Ciarrochi, J., Chan, A. Y. C., Caputi, P., & Roberts, R. (2001). Measuring emotional intelligence. In Ciarrochi, C., Forgas, J. P., & Mayer, J. D. (Eds.), Emotional intelligence in everyday life: A scientific inquiry (pp. 2545). Philadelphia, PA: Psychology Press.
Costa, A., & Faria, L. (2014). Avaliação da inteligência emocional: Que diálogo entre medidas de desempenho e de autorrelato? [Assessment in emotional intelligence: What dialog between ability-based and self-report measures?]. Psicologia: Teoria e Pesquisa, 30, 339346.
Costa, A., & Faria, L. (2015). The impact of emotional intelligence on academic achievement: A longitudinal study in Portuguese secondary school. Learning and Individual Differences, 37, 3847. http://dx.doi.org/10.1016/j.lindif.2014.11.011
Dolan, C. V. (1994). Factor analysis of variables with 2, 3, 5, and 7 response categories: A comparison of categorical variable estimators using simulated data. British Journal of Mathematical and Statistical Psychology, 47, 309326. http://dx.doi.org/10.1111/j.2044-8317.1994.tb01039.x
Duffy, M. E. (2006). Translating instruments into other languages. Clinical Nurse Specialist, 20, 225226. http://dx.doi.org/10.1097/00002800-200609000-00006
Ekerman, G., Saklofske, D. H., Austin, E., & Stough, C. (2011). Measurement invariance and differential item functioning of the Bar-On EQ-i: S measure over Canadian, Scottish, South African and Australian samples. Personality and Individual Differences, 50, 286290. http://dx.doi.org/10.1016/j.paid.2010.10.004
Elosua, P., & Hermosilla, D. (2013). Does body dissatisfaction have the same meaning for males and females? A measurement invariance study. Revue Européenne de Psychologie Appliquée/European Review of Applied Psychology, 63, 315321. http://dx.doi.org/10.1016/j.erap.2013.06.002
Emmerling, R. J., & Boyatzis, R. E. (2012). Emotional and social intelligence competencies: Cross-cultural implications. Cross-Cultural Management: An International Journal, 19(1), 418. http://dx.doi.org/10.1108/13527601211195592
Faria, L., Lima Santos, N., Takšić, V., Räty, H., Molander, B., Holmström, S., … Toyota, H. (2006). Cross-cultural validation of the Emotional Skills and Competence Questionnaire (ESCQ). Psicologia, 2, 95127.
Fernandez, I., Carrera, P., Sanchez, F., Paez, D., & Candia, L. (2000). Differences between cultures in emotional verbal and non-verbal reactions. Psicothema, 12, 8392.
Ghorbani, N., Davison, H. K., Bing, M. N., Watson, P. J., & Mack, D. A. (2002). Self-reported emotional intelligence. Construct similarity and functional dissimilarity of higher-order processing in Iran and the United States. International Journal of Psychology, 37, 297308. http://dx.doi.org/10.1080/00207590244000098
González-Romá, V., Hernández, A., & Gómez-Benito, J. (2006). Power and Type I error of the mean and covariance structure analysis model for detecting differential item functioning in graded response items. Multivariate Behavioral Research, 41, 2953. http://dx.doi.org/10.1207/s15327906mbr4101_3
Gross, J. J., & John, O. P. (2003). Individual differences in two emotion regulation processes: Implications for affect, relationships, and wellbeing. Journal of Personality and Social Psychology, 85, 348362. http://dx.doi.org/10.1037/0022-3514.85.2.348
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structure Equation Modeling, 6, 155. http://dx.doi.org/10.1080/10705519909540118
Karim, J., & Weisz, R. (2010). Cross-cultural research on the reliability and validity of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT). Cross-Cultural Research, 44, 374404. http://dx.doi.org/10.1177/1069397110377603
Kline, R. B. (2010). Principles and practice of structural equation modeling (3rd Ed.). New York, NY: Guilford.
Li, T., Saklofske, D. H., Bowden, S. C., Yan, G., & Fung, T. S. (2012). The measurement invariance of the Wong and Law Emotional Intelligence Scale (WLEIS) across three Chinese university student groups from Canada and China. Journal of Psychoeducational Assessment, 30, 439452. http://dx.doi.org/10.1177/0734282912449449
Little, T. D. (1997). Mean and covariance structures (MACS) analysis of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 5376. http://dx.doi.org/10.1207/s15327906mbr3201_3
Matsumoto, D. (1989). Cultural influences on the perception of emotion. Journal of Cross-Cultural Psychology, 20, 92105. http://dx.doi.org/10.1177/0022022189201006
Matsumoto, D. (1993). Ethnic differences in affect intensity, emotion judgments, display rule attitudes, and self-reported emotional expression in an American sample. Motivation and Emotion, 17, 107123. http://dx.doi.org/10.1007/BF00995188
Mayer, J. D., Caruso, D. R., & Salovey, P. (1999). Emotional intelligence meets traditional standards for an intelligence. Intelligence, 27, 267298. http://dx.doi.org/10.1016/S0160-2896(99)00016-1
Mayer, J. D., & Salovey, P. (1997). What is emotional intelligence? In Salovey, P. & Sluyter, D. J. (Eds.), Emotional development and emotional intelligence. Educational implications. New York, NY: Basic Books.
Molander, B., Holmström, S., & Takšić, V. (2009). Cross-cultural and sex differences in the Emotional Skills and Competence Questionnaire scales: Challenges of differential item functioning analyses. Horizons of Psychology, 18, 3553.
Molander, B., Holmström, S., & Takšić, V. (2011). South and north: DIF analyses of university-student responses to the Emotional Skills and Competence Questionnaire. Psychological Topics, 20, 425447.
Mullen, M. R. (1995). Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 26, 573596. http://dx.doi.org/10.1057/palgrave.jibs.8490187
Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38, 171189.
Parker, J. D. A., Saklofske, D. H., Shaughnessy, P. A., Huang, S. H. S., Wood, L. M., & Eastabrook, J. M. (2005). Generalizability of the emotional intelligence construct: A cross-cultural study of North American aboriginal youth. Personality and Individual Differences, 39, 215227. http://dx.doi.org/10.1016/j.paid.2005.01.008
Petrides, K. V., & Furnham, A. (2003). Trait emotional intelligence: Behavioural validation in two studies of emotion recognition and reactivity to mood induction. European Journal of Personality, 17, 3957. http://dx.doi.org/10.1002/per.466
Rivers, S. E., Brackett, M. A., & Salovey, P. (2008). Measuring emotional intelligence as a mental ability in adults and children. In Boyle, G. J., Matthews, G., & Saklofske, D. H. (Eds.), The Sage handbook of personality theory and assessment: Vol. 2, Personality measurement and testing (pp. 440460). Los Angeles, CA: Sage.
Roberts, R. D., Zeidner, M., & Matthews, G. (2001). Does emotional intelligence meet traditional standards for an intelligence? Some new data and conclusions. Emotion, 1, 196231. http://dx.doi.org/10.1037/1528-3542.1.3.196
Shulruf, B., Alesi, M, Ciochină, L., Faria, L., Hattie, J., Hong, F., … Watkins, D. (2011). Measuring collectivism and individualism in the third millennium. Social Behavior and Personality, 39, 173188. http://dx.doi.org/10.2224/sbp.2011.39.2.173
Siu, A. F. Y. (2009). Trait emotional intelligence and its relationships with problem behavior in Hong Kong adolescents. Personality and Individual Differences, 47, 553557. http://dx.doi.org/10.1016/j.paid.2009.05.004
Stocker, J., & Faria, L. (2012). Competência percebida no ensino secundário: Do conceito à avaliação através de um questionário compósito. [Perceived competence in secondary school: From conceptualization to assessment through a composite questionnaire]. Psicologia, 21, 113140.
Takšić, V. (2001). Upitnici emocionalne kompetentnosti (inteligencije). [Emotional competence (intelligence) questionnaires]. In Lackovic-Grgin, K. & Penezic, Z. (Eds.), Zbirka psihologijskih mjernih instrumenata [The collection of psychological instruments]. Zadar, Croatia: Faculty of Philosophy.
Takšić, V., Mohorić, T., & Duran, M. (2009). Emotional Skills and Competence Questionnaire (ESCQ) as a self-report measure of emotional intelligence. Horizons of Psychology, 18, 721.
van de Vijver, F., & Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: An overview. Revue Européenne de Psychologie Appliquée 54, 119135. http://dx.doi.org/10.1016/j.erap.2003.12.004
Zeidner, M., Roberts, R. D., & Matthews, G. (2002). Can emotional intelligence be schooled? A critical review. Educational Psychologist, 37, 215231. http://dx.doi.org/10.1207/S15326985EP3704_2
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

The Spanish Journal of Psychology
  • ISSN: 1138-7416
  • EISSN: 1988-2904
  • URL: /core/journals/spanish-journal-of-psychology
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed