Hostname: page-component-848d4c4894-wzw2p Total loading time: 0 Render date: 2024-06-12T05:32:10.566Z Has data issue: false hasContentIssue false

Predicting naming scores from language history: A little immersion goes a long way, and self-rated proficiency matters more than percent use

Published online by Cambridge University Press:  14 February 2024

Anne Neveu*
Affiliation:
Department of Psychiatry, University of California, San Diego, La Jolla, CA 92093, USA
Tamar H. Gollan
Affiliation:
Department of Psychiatry, University of California, San Diego, La Jolla, CA 92093, USA
*
Corresponding author: Anne Neveu; Email: aneveu@health.ucsd.edu

Abstract

Language proficiency is a critically important factor in research on bilingualism, but researchers disagree on its measurement. Validated objective measures exist, but investigators often rely exclusively on subjective measures. We investigated if combining multiple self-report measures improves prediction of objective naming test scores in 36 English-dominant versus 32 Spanish-dominant older bilinguals (Experiment 1), and in 41 older Spanish–English bilinguals versus 41 proficiency-matched young bilinguals (Experiment 2). Self-rated proficiency was a powerful but sometimes inaccurate predictor and better predicted naming accuracy when combined with years of immersion, while percent use explained little or no unique variance. Spanish-dominant bilinguals rated themselves more strictly than English-dominant bilinguals at the same objectively measured proficiency level. Immersion affected young more than older bilinguals, and non-immersed (English-dominant) more than immersed (Spanish-dominant) bilinguals. Self-reported proficiency ratings can produce spurious results, but predictive power improves when combined with self-report questions that might be less affected by subjective judgements.

Type
Research Article
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This article has earned badges for transparent research practices: Open Data and Open Materials. For details see the Data Availability Statement.

References

Anderson, J. A., Mak, L., Keyvani Chahi, A., & Bialystok, E. (2018). The language and social background questionnaire: Assessing degree of bilingualism in a diverse population. Behavior Research Methods, 50, 250263.CrossRefGoogle Scholar
Ardila, A., Roselli, M., & Puente, A. E. (1994). Neuro-psychological evaluation of the Spanish speaker. New York: Plenum Press.CrossRefGoogle Scholar
Artiola i Fortuny, L., Heaton, R. K., & Hermosillo, D. (1998). Neuropsychological comparisons of Spanish-speaking participants from the US–Mexico border region versus Spain. Journal of the International Neuropsychological Society, 4(4), 363379.CrossRefGoogle Scholar
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software 67(1), 148. doi:10.18637/jss.v067.i01.CrossRefGoogle Scholar
Birdsong, D. (2014). Dominance and age in bilingualism. Applied Linguistics, 35(4), 374392.CrossRefGoogle Scholar
Brauer, M., & Curtin, J. J. (2018). Linear mixed-effects models and the analysis of nonindependent data: A unified framework to analyze categorical and continuous independent variables that vary within-subjects and/or within-items. Psychological Methods, 23(3), 389.CrossRefGoogle ScholarPubMed
Burke, D. M., MacKay, D. G., Worthley, J. S., & Wade, E. (1991). On the tip of the tongue: What causes word finding failures in young and older adults?. Journal of Memory and Language, 30(5), 542579.CrossRefGoogle Scholar
Carroll, S. E. (2017). Exposure and input in bilingual development. Bilingualism: Language and Cognition, 20(1), 316.CrossRefGoogle Scholar
Chen, H., Cohen, P., & Chen, S. (2010). How big is a big odds ratio? Interpreting the magnitudes of odds ratios in epidemiological studies. Communications in Statistics—Simulation and Computation, 39(4), 860864.CrossRefGoogle Scholar
De Cat, C. (2021). Socioeconomic status as a proxy for input quality in bilingual children? Applied Psycholinguistics, 42(2), 301324.CrossRefGoogle Scholar
Del Maschio, N., Sulpizio, S., Toti, M., Caprioglio, C., Del Mauro, G., Fedeli, D., & Abutalebi, J. (2019). Second language use rather than second language knowledge relates to changes in white matter microstructure. Journal of Cultural Cognitive Science, 4, 165175.CrossRefGoogle Scholar
Dunn, L. M., & Dunn, L. M. (1997). Peabody Picture Vocabulary Test (3rd ed.). Bloomington, MN: Pearson Assessments.Google Scholar
Garcia, D. L., & Gollan, T. H. (2022). The MINT Sprint: Exploring a fast administration procedure with an expanded Multilingual Naming Test. Journal of the International Neuropsychological Society, 28(8), 845861.CrossRefGoogle ScholarPubMed
Gasquoine, P. G., & Gonzalez, C. D. (2012). Using monolingual neuropsychological test norms with bilingual Hispanic Americans: Application of an individual comparison standard. Archives of Clinical Neuropsychology, 27(3), 268276.CrossRefGoogle ScholarPubMed
Gathercole, V. C. M., & Thomas, E. M. (2009). Bilingual first-language development: Dominant language takeover, threatened minority language take-up. Bilingualism: Language and Cognition, 12(2), 213237.CrossRefGoogle Scholar
Gollan, T. H., & Goldrick, M. (2016). Grammatical constraints on language switching: Language control is not just executive control. Journal of Memory and Language, 90, 177199.CrossRefGoogle Scholar
Gollan, T. H., Montoya, R. I., Cera, C., & Sandoval, T. C. (2008). More use almost always means a smaller frequency effect: Aging, bilingualism, and the weaker links hypothesis. Journal of Memory and Language, 58(3), 787814.CrossRefGoogle Scholar
Gollan, T. H., Starr, J., & Ferreira, V. S. (2015). More than use it or lose it: The number-of-speakers effect on heritage language proficiency. Psychonomic Bulletin & Review, 22, 147155.CrossRefGoogle ScholarPubMed
Gollan, T. H., Stasenko, A., & Salmon, D. P. (in press). Which language is more affected in bilinguals with Alzheimer's Disease? Diagnostic sensitivity of the Multilingual Naming Test. Neuropsychology.Google Scholar
Gollan, T. H., Weissberger, G. H., Runnqvist, E., Montoya, R. I., & Cera, C. M. (2012). Self-ratings of spoken language dominance: A Multilingual Naming Test (MINT) and preliminary norms for young and aging Spanish–English bilinguals. Bilingualism: Language and Cognition, 15(3), 594615.CrossRefGoogle Scholar
Grosjean, F. (1998). Studying bilinguals: Methodological and conceptual issues. Bilingualism: Language and Cognition, 1(2), 131149.CrossRefGoogle Scholar
Gullifer, J. W., & Titone, D. (2020). Characterizing the social diversity of bilingualism using language entropy. Bilingualism: Language and Cognition, 23(2), 283294.CrossRefGoogle Scholar
Gullifer, J. W., Kousaie, S., Gilbert, A. C., Grant, A., Giroud, N., Coulter, K., Klein, D., Baum, S., Phillips, N., & Titone, D. (2021). Bilingual language experience as a multidimensional spectrum: Associations with objective and subjective language proficiency. Applied Psycholinguistics, 42(2), 245278.CrossRefGoogle Scholar
Hartig, F. (2022). DHARMa: Residual Diagnostics for Hierarchical (Multi-Level / Mixed) Regression Models. R package version 0.4.5. https://CRAN.R-project.org/package=DHARMaGoogle Scholar
Hoff, E. (2018). Bilingual development in children of immigrant families. Child Development Perspectives, 12(2), 8086.CrossRefGoogle ScholarPubMed
Hoff, E., Welsh, S., Place, S., Ribot, K., Grüter, T., & Paradis, J. (2014). Properties of dual language input that shape bilingual development and properties of environments that shape dual language input. In Paradis, J. & Grüter, T. (Eds.), Input and experience in bilingual development, 13, 119140. John Benjamins Publishing Co.Google Scholar
Hulstijn, J. H. (2011). Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8(3), 229249.CrossRefGoogle Scholar
Hurtado, N., Grüter, T., Marchman, V. A., & Fernald, A. (2014). Relative language exposure, processing efficiency and vocabulary in Spanish–English bilingual toddlers. Bilingualism: Language and Cognition, 17(1), 189202.CrossRefGoogle ScholarPubMed
Kastenbaum, J., Bedore, L., Pena, E., Sheng, L., Mavis, I., Sebastian, R., Vallila-Rohter, S., & Kiran, S. (2018). The influence of language combination and proficiency on bilingual lexical access. Bilingualism Language and Cognition, 131.Google ScholarPubMed
Kaushanskaya, M., Blumenfeld, H. K., & Marian, V. (2020). The Language Experience and Proficiency Questionnaire (LEAP-Q): Ten years later. Bilingualism: Language and Cognition, 23(5), 945950.CrossRefGoogle ScholarPubMed
Li, P., Sepanski, S., & Zhao, X. (2006). Language history questionnaire: A web-based interface for bilingual research. Behavior Research Methods, 38, 202210.CrossRefGoogle ScholarPubMed
Li, P., Zhang, F. A. N., Tsai, E., & Puls, B. (2014). Language history questionnaire (LHQ 2.0): A new dynamic web-based research tool. Bilingualism: Language and Cognition, 17(3), 673680.CrossRefGoogle Scholar
Linck, J. A., Kroll, J. F., & Sunderman, G. (2009). Losing access to the native language while immersed in a second language: Evidence for the role of inhibition in second-language learning. Psychological Science, 20(12), 15071515.CrossRefGoogle Scholar
Lorenzen, B., & Murray, L. L. (2008). Bilingual aphasia: A theoretical and clinical review. American Journal of Speech-Language Pathology, 17, 299317CrossRefGoogle ScholarPubMed
Luk, G., & Bialystok, E. (2013). Bilingualism is not a categorical variable: Interaction between language proficiency and usage. Journal of Cognitive Psychology, 25(5), 605621.CrossRefGoogle Scholar
Lynch, A., Klee, C. A., & Tedick, D. J. (2001). Social factors and language proficiency in postsecondary Spanish immersion: Issues and implications. Hispania, 510524.CrossRefGoogle Scholar
Marian, V., Blumenfeld, H. K., & Kaushanskaya, M. (2007). The Language Experience and Proficiency Questionnaire (LEAP-Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research 50(4), 940967.CrossRefGoogle ScholarPubMed
Nanchen, G., Abutalebi, J., Assal, F., Manchon, M., Démonet, J. F., & Annoni, J. M. (2017). Second language performances in elderly bilinguals and individuals with dementia: The role of L2 immersion. Journal of Neurolinguistics, 43, 4958.CrossRefGoogle Scholar
Newport, E. L., Bavelier, D., & Neville, H. J. (2001). Critical thinking about critical periods: Perspectives on a critical period for language acquisition. Language, brain and cognitive development: Essays in honor of Jacques Mehler, 481502.Google Scholar
Olson, D. J. (2023). A systematic review of proficiency assessment methods in bilingualism research. International Journal of Bilingualism, doi: 13670069231153720.CrossRefGoogle Scholar
Paplikar, A., Alladi, S., Varghese, F. A., Mekala, S., Arshad, F., Sharma, M., Saroja, A.O., Divyaraj, G., Dutt, A., Ellajosyula, R., Ghosh, A., Iyer, G.K., Sunitha, J., Kandukuri, R., Kaul, S., Khan, A.B., Mathew, R., Menon, R.N., Nandi, R., Narayanan, J., Nehra, A., Padma, M.V., Pauranik, A., Ramakrishnan, S., Sarath, L., Shah, U., Tripathi, M., Sylaja, P.N., Varma, R.P., Verma, M., & Vishwanath, Y. (2021). Bilingualism and its implications for neuropsychological evaluation. Archives of Clinical Neuropsychology, 36(8), 15111522.Google Scholar
Rivera Mindt, M., Arentoft, A., Kubo Germano, K., D'Aquila, E., Scheiner, D., Pizzirusso, M., Sandoval, T. C., & Gollan, T. H. (2008). Neuropsychological, cognitive, and theoretical considerations for evaluation of bilingual individuals. Neuropsychology Review, 18, 255268.CrossRefGoogle ScholarPubMed
Ross, S. (1998). Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing, 15(1), 120.CrossRefGoogle Scholar
Rothman, J., Bayram, F., DeLuca, V., Alonso, J. G., Kubota, M., & Puig-Mayenco, E. (2023). Defining bilingualism as a continuum. In Luk, G., Anderson, J. A. E., & Grundy, J. G. (Eds.). Understanding Language and Cognition through Bilingualism: In honor of Ellen Bialystok (pp. 3867). John Benjamins Publishing Co.CrossRefGoogle Scholar
Schmid, M. S., & Yılmaz, G. (2018). Predictors of language dominance: An integrated analysis of first language attrition and second language acquisition in late bilinguals. Frontiers in psychology, 9, 1306.CrossRefGoogle ScholarPubMed
Schrauf, R. W. (2009). English use among older bilingual immigrants in linguistically concentrated neighborhoods: Social proficiency and internal speech as intracultural variation. Journal of Cross-Cultural Gerontology, 24, 157179.CrossRefGoogle ScholarPubMed
Sheng, L., Lu, Y., & Gollan, T. H. (2014). Assessing language dominance in Mandarin–English bilinguals: Convergence and divergence between subjective and objective measures. Bilingualism: Language and Cognition, 17(2), 364383.CrossRefGoogle ScholarPubMed
Sinkeviciute, R., Brown, H., Brekelmans, G., & Wonnacott, E. (2019). The role of input variability and learner age in second language vocabulary learning. Studies in Second Language Acquisition, 41(4), 795820.CrossRefGoogle Scholar
Stasenko, A., Kleinman, D., & Gollan, T. H. (2021). Older bilinguals reverse language dominance less than younger bilinguals: Evidence for the inhibitory deficit hypothesis. Psychology and Aging, 36(7), 806.CrossRefGoogle ScholarPubMed
Thordardottir, E. (2011). The relationship between bilingual exposure and vocabulary development. International Journal of Bilingualism, 15(4), 426445.CrossRefGoogle Scholar
Tomoschuk, B., Ferreira, V. S., & Gollan, T. H. (2019). When a seven is not a seven: Self-ratings of bilingual language proficiency differ between and within language populations. Bilingualism: Language and Cognition, 22(3), 516536.CrossRefGoogle Scholar
Treffers-Daller, J., & Silva-Corvalán, C. (Eds.). (2016). Language dominance in bilinguals: Issues of measurement and operationalization. Cambridge University Press.Google Scholar
Unsworth, S. (2016). Quantity and quality of language input in bilingual language development. In Nicoladis, E. & Montanari, S. (Eds.), Bilingualism across the lifespan : Factors moderating language proficiency (pp. 103122). American Psychological Association.Google Scholar
Williams, K. T. (1997). Expressive Vocabulary Test. Circle Pines, MN: American Guidance Service.Google Scholar
Supplementary material: File

Neveu and Gollan supplementary material

Neveu and Gollan supplementary material
Download Neveu and Gollan supplementary material(File)
File 309.1 KB