Skip to main content
×
×
Home

ASSESSING SECOND-LANGUAGE ORAL PROFICIENCY FOR RESEARCH: The Spanish Elicited Imitation Task

  • Harriet Wood Bowden (a1)
Abstract

Proficiency is a key variable in late second language (L2) learning, but one that is undermeasured in current research. This study investigates whether L2 oral proficiency can be quickly and reliably assessed via the Spanish “elicited imitation task” (EIT; Ortega, Iwashita, Rabie, & Norris, 1999). Thirty-seven L2 learners of Spanish with varied L2 experience (from low to very advanced) were tested. The EIT’s external validity was assessed via correlation with the simulated oral proficiency interview. Further analyses examined the EIT’s internal reliability, discriminatory power, and usefulness in identifying subgroups (clusters) of learners within the sample. Results strongly support the utility of the Spanish EIT for measurement of oral proficiency in SLA research. Moreover, the availability of parallel EITs in other languages promises to facilitate comparisons across studies. Thus, more precise measurement and analysis of proficiency in SLA research is called for via standardized measurements including the EIT.

Copyright
References
Hide All
Abutalebi, J. (2008). Neural aspects of second language representation and language control. Acta Psychologica, 128, 466478.
Abutalebi, J., Cappa, S. F., & Perani, D. (2001). The bilingual brain as revealed by functional neuroimaging. Bilingualism: Language and Cognition, 4, 179190.
Ackerman, T. A., Gierl, M. J., & Walker, C. M. (2003). Using multidimensional item response theory to evaluate educational and psychological tests. Educational Measurement: Issues and Practice, 22(3), 3753.
Bley-Vroman, R., & Chaudron, C. (1994). Elicited imitation as a measure of second-language competence. In Tarone, E. E., Gass, S., & Cohen, A. D. (Eds.), Research methodology in second-language acquisition (pp. 245261). Hillsdale, NJ: Lawrence Erlbaum.
Bowles, M. A. (2011). Measuring implicit and explicit knowledge: What can heritage learners contribute? Studies in Second Language Acquisition, 33, 247271.
Brown, J. D. (1997). Statistics Corner. Questions and answers about language testing statistics (skewness and kurtosis). Shiken: JALT Testing and Evaluation SIG Newsletter , 1(1), 2023.
Brown, J. D. (2000). Statistics Corner. Questions and answers about language testing statistics (how can we calculate item statistics for weighted items?). Shiken: JALT Testing and Evaluation SIG Newsletter, 3(2), 1921.
Brown, J. D. (2003). Norm-referenced item analysis (item facilitation and item discrimination). Shiken: JALT Testing and Evaluation SIG Newsletter, 7, 1619.
Calinski, T., & Harabasz, J. (1974). A dendrite method for cluster analysis. Communications in Statistics, 3, 127.
Carrell, P. (1991). Second language reading: Reading ability or language proficiency? Applied Linguistics, 12(2), 159179.
Chaudron, C., & Russell, G. (1990). The validity of elicited imitation as a measure of second language competence. Unpublished manuscript. Manoa, HI: University of Hawai’i.
Ellis, R. (2005). Measuring implicit and explicit knowledge of a second language: A psychometric study. Studies in Second Language Acquisition, 27, 141172.
Grigg, T. (1986). The effects of task, time, and rule knowledge on grammar performance for three English structures. University of Hawai’i Working Papers in ESL, 5, 3760.
Henning, G. (1992). The ACTFL oral proficiency interview: Validity evidence. System, 20(3), 365372.
Hulstijn, J. H. (2011). Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8, 229249.
Hulstijn, J. H. (2012). The construct of language proficiency in the study of bilingualism from a cognitive perspective. Bilingualism: Language and Cognition, 15(2), 422433.
Indefrey, P. (2006). A meta-analysis of hemodynamic studies on first and second language processing: Which suggested differences can we trust and what do they mean? Language Learning, 56, 279304. doi:10.1111/j.1467-9922.2006.00365.x
Kane, M. T. (2006). Validation. In Brennan, R. (Ed.), Educational measurement (4th ed., pp. 1764). Westport, CT: American Council on Education and Praeger.
Kormos, J. (2000). The role of attention in monitoring second language speech production. Language Learning, 50, 343384.
Kotz, S. A. (2009). A critical review of ERP and fMRI evidence on L2 syntactic processing. Brain and Language, 109, 6874.
Malone, M. E. (2000). The simulated oral proficiency interview: Recent developments. In ERIC, ERIC Digest. Washington, DC: ERIC Clearinghouse on Languages and Linguistics. Retrieved from http://files.eric.ed.gov/fulltext/ED447729.pdf.
McDade, H. L., Simpson, M. S., & Lamb, D. E. (1982). The use of elicited imitation as a measure of expressive grammar. Journal of Speech and Hearing Disorders, 47, 1924.
Mozgalina, A. (2015). Applying an argument-based approach for validating language proficiency assessments in second language acquisition research: The elicited imitation test for Russian (Unpublished doctoral dissertation). Washington, DC: Georgetown University.
Naiman, N. (1974). The use of elicited imitation in second language acquisition research. Working Papers on Bilingualism, 2, 137 .
Norris, J. M., & Ortega, L. (2012). Assessing learner knowledge. In Gass, S. M. & Mackey, A. (Eds.), The Routledge handbook of second language acquisition (pp. 573589). New York: Routledge.
Ortega, L. (2000). Understanding syntactic complexity: The measurement of change in the syntax of instructed L2 Spanish learners (Unpublished doctoral dissertation). University of Hawai’i at Manoa.
Ortega, L., Iwashita, N., Norris, J., & Rabie, S. (2002, October). An investigation of elicited imitation tasks in crosslinguistic SLA research. Paper presented at the Second Language Research Forum Conference, Toronto.
Ortega, L., Iwashita, N., Rabie, S., & Norris, J. M. (1999). A multilanguage comparison of measures of syntactic complexity [Funded project]. Honolulu: University of Hawai’i, National Foreign Language Resource Center.
Savignon, S. J. (1982). Dictation as a measure of communicative competence in French as a second language. Language Learning, 32(1), 3351.
Slobin, D. I., & Welsh, C. A. (1973). Elicited imitation as a research tool in developmental psycholinguistics. In Ferguson, C. & Slobin, D. I. (Eds.), Studies of child language development (pp. 485497). New York: Holt, Rinehart & Winston. (Reprinted from Working Paper No 10, Language Behavior Research Laboratory, pp. 485–497, 1968, University of California, Berkeley.)
Stansfield, C. W., & Kenyon, D. M. (1992a). The development and validation of a simulated oral proficiency interview. Modern Language Journal, 76(2), 129141.
Stansfield, C. W., & Kenyon, D. M. (1992b). Research on the comparability of the oral proficiency interview and the simulated oral proficiency interview. System, 20(3), 347364.
Steinhauer, K., White, E. J., & Drury, J. E. (2009). Temporal dynamics of late second language acquisition: Evidence from event-related brain potentials. Second Language Research, 25(1), 1341.
Thissen, D., & Steinberg, L. (2009). Item response theory. In Millsap, R. E. & Maydeu-Olivares, A. (Eds.), The Sage handbook of quantitative methods in psychology (pp. 148177). Thousand Oaks, CA: Sage.
Thomas, M. (1994). Assessment of L2 proficiency in second language acquisition research. Language Learning, 44, 307336.
Thomas, M. (2006). Research synthesis and historiography: The case of assessment of second language proficiency. In Norris, J. & Ortega, L. (Eds.), Synthesizing research on language learning and teaching (pp. 279298). Amsterdam: John Benjamins.
Tracy-Ventura, N., McManus, K., Norris, J., & Ortega, L. (2014). “Repeat as much as you can”: Elicited imitation as a measure of oral proficiency in L2 French. In Leclercq, P., Edmonds, A., & Hilton, H. (Eds.), Measuring L2 proficiency: Perspectives from SLA (pp. 143166). Bristol: Multilingual Matters.
Tremblay, A. (2011). Proficiency assessment standards in second language acquisition research: “Clozing” the gap. Studies in Second Language Acquisition, 33, 339372.
Tremblay, A., & Garrison, M. D. (2010). Cloze tests: A tool for proficiency assessment in research on L2 French. In Prior, M. T., Watanabe, Y., & Lee, S.-K. (Eds.), Selected proceedings of the Second Language Research Forum 2008 (pp. 7388). Somerville, MA: Cascadilla Press.
Vinther, T. (2002). Elicited imitation: A brief review. International Journal of Applied Linguistics 12, 5473.
Wu, S., & Ortega, L. (2013). Measuring global oral proficiency in SLA research: A new elicited imitation test of L2 Chinese. Foreign Language Annals, 46(4), 680704.
Zhou, S. (2011). Learning to express motion events in L2 Chinese: A cognitive linguistic perspective (Unpublished doctoral dissertation). Manoa, HI: University of Hawaii.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Studies in Second Language Acquisition
  • ISSN: 0272-2631
  • EISSN: 1470-1545
  • URL: /core/journals/studies-in-second-language-acquisition
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Full text views

Total number of HTML views: 38
Total number of PDF views: 602 *
Loading metrics...

Abstract views

Total abstract views: 1262 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 12th June 2018. This data will be updated every 24 hours.