Skip to main content

LEXICAL PROFILES OF COMPREHENSIBLE SECOND LANGUAGE SPEECH: The Role of Appropriateness, Fluency, Variation, Sophistication, Abstractness, and Sense Relations

  • Kazuya Saito (a1), Stuart Webb (a2), Pavel Trofimovich (a3) and Talia Isaacs (a4)

This study examined contributions of lexical factors to native-speaking raters’ assessments of comprehensibility (ease of understanding) of second language (L2) speech. Extemporaneous oral narratives elicited from 40 French speakers of L2 English were transcribed and evaluated for comprehensibility by 10 raters. Subsequently, the samples were analyzed for 12 lexical variables targeting diverse domains of lexical usage (appropriateness, fluency, variation, sophistication, abstractness, and sense relations). For beginner-to-intermediate speakers, comprehensibility was related to basic uses of L2 vocabulary (fluent and accurate use of concrete words). For intermediate-to-advanced speakers, comprehensibility was linked to sophisticated uses of L2 lexis (morphologically accurate use of complex, less familiar, polysemous words). These findings, which highlight complex associations between lexical variables and L2 comprehensibility, suggest that improving comprehensibility requires attention to multiple lexical domains of L2 performance.

Corresponding author
*Correspondence concerning this article should be addressed to Kazuya Saito, Birkbeck, University of London, The Department of Applied Linguistics and Communication, 30 Russell Square, London WC1B 5DT, UK. E-mail:
Hide All
Adolphs, S., & Schmitt, N. (2003). Lexical coverage of spoken discourse. Applied Linguistics, 24, 425438.
Baayen, R. H., Piepenbrock, R., & Gulikers, L. (1995). CELEX. Philadelphia, PA: Linguistic Data Consortium.
Bosker, H. R., Pinget, A.-F., Quené, H., Sanders, T., & de Jong, N. H. (2013). What makes speech sound fluent? The contributions of pauses, speed and repairs. Language Testing, 30, 159175.
Cook, V. (Ed.). (2002). Portraits of the L2 user. Clevedon, UK: Multilingual Matters.
Crossley, S., & McNamara, D. (2013). Applications of text analysis tools for spoken response grading. Language Learning & Technology, 17, 171192.
Crossley, S. A., Salsbury, T., & McNamara, D. S. (2009). Measuring L2 lexical growth using hypernymic relationships. Language Learning, 59, 307334.
Crossley, S. A., Salsbury, T., & McNamara, D. S. (2010). The development of polysemy and frequency use in English second language speakers. Language Learning, 60, 573605.
Crossley, S. A., Salsbury, T., & McNamara, D. S. (2014). Assessing lexical proficiency using analytic ratings: A case for collocation accuracy. Applied Linguistics. Advance online publication. doi: 10.1093/applin/amt056
Crossley, S. A., Salsbury, T., McNamara, D. S., & Jarvis, S. (2011). What is lexical proficiency? Some answers from computational models of speech data. TESOL Quarterly, 45, 182193.
Crowther, D., Trofimovich, P., Isaacs, T., & Saito, K. (2015). Does speaking task affect second language comprehensibility? Modern Language Journal, 99, 8095.
De Bot, K. (1996). The psycholinguistics of the output hypothesis. Language Learning, 46, 529555.
De Jong, N. H., Steinel, M. P., Florijn, A. F., Schoonen, R., & Hulstijn, J. H. (2012). Facets of speaking proficiency. Studies in Second Language Acquisition, 34, 534.
Derwing, T. M., & Munro, M. J. (2009). Putting accent in its place: Rethinking obstacles to communication. Language Teaching, 42, 476490.
Derwing, T. M., & Munro, M. J. (2013). The development of L2 oral language skills in two L1 groups: A seven-year study. Language Learning, 63, 163185.
Derwing, T. M., Rossiter, M. J., Munro, M. J. & Thomson, R. I. (2004). L2 fluency: Judgments on different tasks. Language Learning, 54, 655679.
Ellis, N., & Beaton, A. (1993). Psycholinguistic determinants of foreign language vocabulary acquisition. Language Learning, 43, 559617.
Færch, C., & Kasper, G. (1984). Two ways of defining communication strategies. Language Learning, 34, 4563.
Field, J. (2005). Intelligibility and the listener: The role of lexical stress. TESOL Quarterly, 39, 399423.
Foster, P., Tonkyn, A., & Wigglesworth, G. (2000). Measuring spoken language. Applied Linguistics, 21, 354375.
Gass, S. M., & Mackey, A. (2006). Input, interaction and output: An overview. AILA Review, 19, 317.
Gatbonton, E., & Segalowitz, N. (2005). Rethinking the communicative approach: A focus on accuracy and fluency. Canadian Modern Language Review, 61, 325353.
Goldschneider, J. M., & DeKeyser, R. M. (2001). Explaining the “Natural Order of L2 Morpheme Acquisition” in English: A Meta-analysis of multiple determinants. Language Learning, 51, 150.
Hahn, L. (2004). Primary stress and intelligibility: Research to motivate the teaching of suprasegmentals. TESOL Quarterly, 38, 201223.
Hulstijn, J. H., Schoonen, R., De Jong, N. H., Steinel, M. P., & Florijn, A. (2012). Linguistic competences of learners of Dutch as a second language at the B1 and B2 levels of speaking proficiency of the Common European Framework of Reference for Languages (CEFR). Language Testing, 29, 203221.
Isaacs, T., & Thomson, R. I. (2013). Rater experience, rating scale length, and judgments of L2 pronunciation: Revisiting research conventions. Language Assessment Quarterly, 10, 135159.
Isaacs, T., & Trofimovich, P. (2012). Deconstructing comprehensibility: Identifying the linguistic influences on listeners’ L2 comprehensibility ratings. Studies in Second Language Acquisition, 34, 475505.
Iwashita, N., Brown, A., McNamara, T., & O’Hagan, S. (2008). Assessed levels of second language speaking proficiency: How distinct? Applied Linguistics, 29, 2949.
Jenkins, J. (2000). The phonology of English as an international language. Oxford, UK: Oxford University Press.
Jiang, N. (2007). Selective integration of linguistic knowledge in adult second language acquisition. Language Learning, 57, 133.
Kang, O., Rubin, D., & Pickering, L. (2010). Suprasegmental measures of accentedness and judgments of English language learner proficiency in oral English. Modern Language Journal, 94, 554566.
Koizumi, R. (2012). Vocabulary and speaking. In Chapelle, C. (Ed.), The encyclopedia of applied linguistics (pp. 17). Oxford, UK: Wiley Blackwell.
Koizumi, R., & In’nami, Y. (2012). Effects of text length on lexical diversity measures: Using short texts with less than 200 tokens. System, 40, 554564.
Kormos, J. (2006). Speech production and second language acquisition. Mahwah, NJ: Erlbaum.
Laufer, B., & Nation, P. (1995). Vocabulary size and use: Lexical richness in L2 written production. Applied Linguistics, 16, 307322.
Lennon, P. (1990). Investigating fluency in EFL: A quantitative approach. Language Learning, 40, 387417.
Levis, J. (2005). Changing contexts and shifting paradigms in pronunciation teaching. TESOL Quarterly, 39, 367377.
Long, M. H. (1996). The role of the linguistic environment in second language acquisition. In Ritchie, W. C. & Bhatia, T. K. (Eds.), Handbook of language acquisition. Vol. 2: Second language acquisition (pp. 413468). New York, NY: Academic Press.
Lu, X. (2012). The relationship of lexical richness to the quality of ESL learners’ oral narratives. Modern Language Review, 96, 190208.
Lyster, R. (2007). Learning and teaching languages through content: A counterbalanced approach. Amsterdam, the Netherlands: Benjamins.
Mackey, A., Gass, S., & McDonough, K. (2000). How do learners perceive interactional feedback? Studies in Second Language Acquisition, 22, 471497.
MATLAB (Version 8.1) [Computer software]. (2013). Natick, MA: The Mathworks Inc.
McCarthy, P. M., & Jarvis, S. (2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods, 42, 381392.
McNamara, D. S., Graesser, A. C., McCarthy, P. M., & Cai, Z. (2014). Automated evaluation of text and discourse with Coh-Metrix. New York, NY: Cambridge University Press.
Munro, M. J., & Derwing, T. M. (1999). Foreign accent comprehensibility and intelligibility in the speech of second language learners. Language Learning, 49, 285310.
Munro, M., & Derwing, T. (2006). The functional load principle in ESL pronunciation instruction: An exploratory study. System, 34, 520531.
Nation, I. S. P., & Webb, S. (2011). Researching and analyzing vocabulary. Boston, MA: Heinle.
Ochs, E. (1979). Transcription as theory. In Ochs, E. & Schieffelin, B. B. (Eds.), Developmental pragmatics (pp. 4372). New York, NY: Academic Press.
Patkowski, M. (1980). The sensitive period for the acquisition of syntax in a second language. Language Learning, 30, 449472.
Piske, T., MacKay, I., & Flege, J. (2001). Factors affecting degree of foreign accents in an L2: A review. Journal of Phonetics, 29, 191215.
Read, J. (2000). Assessing vocabulary. Cambridge, UK: Cambridge University Press.
Saito, K. (2015). Experience effects on the development of late second language learners’ oral proficiency. Language Learning, 65(3).
Saito, K., Trofimovich, P., & Isaacs, T. (2015). Second language speech production: Investigating linguistic correlates of comprehensibility and accentedness for learners at different ability levels. Applied Psycholinguistics. Advance online publication. doi: 10.1017/S0142716414000502
Saito, K., Trofimovich, P., Isaacs, T., & Webb, S. (in press). Re-examining phonological and lexical correlates of second language comprehensibility: The role of rater experience. In Isaacs, T. & Trofimovich, P. (Eds.). Interfaces in second language pronunciation assessment: Interdisciplinary perspectives. Bristol, UK: Multilingual Matters.
Salsbury, T., Crossley, S. A., & McNamara, D. S. (2011). Psycholinguistic word information in second language oral discourse. Second Language Research, 27, 343360.
Schmitt, N. (1998). Tracking the incremental acquisition of a second language vocabulary: A longitudinal study. Language Learning, 48, 281317.
Schmitt, N. (2008). State of the art: Instructed second language vocabulary acquisition. Language Teaching Research, 12, 329363.
Schmitt, N., & Meara, P. (1997). Researching vocabulary through a word knowledge framework: Word associations and verbal suffixes. Studies in Second Language Acquisition, 19, 1736.
Stadthagen-Gonzalez, H., & Davis, C. J. (2006). The Bristol norms for age of acquisition, imageability, and familiarity. Behavior Research Methods, 38, 598605.
Tavakoli, P., & Foster, P. (2010). Task design and second language performance: The effect of narrative type on learner output. Language Learning, 58, 439473.
Trofimovich, P., & Baker, W. (2006). Learning second-language suprasegmentals: Effect of L2 experience on prosody and fluency characteristics of L2 speech. Studies in Second Language Acquisition, 28, 130.
van Zeeland, H., & Schmitt, N. (2013). Incidental vocabulary acquisition through L2 listening: A dimensions approach. System, 41, 609624.
Varonis, E. M., & Gass, S. (1982). The comprehensibility of nonnative speech. Studies in Second Language Acquisition, 4, 114136.
Verspoor, M., & Lowie, W. (2003). Making sense of polysemous words. Language Learning, 53, 547586.
Webb, S., & Rodgers, M. P. H. (2009). The vocabulary demands of television programs. Language Learning, 59, 335366.
Wilson, M. D. (1988). The MRC psycholinguistic database: Machine readable dictionary, Version 2. Behavior Research Methods, Instruments and Computers, 20, 611.
Winke, P., Gass, S., & Myford, C. (2013). Raters’ L2 background as a potential source of bias in rating oral performance. Language Testing, 30, 231252.
Yao, Z., Saito, K., Trofimvich, P., & Isaacs, T. (2013). Z-Lab [Computer software]. Retrieved from (Accessed on August 1, 2013).
Yuan, F., & Ellis, R. (2003). The effects of pre-task planning and on-line planning on fluency, complexity and accuracy in L2 monologic oral production. Applied Linguistics, 24, 127.
Zareva, A. (2007). Structure of the second language mental lexicon: How does it compare to native speakers’ lexical organization? Second Language Research, 23, 123153.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Studies in Second Language Acquisition
  • ISSN: 0272-2631
  • EISSN: 1470-1545
  • URL: /core/journals/studies-in-second-language-acquisition
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Altmetric attention score

Full text views

Total number of HTML views: 34
Total number of PDF views: 581 *
Loading metrics...

Abstract views

Total abstract views: 1131 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 18th August 2018. This data will be updated every 24 hours.