Skip to main content Accessibility help

Effects of modality preference and working memory capacity on captioned videos in enhancing L2 listening outcomes

  • Emily Fen Kam (a1), Yeu-Ting Liu (a2) and Wen-Ta Tseng (a3)


Captioned video is widely used to enhance second language (L2) learners’ exposure to oral input beyond the classroom setting, and captioning has been found to provide an instantaneous, useful visual aid for parsing and understanding L2 oral discourse. Nevertheless, a meta-analysis has shown that captioning exerts a selective effect on L2 learners with different profiles. This study investigated whether L2 learners’ modality preferences (visual vs. auditory) and working memory capacity (high vs. low) would modulate the effect of full captions on L2 listening outcome. Results from 60 participants revealed that both cognitive variables affected their L2 listening to different extents. Notably, working memory capacity modulates the impact of L2 learners’ preferred modality on their listening outcome. Modality preference did not exert any significant impact on the listening outcome of L2 learners with lower working memory capacity. For L2 learners with high working memory capacity, their modality preference played a pivotal role in modulating their listening outcome; in this case, auditory learners had the best listening performance viewing the video without captions, whereas visual learners did best when watching the captioned video. These findings speak to the need for taking individual differences into consideration when employing captioned videos.


Corresponding author

*All correspondence regarding this publication should be addressed to Yeu-Ting Liu (Email:


Hide All
Alptekin, C. & Erçetin, G. (2009) Assessing the relationship of working memory to L2 reading: Does the nature of comprehension process and reading span task make a difference? System, 37(4): 627639.
Chang, C.-C., Tseng, K.-H. & Tseng, J.-S. (2011) Is single or dual channel with different English proficiencies better for English listening comprehension, cognitive load and attitude in ubiquitous learning environment? Computers & Education, 57(4): 23132321.
Chen, Y.-R., Liu, Y.-T. & Todd, A. G. (2018) Transient but effective? Captioning and adolescent EFL learners’ spoken vocabulary acquisition. English Teaching & Learning, 42(1): 2556.
Friedman, N. P. & Miyake, A. (2004) The reading span test and its predictive power for reading comprehension ability. Journal of Memory and Language, 51(1): 136158.
Garza, T. J. (1991) Evaluating the use of captioned video materials in advanced foreign language learning. Foreign Language Annals, 24(3): 239258.
Gass, S., Winke, P., Isbell, D. R. & Ahn, J. (2019) How captions help people learn languages: A working-memory, eye-tracking study. Language Learning & Technology, 23(2): 84104.
Hasler, B. S., Kersten, B. & Sweller, J. (2007) Learner control, cognitive load and instructional animation. Applied Cognitive Psychology, 21(6): 713729.
Huang, H.-C. & Eskey, D. E. (1999) The effects of closed-captioned television on the listening comprehension of intermediate English as a second language (ESL) students. Journal of Educational Technology Systems, 28(1): 7596.
Kozan, K., Erçetin, G. & Richardson, J. C. (2015) Input modality and working memory: Effects on second language text comprehension in a multimedia learning environment. System, 55: 6373.
Lee, M. & Révész, A. (2018) Promoting grammatical development through textually enhanced captions: An eye-tracking study. The Modern Language Journal, 102(3): 557577.
Lee, P.-J., Liu, Y.-T. & Tseng, W.-T. (2019) One size fits all? In search of the desirable caption display for second language learners with different caption reliance in listening comprehension. Language Teaching Research. Advance online publication.
Leveridge, A. N. & Yang, J. C. (2013) Testing learner reliance on caption supports in second language listening comprehension multimedia environments. ReCALL, 25(2): 199214.
Leveridge, A. N. & Yang, J. C. (2014) Learner perceptions of reliance on captions in EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6): 545559.
Liu, Y.-T. & Todd, A. G. (2014) Dual-modality input in repeated reading for foreign language learners with different learning styles. Foreign Language Annals, 47(4): 684706.
Linck, J. A., Osthus, P., Koeth, J. T. & Bunting, M. F. (2014) Working memory and second language comprehension and production: A meta-analysis. Psychonomic Bulletin & Review, 21(4): 861883.
Markham, P. & Peter, L. (2003) The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems, 31(3): 331341.
Markham, P. L., Peter, L. A. & McCarthy, T. J. (2001) The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign Language Annals, 34(5): 439445.
Mayer, R. E. (2001) Multimedia learning. New York: Cambridge University Press.
Mayer, R. E. (2005) Principles for managing essential processing in multimedia learning: Segmenting, pretraining, and modality principles. In Mayer, R. E. (ed.), Cambridge handbook of multimedia learning. New York: Cambridge University Press, 169182.
Mayer, R. E. & Moreno, R. (2003) Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1): 4352.
Mirzaei, M. S., Meshgi, K., Akita, Y. & Kawahara, T. (2017) Partial and synchronized captioning: A new tool to assist learners in developing second language listening skill. ReCALL, 29(2): 178199.
Montero Perez, M., Noortgate, W. V. D. & Desmet, P. (2013) Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3): 720739.
Moreno, R. & Mayer, R. E. (2007) Interactive multimodal learning environments. Educational Psychology Review, 19(3): 309326.
Peters, E. (2019) The effect of imagery and on-screen text on foreign language vocabulary learning from audio-visual input. TESOL Quarterly, 53: 10081032.
Pujadas, G. & Muñoz, C. (2019) Extensive viewing of captioned and subtitled TV series: A study of L2 vocabulary learning by adolescents. The Language Learning Journal, 47(4): 479496.
Reid, J. M. (ed.) (1995) Learning styles in the ESL/EFL classroom. Boston: Heinle & Heinle.
Révész, A. (2012) Working memory and the observed effectiveness of recasts on different L2 outcome measures. Language Learning, 62(1): 93132.
Sagarra, N. (2017) Longitudinal effects of working memory on L2 grammar and reading abilities. Second Language Research, 33(3): 341363.
Seufert, T., Schütze, M. & Brünken, R. (2009) Memory characteristics and modality in multimedia learning: An aptitude–treatment–interaction study. Learning and Instruction, 19(1): 2842.
Suárez, M. D. M. & Gesa, F. (2019) Learning vocabulary with the support of sustained exposure to captioned video: Do proficiency and aptitude make a difference? The Language Learning Journal, 47(4): 497517.
Sueyoshi, A. & Hardison, D. M. (2005) The role of gestures and facial cues in second language listening comprehension. Language Learning, 55(4): 661699.
Taylor, G. (2005) Perceived processing strategies of students watching captioned video. Foreign Language Annals, 38(3): 422427.
Turner, M. L. & Engle, R. W. (1989) Is working memory capacity task dependent? Journal of Memory and Language, 28(2): 127154.
Winke, P., Gass, S. & Sydorenko, T. (2010) The effects of captioning videos used for foreign language listening activities. Language Learning & Technology, 14(1): 6586.
Winke, P., Gass, S. & Sydorenko, T. (2013) Factors influencing the use of captions by foreign language learners: An eye‐tracking study. The Modern Language Journal, 97(1): 254275.


Effects of modality preference and working memory capacity on captioned videos in enhancing L2 listening outcomes

  • Emily Fen Kam (a1), Yeu-Ting Liu (a2) and Wen-Ta Tseng (a3)


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.