Skip to main content Accesibility Help

A meta-analysis of effectiveness studies on computer technology-supported language learning

  • Maja Grgurović (a1), Carol A. Chapelle (a2) and Mack C. Shelley (a3)

With the aim of summarizing years of research comparing pedagogies for second/foreign language teaching supported with computer technology and pedagogy not-supported by computer technology, a meta-analysis was conducted of empirical research investigating language outcomes. Thirty-seven studies yielding 52 effect sizes were included, following a search of literature from 1970 to 2006 and screening of studies based on stated criteria. The differences in research designs required subdivision of studies, but overall results favored the technology-supported pedagogy, with a small, but positive and statistically significant effect size. Second/foreign language instruction supported by computer technology was found to be at least as effective as instruction without technology, and in studies using rigorous research designs the CALL groups outperformed the non-CALL groups. The analyses of instructional conditions, characteristics of participants, and conditions of the research design did not provide reliable results because of the small number of effect sizes representing each group. The meta-analysis results provide an empirically-based response to the questions of whether or not technology-supported pedagogies enhance language learning, and the process of conducting the meta-analysis pointed to areas in research methodology that would benefit from attention in future research.

Hide All
Abraham, L. B. (2008) Computer-mediated glosses in second language reading comprehension and vocabulary learning: A meta-analysis. Computer Assisted Language Learning, 21: 199226.
Adair-Hauck, B., Willingham-McLain, L.Youngs, B. E. (2000) Evaluating the integration of technology and second language learning. CALICO Journal, 17(2): 296306.
Al-Jarf, R. S. (2002) Effect of online learning on struggling ESL college writers. National Educational Computing Conference, San Antonio, Texas: National Educational Computing Conference Proceedings, 23.
Aust, R., Kelley, M. J.Roby, W. (1993) The use of hyper-reference and conventional dictionaries. Educational Technology, Research and Development, 41(4): 6373.
Bowles, M. A. (2004) L2 glossing: To CALL or not to CALL. Hispania, 87(3): 541552.
Chapelle, C. A. (2001) Computer applications in second language acquisition. Cambridge: Cambridge University Press.
Chapelle, C. A. (2003) English language learning and technology: Lectures on applied linguistics in the age of information and communication technology. Amsterdam: John Benjamins Publishing.
Chapelle, C. A. (2007) Challenges in evaluation of innovation: Observations from technology research. Innovation in Language Learning and Teaching, 1(1): 3045.
Chenoweth, N. A., Ushida, E.Murday, K. (2006) Student learning in hybrid French and Spanish courses: An overview of language online. CALICO Journal, 24(1): 115145.
Cooper, H. (1998) Synthesizing research: A guide for literature reviews. Thousand Oaks, CA: Sage.
Cohen, J. (1988) Statistical power analysis for behavioral sciences. Hillsdale, NJ: Erlbaum.
De la Fuente, M. J. (2003) Is SLA Interactionist theory relevant to CALL? A study on the effects of computer-mediated interaction in L2 vocabulary acquisition. Computer Assisted Language Learning, 16(1): 4781.
Dunkel, P. (1991) The effectiveness research on computer-assisted instruction and computer-assisted language learning. In: Dunkel, P. (ed.), Computer-assisted language learning and testing: Research issues and practice. New York: Newbury House, 536.
Echavez-Solano, N. (2003) A comparison of student outcomes and attitudes in technology-enhanced vs. traditional second-semester Spanish language courses. Unpublished doctoral dissertation, The University of Minnesota.
Felix, U. (2005a) What do meta-analyses tell us about CALL effectiveness? ReCALL, 17(2): 269288.
Felix, U. (2005b) Analyzing Recent CALL Effectiveness Research – Towards a Common Agenda. Computer Assisted Language Learning, 18(1–2): 132.
Jeon, E. H.Kaya, T. (2006) Effects of L2 instruction on interlanguage pragmatic development. In: Norris, J. and Ortega, L. (eds.), Synthesizing research on language learning and teaching. Philadelphia PA: John Benjamins, 165211.
Kulik, J. A. (2003) Effects of using instructional technology in colleges and universities: What controlled evaluation studies say. Arlington: SRI International.
Kulik, J. A.Kulik, C. L. C. (1987) Review of recent literature on computer-based instruction. Contemporary Education Review, 12: 222230.
Kulik, J. A.Kulik, C. L. C. (1991) Effectiveness of computer-based instruction: An updated analysis. Computers in Human Behavior, 7(1–2): 7594.
Li, S. (2010) The effectiveness of corrective feedback in SLA: A meta-analysis. Language Learning, 60(2): 309365.
Liu, M., Moore, Z., Graham, L.Lee, S. (2002) A look at the research in computer-based technology use in second language learning: A review of literature from 1990–2000. Journal of Research on Technology in Education, 34(3): 250273.
Lipsey, M. W.Wilson, D. B. (2001) Practical meta-analysis. Thousand Oaks, CA: Sage.
Nagata, N. (1996) Computer vs. workbook instruction in second language acquisition. CALICO Journal, 14(1): 5375.
Norris, J. M.Ortega, L. (2000) Effectiveness of L2 instruction: A research synthesis and a quantitative meta-analysis. Language Learning, 50: 417528.
Norris, J. M.Ortega, L. (2006) Synthesizing research on language learning and teaching. Philadelphia, PA: John Benjamins.
Odenthal, J. M. (1992) The effect of a computer-based writing program on the attitudes and performance of students acquiring English as a Second Language. Unpublished doctoral dissertation, Claremont Graduate School, San Diego State University, Claremont, California.
Oswald, F. L.Plonsky, L. (2010) Meta-analysis in second language research: Choices and challenges. Annual Review of Applied Linguistics, 30: 85110.
Payne, J. S.Whitney, P. J. (2002) Developing L2 oral proficiency through synchronous CMC: output, working memory, and interlanguage development. CALICO Journal, 20(1): 732.
Pederson, K. M. (1987) Research on CALL. In: Smith, W. F. (ed.), Modern media in foreign language education: Theory and implementation. Lincolnwood, IL: National Textbook Company, 99132.
Rawdon, T., Sharp, R. L., Shelley, M.Thomas, J. R. (2012) Meta-analysis of the placebo effect in nutritional supplement studies of muscular performance. Kinesiology Review, 1(2): 137148.
Shelley, M., Rawdon, T., Sharp, R., Thomas, J., Schalinske, K. (2007) Meta-analysis in the human sciences: Are placebo effects real? In: American Statistical Association, 2006 proceedings of the American Statistical Association, section on survey research methods [CD-ROM]. Alexandria, VA: American Statistical Association.
Taylor, A. M. (2006) The effects of CALL versus traditional L1 glosses on L2 reading comprehension. CALICO Journal, 23: 309318.
Tozcy, A.Coady, J. (2004) Successful learning of frequent vocabulary through CALL also benefits reading comprehension and speed. Computer Assisted Language Learning, 17(5): 473495.
Troia, G. A. (2004) Migrant students with limited English proficiency: Can Fast ForWord Language make a difference in their language skills and academic achievement? Remedial and Special Education, 25(6): 353366.
US Department of Education, Office of Planning, Evaluation, and Policy Development (2009) Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Washington, DC.
Zhao, Y. (2003) Recent developments in technology and language learning: a literature review and meta-analysis. CALICO Journal, 21(1): 727.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

  • ISSN: 0958-3440
  • EISSN: 1474-0109
  • URL: /core/journals/recall
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary materials

Grgurović et al. supplementary material
Supplementary Tables and Appendices

 Unknown (153 KB)
153 KB


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed