Skip to main content

Replication research in computer-assisted language learning: Replication of Neri et al. (2008) and Satar & Ӧzdener (2008)

  • Zöe Handley (a1)

This paper argues that key findings from computer-assisted language learning (CALL) research need to be replicated to permit the construction of a valid and reliable evidence-base which can inform the design of future CALL software and activities, together with language teachers’ decisions about their adoption. Through the critical examination of two key studies, the limitations of much current CALL research with respect to the construction of such an evidence-base are highlighted and approaches to replication which may overcome these limitations are discussed. Like much CALL research, both papers are experimental studies. Key issues raised by the two studies are the need to: (1) conduct replications focused on attributes and affordances which transcend multiple technologies which might be employed in CALL, (2) collect process data to increase the explanatory power of studies, and (3) link CALL research to relevant second language acquisition (SLA) theory and research to increase the explanatory power of studies and integrate the findings from individual studies into the CALL and SLA evidence-base more broadly. Emphasis is also placed on the need to conduct replications with different populations in different settings in order to demonstrate the validity and reliability of current findings.

Hide All
Ahmadian, M. J., Tavakoli, M. & Dastjerdi, H. V. (2012). The combined effects of online planning and task structure on complexity, accuracy and fluency of L2 speech. The Language Learning Journal 43.1, 4156.
Andon, N. & Eckerth, J. (2009). Chacun à son gout? Task-based L2 pedagogy from the teacher's point of view. International Journal of Applied Linguistics 19.3, 286310.
Aydin, B. (2001). Konuşma ve yazma derslerinde yabani dil öğrenimindki kaygi nedenleri [Reasons for anxiety in foreign language learning in speaking and writing courses]. Unpublished doctoral dissertation, Andalou University, Turkey, no. 1265.
Beauvois, M. H. (1997). Computer-mediated communication (CMC): Technology for improving speaking and writing. In Bush, M. D. & Terry, R. M. (eds.), Technology-enhanced language learning. Lincolnwood, IL: National Textbook Company, 165184.
Carless, D. (2007). The suitability of task-based approaches for secondary schools: Perspectives from Hong Kong. System 35.4, 595608.
Chapelle, C. & Jamieson, J. (1990). Internal and external validity issues in research on CALL effectiveness. In Dunkel, P. (ed.), Computer assisted language learning and testing: Research issues and practice. New York: Newbury House, 3759.
Chun, D. (2012). Review article: Replication studies in CALL research. CALICO Journal 29.4, 591600.
Cincarek, T., Gruhn, R., Hacker, C., Nöth, E. & Satoshi, N. (2009). Automatic pronunciation scoring of words and sentences independent from the non-native's first language. Computer Speech and Language 23.1, 6588.
Cohen, L., Manion, L., Morrison, K., & Bell, R. (2011). Research methods in education. London: Routledge.
Compton, L. (2002). From chatting to confidence: A case study of the impact of online chatting on international teaching assistants’ willingness to communicate, confidence level and fluency in oral communication. Unpublished MA thesis, Department of English, Iowa State University, Ames.
Dörnyei, Z. (2005). The psychology of the language learner: Individual differences in second language acquisition. London: Routledge.
Ellis, R. (2009). The differential effects of three types of task planning on the fluency, complexity, and accuracy in L2 oral production. Applied Linguistics 30.4, 474509.
Eskenazi, M. (2009). An overview of spoken language technology for education. Speech Communication 51, 832844.
Felix, U. (2008). The unreasonable effectiveness of CALL: What have we learned in two decades of research? ReCALL 20.2, 141161.
Foster, P. & Skehan, P. (2013). Anticipating a post-task activity: The effects on accuracy, complexity, and fluency of second language performance. Canadian Modern Language Review 69.3, 249273.
Foster, P. & Wigglesworth, G. (2016). Measuring accuracy in second language performance: The case for a weighted clause ratio. Annual Review of Applied Linguistics 36, 119.
Foster, P. Tonkyn, A. & Wigglesworth, G. (2000). A unit for all reasons: The analysis of spoken interaction. Applied Linguistics 21.3, 354374.
Fujii, A. & Mackey, A. (2009). Interactional feedback in learner-learner interactions in a task-based EFL classroom. International Review of Applied Linguistics in Language Teaching 47.3–4, 267301.
Garrett, N. (1991). Technology in the service of language learning: Trends and issues. The Modern Language Journal 75, 74101.
Gerosa, M. & Giuliani, D. (2004). Preliminary investigations in automatic recognition of English sentences uttered by Italian children. In Delmonte, R., Delcloque, P. & Tonelli, S. (eds.), Proceedings of NLP and speech technologies in advanced language learning systems symposium, Venice, Italy. Padova: Unipress, 912.
Grgurovic, M., Chapelle, C. A. & Shelley, M. C. (2013). A meta-analysis of effectiveness studies on computer technology-supported language learning. ReCALL 25.2, 165198.
Handley, Z. (2014). Constructing an evidence-base for future CALL design with ‘engineering power’: The need for more basic research and instrumental replication. EUROCALL Review 22.2, 4656.
Hewitt, E. & Stephenson, J. (2012). Foreign language anxiety and oral exam performance: A replication of Phillip's MLJ study. The Modern Language Journal 96.2, 170189.
Horwitz, E, Horwitz, M. & Cope, J. (1991). Foreign language classroom anxiety. In Horwitz, E. & Young, D. (eds.), Language anxiety: From theory and research to classroom implications. Englewood Cliffs, New Jersey: Prentice Hall, 2736.
Hughes, A. (2003). Testing for language teachers. Cambridge: Cambridge University Press.
Li, S., Ellis, R. & Zhu, Y. (2016). Task-based versus task-supported language instruction: An experimental study. Annual Review of Applied Linguistics 36, 205229.
Macaro, E., Handley, Z. & Walter, C. (2012). A systematic review of CALL in English as a second language: Focus on primary and secondary education. Language Teaching 45.1, 143.
Mackey, A. (2012). Why (or why not), when and how to replicate research. In Porte, G. K. (ed.), Replication research in applied linguistics. Cambridge: Cambridge University Press, 3469.
Marsden, E. J. (2007). Can educational experiments both test a theory and inform practice? British Educational Research Journal 33.4, 565588.
Marsden, E. J. & Mackey, A. (2014). IRIS: A new resource for second language research. Linguistic Approaches to Bilingualism 4.1, 125130.
McDonough, K. & Chaikit-Mongkol, W. (2007). Teachers' and learners' reactions to a task-based EFL course in Thailand. TESOL Quarterly 41.1, 107132.
Neri, A., Cucchiarini, C. & Strik, H. (2008a). The effectiveness of computer-based speech corrective feedback for improving segmental quality in L2 Dutch. ReCALL 20.2, 225243.
Neri, A., Mich, O., Gerosa, M. & Giuliani, D. (2008b). The effectiveness of computer assisted pronunciation training for foreign language learning by children. Computer Assisted Language Learning 21.5, 393408.
Park, S. (2010). The influence of pre-task instructions and pre-task planning on focus on form during Korean EFL task-based interaction. Language Teaching Research 14.1, 926.
Pederson, K. (1987). Research on CALL. In Smith, W. F. (ed.), Modern media in foreign language education: Theory and implementation. Lincolnwood, Illinois: National Textbook Company, 99131.
Phillips, E. M. (1992). The effects of language anxiety on students’ oral test performance and attitudes. The Modern Language Journal 76.1, 1426.
Philp, J., Oliver, R. & Mackey, A. (2006). The impact of planning time on children's task-based interactions. System 34.4, 547565.
Plonsky, L. (2012). Replication, meta-analysis, and generalizability. In Porte, G. (ed.), Replication research in applied linguistics. Cambridge: Cambridge University Press, 116132.
Plonsky, L. (2015). Quantitative considerations for improving replicability in CALL and applied linguistics. CALICO Journal 32.2, 232244.
Polio, C. (2012). Replication in published applied linguistics research: A historical perspective. Porte, In G. (ed.), Replication research in applied linguistics. Cambridge: Cambridge University Press, 4791.
Polio, C. & Gass, S. (1997). Replication and reporting. Studies in Second Language Acquisition 19, 499508.
Porte, G. (2013). Who needs replication? CALICO Journal 30.1, 1015.
Probst, K., Ke, Y. & Eskénazi, M. (2002) Enhancing foreign language tutors – in search of the golden speaker, Speech Communication 37.3–4, 161174.
Révész, A. (2014). Towards a fuller assessment of cognitive models of task-based learning: Investigating task-generated cognitive demands and processes. Applied Linguistics 35, 8792.
Robinson, P. (2011). Task-based language learning: A review of the issues. Language Learning 61.1, 136.
Satar, H. M. & Ӧzdener, N. (2008). The effects of synchronous CMC on speaking proficiency and anxiety: Text versus voice chat. The Modern Language Journal 92.4, 595613.
Skehan, P. & Foster, P. (1999). The influence of task structure and processing conditions on narrative retellings. Language Learning 49.1, 93120.
Slimani-Rolls, A. (2005). Rethinking task-based language learning: What we can learn from the learners. Language Teaching Research 9.2, 195218.
Stockwell, G. (2012). Diversity in research and practice. In Stockwell, G. (ed.), Computer-assisted language learning: Diversity in research and practice. Cambridge: Cambridge University Press, 147163.
Torgerson, C. J. & Torgerson, D. J. (2003). The design and conduct of randomised controlled trials in education: Lessons from health care. Oxford Review of Education 29, 6780.
van den Branden, K. (2009). Mediating between predetermined order and chaos: The role of the teacher in task-based language education. International Journal of Applied Linguistics 19.3, 264285.
Wachowicz, K. A. & Scott, B. (1999). Software that listens: It's not a question of whether, it's a question of how. CALICO Journal 16.3, 253276.
Zheng, X. & Borg, S. (2014). Task-based learning and teaching in China: Secondary school teachers’ beliefs and practices. Language Teaching Research 18.2, 205221.
Ziegler, N. (2015). Synchronous computer-mediated communication and interaction. Studies in Second Language Acquisition 38.3, 134.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Language Teaching
  • ISSN: 0261-4448
  • EISSN: 1475-3049
  • URL: /core/journals/language-teaching
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Altmetric attention score

Full text views

Total number of HTML views: 18
Total number of PDF views: 128 *
Loading metrics...

Abstract views

Total abstract views: 943 *
Loading metrics...

* Views captured on Cambridge Core between 7th March 2017 - 21st March 2018. This data will be updated every 24 hours.