There has recently been a surge of interest in improving the replicability of second language (L2) research. However, less attention is paid to replicability in the context of L2 meta-analyses. I argue that conducting interrater reliability (IRR) analyses is a key step toward improving the replicability of L2 meta-analyses. To that end, I first discuss the foundation of IRR in the context of meta-analytic research. Second, I introduce two IRR measures, S index and Specific Agreement, which aid in improving the replicability of meta-analytic research. Third, I offer a flexible R program, meta_rate, to facilitate the conduct of IRR analyses for L2 meta-analyses. Fourth, I apply the R program to an actual meta-analytic L2 coding sheet to demonstrate the practical use of the IRR methods discussed. Finally, I provide interpretive guidelines to assist both L2 meta-analysts and journals with the transparent reporting of the IRR findings.

This study examines second (L2) and third (L3) language learners’ pitch perception. We test the hypothesis that a listener’s discrimination of and sensitivity (d’) to Japanese pitch accent reflects how pitch cues inform all words a listener knows in an additive, nonselective manner rather than how pitch cues inform words in a selective, Japanese-only manner. Six groups of listeners performed a speeded ABX discrimination task in Japanese. Groups were defined by their L1, L2, and L3 experience with the target language’s pitch cues (Japanese), a language with less informative pitch cues (English), or a language with more informative pitch cues (Mandarin Chinese). Results indicate that sensitivity to pitch is better modeled as a function of pitch’s informativeness across all languages a listener speaks. These findings support cue-centric views of perception and transfer, demonstrate potential advantageous transfer of tonal-L1/L2 speakers, and highlight the cumulative role that pitch plays in language learning.

Proper nouns constitute a lexical class with special properties and are thus treated differently from other words by second language acquisition researchers. An assumption exists that even low-proficiency learners will find them unproblematic, yet research suggests this assumption might be misplaced. The present study involved two self-paced reading experiments designed to investigate proper nouns’ influence on Japanese university students’ reading fluency. In Experiment 1, participants were presented with 60 decontextualized sentences containing 30 proper nouns and 30 common nouns to determine whether they are processed in a similar manner. In Experiment 2, participants read another 60 sentences comprising a book chapter to explore the effects of repeated exposure to a set of proper nouns. The results indicated that proper nouns are processed in a similar manner to common nouns in terms of disrupting reading fluency. The implications for language learning pedagogy, in particular extensive reading, are discussed.

Listener-based ratings have become a prominent means of defining second language (L2) users’ global speaking ability. In most cases, local listeners are recruited to evaluate speech samples in person. However, in many teaching and research contexts, recruiting local listeners may not be possible or advisable. The goal of this study was to hone a reliable method of recruiting listeners to evaluate L2 speech samples online through Amazon Mechanical Turk (AMT) using a blocked rating design. Three groups of listeners were recruited: local laboratory raters and two AMT groups, one inclusive of the dialects to which L2 speakers had been exposed and another inclusive of a variety of dialects. Reliability was assessed using intraclass correlation coefficients, Rasch models, and mixed-effects models. Results indicate that online ratings can be highly reliable as long as appropriate quality control measures are adopted. The method and results can guide future work with online samples.

Referential expressions (REs) have been investigated in L2 English but to date there is no single study that systematically and simultaneously analyzes the development and acquisition of the multiple factors that constrain the choice of REs in natural discourse production. We investigate L1 Spanish–L2 English learners across three proficiency levels versus an English control group from the COREFL corpus. An analysis of both the RE and its antecedent(s) reveals that different intra- and extralinguistic factors constrain the choice of REs (information status, activated antecedents, syntactic configurations, characterhood, within-task effect, and proficiency level). L2 learners (L2ers) are sensitive to some factors but are unable to fully attain native-like levels even at advanced stages. They do not transfer null subjects from their L1 contrary to previous L2 research, and do not find all contexts at the syntax-discourse interface equally problematic, thus confirming previous theoretical proposals and empirical findings.

A foundation of second language motivational theory has been that motivation contributes to explaining variance in language learning proficiency; however, empirical findings have been mixed. This article presents an innovative approach to exploring L2 proficiency and motivations of teenage English language learners in Madrid, Spain (N = 1773). Participants completed a multiskill English language test, plus an eight-scale questionnaire operationalizing constructs from Dörnyei’s L2 Motivational Self System (Dörnyei, 2005). Data were analysed using Latent Variable Mixture Modeling, a person-centered profiling approach. Results indicated five distinct classes of students, characterized by differing motivation-proficiency profiles. The importance of this study is that the analysis does not assume a homogenous relationship between motivational traits and proficiency levels across the learner sample; whilst there is undoubtedly a connection between the two areas, it is not a straightforward correlation, explaining to some extent discrepancies in previous findings and laying groundwork for further, more nuanced, investigation.

This study sought to investigate the psychological network structure of adult Spanish heritage language (HL) learners’ motivational profile by considering interconnections among the following variables: the possible HL selves, family influence, intended HL learning effort, HL achievement goal orientations, HL enjoyment, HL anxiety, perceived classroom environment, and critical language awareness. In line with a complex systems perspective, mutually interdependent connections among variables were estimated using psychological network modeling. The analysis revealed a majority of positive associations among the system constituents, with nodes representing the possible HL selves, HL enjoyment, and intended HL learning effort holding the most central influence on the network. Results also shed light on the unexplored relevance of critical language awareness in understanding HL learners’ motivational and emotional dispositions. We discuss the theoretical, pedagogical, and methodological implications of the study, highlighting the potential of network analysis for providing insights into complex psychological phenomena.

This study tested whether individual sensitivity to an auditory perceptual cue called amplitude rise time (ART) facilitates novel word learning. Forty adult native speakers of Polish performed a perceptual task testing their sensitivity to ART, learned associations between nonwords and pictures of common objects, and were subsequently tested on their knowledge with a picture recognition (PR) task. In the PR task participants heard each nonword, followed either by a congruent or incongruent picture, and had to assess if the picture matched the nonword. Word learning efficiency was measured by accuracy and reaction time on the PR task and modulation of the N300 ERP. As predicted, participants with greater sensitivity to ART showed better performance in PR suggesting that auditory sensitivity indeed facilitates learning of novel words. Contrary to expectations, the N300 was not modulated by sensitivity to ART suggesting that the behavioral and ERP measures reflect different underlying processes.

This study explored the impact of contextualized practice on second language (L2) learners’ production of wh-questions in the L2 classroom. It examined the quality of practice (correct vs. incorrect production) and the contribution of declarative knowledge to proceduralization. Thirty-four university-level English as a foreign language learners first completed a declarative knowledge test. Then, they engaged in various communicative activities over five weeks. Their production of wh-questions was coded for accuracy (absence of errors) and fluency (speech rate, mean length of pauses, and repair phenomena). Improvement was measured as the difference between the first and last practice sessions. The results showed that accuracy, speech rate, and pauses improved but with distinct patterns. Regression models showed that declarative knowledge did not predict accuracy or fluency; however, declarative knowledge assisted the learners to engage in targetlike behaviors at the initial stage of proceduralization. Furthermore, whereas production of accurate wh-questions predicted accuracy improvement, it had no impact on fluency.

Although retrieval of lexical forms is a prerequisite for language production, research of L2 vocabulary learning has focused much more on meanings and form-meaning mappings than on development of detailed, accessible mental representations of forms. This is particularly true with respect to multi-word items (MWIs). We report an experimental study involving a variety of intra-lexical, usage-based, and interlingual co-determinants of L2 vocabulary learnability pertaining to MWIs. Each learner (N = 60) encountered a randomly allocated set of 26 two-word MWIs (Nsets = 4) semi-randomly drawn from a larger pool of MWIs. Learners were asked to remember either the 13 MWIs showing the form variable assonance (e.g., change shape) or the 13 nonassonant control MWIs (e.g., sound good). Posttests of form recall revealed a large, durable effect of the focusing task in combination with forewarning of testing. Except when MWI concreteness (a semantic variable) was high, assonance had a positive effect on retrievability in recall tests given after delays of 15 minutes and one week. There was a consistent effect of the semi-semantic variable Mutual Information. Even in the context of a strong focus on forms, form variables are not the only variables that matter.

Despite extensive theoretical and empirical research, we do not have estimations of the magnitude of sensitivity to grammatical information during L2 online processing. This is largely due to reliance on null hypothesis significance testing (Plonsky, 2015). The current meta-analysis draws on data from one elicitation technique, self-paced reading, across 57 studies (N = 3,052), to estimate sensitivity to L2 morphosyntax and how far L1 background moderates this. Overall, we found a reliable sensitivity to L2 morphosyntax at advanced proficiencies (d = .20, 95% CIs .15, .25), with some evidence that this was reliably lower than for native speakers (NSs). These patterns were not generally moderated by linguistic feature or sentence region. However, effects for anomaly detection were larger among NSs than L2 learners and the effects among L2 learners appeared to show a trend toward L1 influence. Finding smaller effects than in other subdomains, we provide an initial framework of reference for L2 reading time effect sizes.

This study investigates whether (a) Cantonese and (b) English listeners integrally or independently perceive Thai tone and segmental information. Listeners completed a modified AX discrimination task that contained a control block (without segmental variation) and an orthogonal block (with segmental variation). Relative to their own performance in the control block, the Cantonese listeners showed increased response time, decreased proportion of accuracy, and decreased sensitivity index in the orthogonal block. By contrast, the English listeners showed similar response time, proportion of accuracy, and sensitivity index across the two blocks. These reflect integral processing among the Cantonese but not the English listeners. This finding motivates the dimensional transfer hypothesis. The hypothesis posits that L1 perceptual experience shapes the perceptual integrality (or nonintegrality) of foreign suprasegmental and segmental information.

This study presents a conceptual replication of Birulés et al.’s (2020, Experiment 2) investigation of native and nonnative listeners’ selective attention to a talker’s mouth with the goal of better understanding the potentially modulating role of proficiency in listeners’ reliance on audiovisual speech cues. Listeners’ eye gaze was recorded while watching two short videos. Findings from one of the videos replicated results from the original study, showing greater attention to the talker’s mouth among L2 than L1 listeners. In both videos, L2 proficiency modulated attention, with more fixations on the mouth among lower proficiency listeners, an effect predicted but not observed in the original study. Collectively, these laboratory-based findings highlight the role of visual speech cues in L2 listening and present evidence that listeners with more limited proficiency may be especially reliant on such cues. These observations warrant future investigations of the benefits of visual speech cues in instructional and assessment contexts.

Our study proposes the use of a free classification task for investigating the dimensions used by listeners in their perception of nonnative sounds and for predicting the perceptual discriminability of nonnative contrasts. In a free classification task, participants freely group auditory stimuli based on their perceived similarity. The results can be used to predict discriminability and can be compared to various acoustic or phonological dimensions to determine the relevant cues for listeners. The viability of this method was examined for both a segmental contrast (German vowels) and a nonsegmental contrast (Finnish phonemic length). Perceptual similarity data from the free classification task accurately predicted discriminability in an oddity task and separately provided rich information on how the perceptual space is shaped. These results suggest that a free classification task and related analyses are informative and replicable methods for examining nonnative speech perception.

The present study tests the Shallow Structure Hypothesis (SSH), which claims that compared to L1 processing, L2 language processing generally underuses grammatical information, prioritizing nongrammatical information. Specifically, this cross-modal priming study tests SSH at the level of morphology, investigating whether late advanced L2 learners construct hierarchically structured representations for trimorphemic derived words during real-time processing as native speakers do. Our results support SSH. In lexical decision on English trimorphemic words (e.g., unkindness or [[un-[kind]]-ness]), L1 recognition of the targets was facilitated by their bimorphemic morphological-structural constituent primes (e.g., unkind), but not by their bimorphemic nonconstituent primes (e.g., kindness), which were only semantically and formally related to the target. In contrast, L2 recognition was equally facilitated by both constituent and nonconstituent primes. These results suggest that unlike L1 processing, L2 processing of multimorphemic words is not mainly guided by detailed morphological structure, overrelying on nonstructural information.

The multidimensional conceptualization of vocabulary knowledge has been extraordinarily influential in lexical research. Yet, the few studies that have empirically explored the structure of word knowledge conflict regarding its multidimensionality. The present study examines the nature of L2 vocabulary knowledge by exploring how the hypothesized word-knowledge dimensions fit together across different L2 learner groups. A total of 314 EFL learners from two dissimilar L1 backgrounds (Chinese n = 170; Spanish n = 144) were assessed using eight vocabulary measures testing recognition and recall knowledge of form-meaning, collocations, multiple meanings, and derivatives. Confirmatory factor analysis (CFA) revealed that vocabulary knowledge behaves as a unidimensional construct for each learner group individually. Simultaneous multigroup CFA confirmed that this unidimensional model holds invariant across the two groups regardless of their distinct L1s. These findings provide empirical evidence for the unidimensionality of vocabulary knowledge in a second language, indicating the need to refine the conceptualization of the construct.

This study utilizes social network analysis to characterize a typology of study abroad sojourner experience, detailing the relationship of social experience types to second language (L2) proficiency growth and study abroad program design. In contrast with previous research, the study performs a quantitative analysis of structural and compositional network features to identify a typology of social networks. Participants were 30 L2 Spanish learners from five US-based semester-long university study abroad programs in Spain. Social network data were collected using a social network questionnaire, while L2 development was measured through an elicited imitation task. Results identify four prominent social network patterns, characterized by varying levels of Spanish language use, emotional proximity to contacts, frequency of interaction, contact status as program peer or host community member, and network cohesion. L2 proficiency development was significantly affected by these patterns, which were shaped by the contrasting curricular models of study abroad programs.

Twenty years ago, a state-of-the-art review in SSLA marked the coming of age of the study of temporality in second language acquisition. This was followed by three monographs on tense and aspect the next year. This article presents a state-of-the-scholarship review of the last 20 years of research addressing the aspect hypothesis (AH) (Andersen, 1991, 2002; Andersen & Shirai, 1994, 1996), the most tested hypothesis in L2 temporality research. The first section of the article gives an overview of the AH and examines its central tenets, and then explores the results of empirical studies that test the hypothesis. The second section considers studies that have investigated four crucial variables in the acquisition of temporality and the testing of the AH. The third section discusses theoretically motivated areas of future research within the framework of the hypothesis.

This study is the first to investigate subject-level variability in sociolinguistic evaluative judgements by 30 adult L2 German learners and explore whether the observed variability is characterizable as a function of individual differences in proficiency, exposure, and motivation. Because group-level estimates did not paint an accurate picture of the individual, we propose methods capable of integrating population-level estimates with person- and ensemble-centered approaches so as to reconcile generalizability and individuality. Using random effects from Bayesian mixed-effects models, we found that global subject-level variability in evaluative judgements was not predicted by individual differences. By building homogeneous ensembles (i.e., subgroups of individuals with similar evaluative judgements), however, it was possible to assess whether ensembles were characteristic of certain levels of individual differences. This ensemble-centered approach presents an innovative way to address the group-to-individual generalizability issue in cross-sectional data and transcend individual variability in order to make tentative generalizations of individual cases to wider populations.

This article proposes a conceptual and measurement framework for postpubertal, L2 speech learning aptitude that is centered around domain-general auditory processing (i.e., representing spectral and temporal characteristics of sounds). To this end, we examine the construct and reliability of a battery of auditory processing tests by presenting the results of an empirical study wherein 100 participants took the tests twice. The findings showed (a) that the tasks tapped into multiple dimensions of auditory processing ability (e.g., perceptual acuity, audio-motor integration); and (b) that test-retest reliability ranged from “fair” to “excellent” (ICC (2,2) = .4–.8). Last, we introduce an offline version of the tests (deposited at L2 Speech Tools for Researchers & Teachers; http://sla-speech-tools.com/), provide a brief user manual, and invite researchers to use these tests to examine the role of auditory processing in various aspects of L2 speech learning (naturalistic vs. classroom, perception- vs. production-based practice).