3 results
82 Single Errors on Trial 1 of the Test of Memory Malingering may be Indicative of Invalid Performance on Neuropsychological Measures in a Sample of Youth Athletes
- Daniel Baldini, Talamahe’a A. Tupou, Julius Flowers, Ashlynn Steinbaugh, Bradley R. Forbes, Michael Ellis-Stockley, Rachel Murley, Rayna B. Hirst
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 755-756
-
- Article
-
- You have access Access
- Export citation
-
Objective:
The Test of Memory Malingering (TOMM) is a performance validity test (PVT) that aims to assess whether participants are giving adequate effort to perform well on tasks of memory performance (Tombaugh, 1996). Other PVTs, specifically the Forced Choice Recognition Trial in the California Verbal Learning Test, have shown that even single errors may indicate invalid performance (Erdodi et al., 2018). Finally, youth are often understudied in the PVT literature, and athletes are at increased risk of invalid performance on baseline testing due to many wanting to return to play following concussion (Erdal, 2012). Therefore, the objective of the current study is to examine whether single errors on TOMM Trial 1 are indicative of lower, and possibly invalid, cognitive performance in a youth sample, given that cognitive performance declines with even small decreases in effort (Green, 2007).
Participants and Methods:Healthy youth athletes (n=174) aged 8-16 years (M=12.07) completed the TOMM as well as other neuropsychological measures during baseline neuropsychological evaluation in a clinical research program for sports concussion. Independent samples t-tests compared youth athletes who scored 49 points on the TOMM (n=28) to youth athletes who scored a perfect 50 (n=50) across several groupings of neuropsychological measures. Participants who scored less than 49 or who didn’t complete the TOMM were excluded from the analyses.
Results:Participants scoring 50/50 on TOMM Trial 1 scored significantly higher on Stroop Color Naming task (p=0.036), Verbal Learning Delayed task from the second edition of the Wide Range Assessment of Learning and Memory (WRAML-2, p=0.018), and Letter Number Sequencing task from the Weschler Intelligence Scale for Children (WISC-IV, p=0.025), relative to participants scoring 49/50. Though not statistically significant, results also showed a trend toward participants scoring 50/50 scoring higher on nearly every test in the battery.
Conclusions:Participants with a single error on TOMM Trial 1, as compared to participants with a perfect score, performed significantly worse on a processing speed task, a verbal learning task, and a working memory task as part of a comprehensive neuropsychological battery. The single-error group also trended toward scoring lower on nearly all of the remaining attention, processing speed, perceptual ability, memory, and executive functioning tasks in the battery. The results could lead to a more liberal interpretation of TOMM scores, given that the trend towards lower performance may be due to putting forth significantly less effort. These results point to the need for a similar comparison of the TOMM in a larger sample size, as greater power may reveal even more significant differences in performance. Findings also emphasize the importance of viewing performance validity on a continuum rather than as a dichotomous pass/fail. Understanding the TOMM and how single errors may be indicative of poorer performance in a youth sample could help to reframe the way PVT results are interpreted in clinical and forensic settings.
79 The Clinical Utility of Reliable Digit Span in Predicting Effort on the TOMM in Youth with a History of a Concussion
- Ashlynn Steinbaugh, Rachel Murley, Bradley R Forbes, Daniel Baldini, Talamahe’a A Tupou, Julius Flowers, Rayna B Hirst
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 753-754
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Performance validity testing (PVT) is important in neuropsychological evaluations to ensure accurate interpretation of performance. While research shows children pass PVTs with adult cut-offs, PVTs are more commonly used with adults (Lippa, 2018). The Test of Memory Malingering (TOMM), a standalone PVT, is commonly used with adults and children (DeRight & Carone, 2015). The Reliable Digit Span (RDS), an embedded PVT derived from the Digit Span subtest of the Wechsler Intelligence Scales (Wechsler Intelligence Scale for Children-4th Edition, WISC-IV; Wechsler, 2003), is less commonly used with children (DeRight & Carone, 2015). RDS cut-off scores are associated with an increased rate of false positives in children, indicating mixed results regarding the clinical utility in pediatric populations (Welsh et al., 2012). Research shows that youth with a history of concussion (HOC) may demonstrate suboptimal effort for many reasons (e.g., external incentives, boredom, pressure), thus highlighting the need to investigate the utility of PVTs in this population (Araujo et al., 2014; DeRight & Carone, 2015). The present study aimed to examine the clinical utility of RDS in detecting poor effort on the TOMM in youth athletes with a HOC.
Participants and Methods:Participants included 174 youth athletes aged 8 to 18 (20.1% female; 42.5% people of color (POC)) who completed a baseline neuropsychological battery that included the TOMM and WISC-IV Digit Span. Of the sample, 29 youth athletes reported a HOC (13.8% female; 37.9 POC). RDS was calculated for each Digit Span administration, and sensitivity (SN) and specificity (SP) were calculated for RDS when invalid performance was operationalized by a more stringent cut-off score of <49 to increase the SN of the TOMM Trial 1 (Stenclik et al., 2013). Receiver operator characteristics (ROC) curve analysis determined whether RDS performance accurately predicted participants’ performance on the TOMM.
Results:The ROC curve analysis resulted in an area under the curve (AUC) of just 0.427 for RDS. A cut-off score of <7 (as suggested by Kirkwood et al. (2011)) for RDS results in 100% SN, 8.3% SP, 5% positive predictive validity (PPV), and 95% negative predictive validity (NPV). However, a cut-off score of <9 for RDS results in 75% SN, 15% SP, 25% PPV, and 75% NPV.
Conclusions:Little research shows the utility of different PVTs predicting children’s performance on other PVTs, despite evidence that children with a HOC are vulnerable to variable or insufficient effort (Araujo et al., 2014; DeRight & Carone, 2015). In a sample of 29 youth athletes with a HOC, RDS predicted TOMM performance at rates worse than chance. While RDS has advantages as an embedded PVT, its limited ability to predict performance on a standalone PVT suggests interpreting with great caution. These findings highlight the importance of implementing multiple PVTs throughout testing to ensure accurate findings and interpretations, particularly in youth with a HOC. The small sample size is a limitation that possibly impacted the ability of RDS to predict TOMM performance. Further research is needed to understand the utility of RDS as a predictor of PVT performance in different populations. Replication of these findings with a larger sample size is needed to provide confirmatory evidence of poor predictive performance of the RDS.
87 The Cumulative and Unique Effect of Competitive Youth Participation in the United States’ Most Popular Sports on Executive Function
- Michael Ellis-Stockley, Daniel Baldini, Talamahe’a A Tupou, Bradley Forbes, Jakob Hopper, Aubrey Deneen, Rayna Hirst
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 287-288
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Engagement in sporting activities has shown improvement in executive function among youth (Contreras-Osorio et al., 2021). Additionally, participation in specific sports such as soccer has been shown to enhance executive function in youth athletes compared to same-aged non-athletes (Yongtawee et al., 2021). The present study aimed to examine the effects of competitive participation in the United States’ four most popular sports on executive function among youth athletes. The most popular sports, as defined by viewership, revenue, and youth participation in the U.S. are American football, basketball, baseball, and soccer (Injai, 2022; Aspen Institute, 2020).
Participants and Methods:Data from the following three executive functioning subtests were analyzed in a sample of youth athletes (n=76), aged 8-18 years (mean age=11.94): Delis-Kaplan Executive Function System Trail Making Letter-Number Sequencing (cognitive flexibility), Wechsler Intelligence Scale for Children Fourth Edition Working Memory Index, and Golden Stroop Color-Word Inhibition. Participants completed these measures as part of a larger neuropsychological baseline assessment. Multivariate General Linear Model (GLM) regression was used to examine the influence of total cumulative years playing in one or more of the four most popular sports on executive functioning. A multivariate GLM regression also investigated the unique contributions of total years playing soccer (n=40; mean age=12.40) and total years playing American football (n=32; mean age=12.03) on subtest performance. The unique contributions of basketball (n=14) and baseball (n=21) were not analyzed due to small sample size.
Results:Total cumulative years playing > one of the four most popular sports significantly predicted cognitive flexibility (p=.007) and working memory (p=.002), but not inhibition (p=0.639). Total years playing soccer also significantly predicted cognitive flexibility (p=.029) and working memory (p=0.05), but not inhibition (p=.310). Total years playing American football did not significantly predict performance on tasks requiring cognitive flexibility (p=.186), working memory (p=0.150), or inhibition (p=0.277).
Conclusions:In congruence with previous research, sports participation predicted enhanced cognitive flexibility and working memory on certain executive tasks. Among youth athletes, prolonged competitive participation in one or more of the four most popular sports in the U.S. predicted better performance on measures of cognitive flexibility and working memory. Furthermore, protracted participation in soccer predicted enhanced performance on measures of cognitive flexibility and working memory, whereas extended participation in American football did not. Future research should examine this effect in larger samples within all four sports. Examining the cumulative length of competitive participation in these popular sports on executive function could present a favorable developmental outcome of youth participation if competitive participation is sustained. Additionally, the present data on executive function performance between lasting soccer participation and lasting American football participation suggests that executive function development and performance may be influenced by the sport played. The direction of this possible influence is unclear. More research is needed to establish this observed difference, and to better understand its existence and directionality.