5 results
82 Single Errors on Trial 1 of the Test of Memory Malingering may be Indicative of Invalid Performance on Neuropsychological Measures in a Sample of Youth Athletes
- Daniel Baldini, Talamahe’a A. Tupou, Julius Flowers, Ashlynn Steinbaugh, Bradley R. Forbes, Michael Ellis-Stockley, Rachel Murley, Rayna B. Hirst
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 755-756
-
- Article
-
- You have access Access
- Export citation
-
Objective:
The Test of Memory Malingering (TOMM) is a performance validity test (PVT) that aims to assess whether participants are giving adequate effort to perform well on tasks of memory performance (Tombaugh, 1996). Other PVTs, specifically the Forced Choice Recognition Trial in the California Verbal Learning Test, have shown that even single errors may indicate invalid performance (Erdodi et al., 2018). Finally, youth are often understudied in the PVT literature, and athletes are at increased risk of invalid performance on baseline testing due to many wanting to return to play following concussion (Erdal, 2012). Therefore, the objective of the current study is to examine whether single errors on TOMM Trial 1 are indicative of lower, and possibly invalid, cognitive performance in a youth sample, given that cognitive performance declines with even small decreases in effort (Green, 2007).
Participants and Methods:Healthy youth athletes (n=174) aged 8-16 years (M=12.07) completed the TOMM as well as other neuropsychological measures during baseline neuropsychological evaluation in a clinical research program for sports concussion. Independent samples t-tests compared youth athletes who scored 49 points on the TOMM (n=28) to youth athletes who scored a perfect 50 (n=50) across several groupings of neuropsychological measures. Participants who scored less than 49 or who didn’t complete the TOMM were excluded from the analyses.
Results:Participants scoring 50/50 on TOMM Trial 1 scored significantly higher on Stroop Color Naming task (p=0.036), Verbal Learning Delayed task from the second edition of the Wide Range Assessment of Learning and Memory (WRAML-2, p=0.018), and Letter Number Sequencing task from the Weschler Intelligence Scale for Children (WISC-IV, p=0.025), relative to participants scoring 49/50. Though not statistically significant, results also showed a trend toward participants scoring 50/50 scoring higher on nearly every test in the battery.
Conclusions:Participants with a single error on TOMM Trial 1, as compared to participants with a perfect score, performed significantly worse on a processing speed task, a verbal learning task, and a working memory task as part of a comprehensive neuropsychological battery. The single-error group also trended toward scoring lower on nearly all of the remaining attention, processing speed, perceptual ability, memory, and executive functioning tasks in the battery. The results could lead to a more liberal interpretation of TOMM scores, given that the trend towards lower performance may be due to putting forth significantly less effort. These results point to the need for a similar comparison of the TOMM in a larger sample size, as greater power may reveal even more significant differences in performance. Findings also emphasize the importance of viewing performance validity on a continuum rather than as a dichotomous pass/fail. Understanding the TOMM and how single errors may be indicative of poorer performance in a youth sample could help to reframe the way PVT results are interpreted in clinical and forensic settings.
15 Construct Validity of the Stroop Interference task in Youth and the Contribution of Effort
- Julius H Flowers, Ashlynn Steinbaugh, Bradley Forbes, Tarah Talamahe’a, Lillian Vang, Daniel Baldini, Rayna Hirst
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 892-893
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Previous literature has studied the cognitive processes that contribute to performance on the Stroop interference condition in adults and found that the Stroop task performance (i.e., color-word interference) is comprised of multiple cognitive skills, including speed of visual search, working memory, and conflict monitoring (Perianez et al. 2020). However, the relationship of these cognitive processes to Stroop interference in youth remains understudied. Moreover, no studies have examined the contribution of effort measurement to the interference condition in healthy youth.
Participants and Methods:Golden Stroop Test interference performance was examined in healthy youth athletes (n=174) aged 8-16 years (mean age=12.07) who participated in a baseline neuropsychological evaluation as part of a clinical research program on sports concussion. Predictor variables included speed of visual search, working memory, processing speed, verbal fluency effort (i.e., validity tests), visuospatial abilities, visual processing, and executive functioning skills such as cognitive flexibility and reasoning.
Results:Speed of visual search as measured by Trail Making Test visual scanning time (p<0.00), and effort as measured by Reliable Digit Span and Trail Making Test ratio (p=0.03; p<0.00, respectively) significantly contributed to Stroop interference performance in healthy youth. We provided three validity measures; however, only those requiring higher-order cognitive processes predicted Stroop performance: Reliable Digit Span (p=0.03) and the Trail Making Test ratio (p<0.00). The standalone validity measure (TOMM) was not a significant predictor of Stroop performance (p>0.05).
Conclusions:In contrast to adults, working memory and processing speed did not significantly predict Stroop performance, while visual search speed did predict Stroop interference. Furthermore, two embedded validity indicator (EVI) measures predicted Stroop interference, in contrast to a standalone validity measure requiring lower cognitive processes, which did not predict Stroop performance. Therefore, EVI’s that include an executive functioning component may not accurately represent effort in youth, perhaps due to their less developed executive functioning relative to adults (Lezak et al., 2012; Shanmugan & Satterthwaite, 2017). Overall, understanding the cognitive processes contributing to Stroop performance in healthy youth will allow clinicians to better detect deficits in those cognitive processes and understand how they may impact Stroop performance. This would lead to a better understanding of executive functioning and the accurate measurement of effort in healthy youth.
79 The Clinical Utility of Reliable Digit Span in Predicting Effort on the TOMM in Youth with a History of a Concussion
- Ashlynn Steinbaugh, Rachel Murley, Bradley R Forbes, Daniel Baldini, Talamahe’a A Tupou, Julius Flowers, Rayna B Hirst
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 753-754
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Performance validity testing (PVT) is important in neuropsychological evaluations to ensure accurate interpretation of performance. While research shows children pass PVTs with adult cut-offs, PVTs are more commonly used with adults (Lippa, 2018). The Test of Memory Malingering (TOMM), a standalone PVT, is commonly used with adults and children (DeRight & Carone, 2015). The Reliable Digit Span (RDS), an embedded PVT derived from the Digit Span subtest of the Wechsler Intelligence Scales (Wechsler Intelligence Scale for Children-4th Edition, WISC-IV; Wechsler, 2003), is less commonly used with children (DeRight & Carone, 2015). RDS cut-off scores are associated with an increased rate of false positives in children, indicating mixed results regarding the clinical utility in pediatric populations (Welsh et al., 2012). Research shows that youth with a history of concussion (HOC) may demonstrate suboptimal effort for many reasons (e.g., external incentives, boredom, pressure), thus highlighting the need to investigate the utility of PVTs in this population (Araujo et al., 2014; DeRight & Carone, 2015). The present study aimed to examine the clinical utility of RDS in detecting poor effort on the TOMM in youth athletes with a HOC.
Participants and Methods:Participants included 174 youth athletes aged 8 to 18 (20.1% female; 42.5% people of color (POC)) who completed a baseline neuropsychological battery that included the TOMM and WISC-IV Digit Span. Of the sample, 29 youth athletes reported a HOC (13.8% female; 37.9 POC). RDS was calculated for each Digit Span administration, and sensitivity (SN) and specificity (SP) were calculated for RDS when invalid performance was operationalized by a more stringent cut-off score of <49 to increase the SN of the TOMM Trial 1 (Stenclik et al., 2013). Receiver operator characteristics (ROC) curve analysis determined whether RDS performance accurately predicted participants’ performance on the TOMM.
Results:The ROC curve analysis resulted in an area under the curve (AUC) of just 0.427 for RDS. A cut-off score of <7 (as suggested by Kirkwood et al. (2011)) for RDS results in 100% SN, 8.3% SP, 5% positive predictive validity (PPV), and 95% negative predictive validity (NPV). However, a cut-off score of <9 for RDS results in 75% SN, 15% SP, 25% PPV, and 75% NPV.
Conclusions:Little research shows the utility of different PVTs predicting children’s performance on other PVTs, despite evidence that children with a HOC are vulnerable to variable or insufficient effort (Araujo et al., 2014; DeRight & Carone, 2015). In a sample of 29 youth athletes with a HOC, RDS predicted TOMM performance at rates worse than chance. While RDS has advantages as an embedded PVT, its limited ability to predict performance on a standalone PVT suggests interpreting with great caution. These findings highlight the importance of implementing multiple PVTs throughout testing to ensure accurate findings and interpretations, particularly in youth with a HOC. The small sample size is a limitation that possibly impacted the ability of RDS to predict TOMM performance. Further research is needed to understand the utility of RDS as a predictor of PVT performance in different populations. Replication of these findings with a larger sample size is needed to provide confirmatory evidence of poor predictive performance of the RDS.
87 The Cumulative and Unique Effect of Competitive Youth Participation in the United States’ Most Popular Sports on Executive Function
- Michael Ellis-Stockley, Daniel Baldini, Talamahe’a A Tupou, Bradley Forbes, Jakob Hopper, Aubrey Deneen, Rayna Hirst
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 287-288
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Engagement in sporting activities has shown improvement in executive function among youth (Contreras-Osorio et al., 2021). Additionally, participation in specific sports such as soccer has been shown to enhance executive function in youth athletes compared to same-aged non-athletes (Yongtawee et al., 2021). The present study aimed to examine the effects of competitive participation in the United States’ four most popular sports on executive function among youth athletes. The most popular sports, as defined by viewership, revenue, and youth participation in the U.S. are American football, basketball, baseball, and soccer (Injai, 2022; Aspen Institute, 2020).
Participants and Methods:Data from the following three executive functioning subtests were analyzed in a sample of youth athletes (n=76), aged 8-18 years (mean age=11.94): Delis-Kaplan Executive Function System Trail Making Letter-Number Sequencing (cognitive flexibility), Wechsler Intelligence Scale for Children Fourth Edition Working Memory Index, and Golden Stroop Color-Word Inhibition. Participants completed these measures as part of a larger neuropsychological baseline assessment. Multivariate General Linear Model (GLM) regression was used to examine the influence of total cumulative years playing in one or more of the four most popular sports on executive functioning. A multivariate GLM regression also investigated the unique contributions of total years playing soccer (n=40; mean age=12.40) and total years playing American football (n=32; mean age=12.03) on subtest performance. The unique contributions of basketball (n=14) and baseball (n=21) were not analyzed due to small sample size.
Results:Total cumulative years playing > one of the four most popular sports significantly predicted cognitive flexibility (p=.007) and working memory (p=.002), but not inhibition (p=0.639). Total years playing soccer also significantly predicted cognitive flexibility (p=.029) and working memory (p=0.05), but not inhibition (p=.310). Total years playing American football did not significantly predict performance on tasks requiring cognitive flexibility (p=.186), working memory (p=0.150), or inhibition (p=0.277).
Conclusions:In congruence with previous research, sports participation predicted enhanced cognitive flexibility and working memory on certain executive tasks. Among youth athletes, prolonged competitive participation in one or more of the four most popular sports in the U.S. predicted better performance on measures of cognitive flexibility and working memory. Furthermore, protracted participation in soccer predicted enhanced performance on measures of cognitive flexibility and working memory, whereas extended participation in American football did not. Future research should examine this effect in larger samples within all four sports. Examining the cumulative length of competitive participation in these popular sports on executive function could present a favorable developmental outcome of youth participation if competitive participation is sustained. Additionally, the present data on executive function performance between lasting soccer participation and lasting American football participation suggests that executive function development and performance may be influenced by the sport played. The direction of this possible influence is unclear. More research is needed to establish this observed difference, and to better understand its existence and directionality.
Female Sex as a Protective Factor in the Effects of Chronic Cannabis Use on Verbal Learning and Memory
- Rayna Hirst, Dylan Vaughn, Sana Arastu, Aubrey Deneen, Haig Pilavjian
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 27 / Issue 6 / July 2021
- Published online by Cambridge University Press:
- 15 July 2021, pp. 581-591
-
- Article
- Export citation
-
Objective:
The variability of findings in studies examining the effects of chronic cannabis use on neuropsychological functioning highlights the importance of examining contributing factors. Few studies examine the role of sex in the relationship between cannabis and neuropsychological functioning, despite known neurobiological structural differences between males and females. This study examined whether males and females experience differential cognitive effects of chronic cannabis use.
Method:Chronic cannabis users (3+ days per week for >12 months, n = 110, 72% male) and non-users (n = 71, 39% male) completed a neuropsychological test battery. Two multivariate analyses of covariance (MANCOVAs) examined for sex differences in performance within users and non-users on neuropsychological tests, controlling for potential confounding variables. Bonferroni corrections were applied to adjust for multiple comparisons.
Results:Male and female cannabis users did not differ in cannabis use variables. Female cannabis users performed better than males on multiple subtests of the California Verbal Learning Test-II (CVLT-II), a verbal learning and memory test. Male cannabis users performed better than female users on Trial 1 of the CVLT-II (p = .002), and Trail Making Test B (p = .001), which measure attention and cognitive flexibility, respectively. Non-user males and females performed comparably, with the exception of Trail Making Test B (p = .001).
Conclusions:Results suggest that chronic cannabis use differentially impacts males and females, with females exhibiting better verbal learning and memory despite males demonstrating better attention and cognitive flexibility. Further research is needed to understand the potential protective mechanism of female sex on learning and memory effects of cannabis use.