32 results
Development of robust normative data for the neuropsychological assessment of Greek older adults
- Xanthi Arampatzi, Eleni S. Margioti, Lambros Messinis, Mary Yannakoulia, Georgios Hadjigeorgiou, Efthimios Dardiotis, Paraskevi Sakka, Nikolaos Scarmeas, Mary H. Kosmidis
-
- Journal:
- Journal of the International Neuropsychological Society , First View
- Published online by Cambridge University Press:
- 29 January 2024, pp. 1-9
-
- Article
-
- You have access Access
- Open access
- HTML
- Export citation
-
Objective:
Normative data for older adults may be tainted by inadvertent inclusion of undiagnosed individuals at the very early stage of a neurodegenerative process. To avoid this pitfall, we developed norms for a cohort of older adults without MCI/dementia at 3-year follow-up.
Methods:A randomly selected sample of 1041 community-dwelling individuals (age ≥ 65) received a full neurological and neuropsychological examination on two occasions [mean interval = 3.1 (SD = 0.9) years].
Results:Of these, 492 participants (Group 1; 65–87 years old) were without dementia on both evaluations (CDR=0 and MMSE ≥ 26); their baseline data were used for norms development. Group 2 (n = 202) met the aforementioned criteria only at baseline, but not at follow-up. Multiple linear regressions included demographic predictors for regression-based normative formulae and raw test scores as dependent variables for each test variable separately. Standardized scaled scores and stratified discrete norms were also calculated. Group 2 performed worse than Group 1 on most tests (p-values < .001–.021). Education was associated with all test scores, age with most, and sex effects were consistent with the literature.
Conclusions:We provide a model for developing sound normative data for widely used neuropsychological tests among older adults, untainted by potential early, undiagnosed cognitive impairment, reporting regression-based, scaled, and discrete norms for use in clinical settings to identify cognitive decline in older adults. Additionally, our co-norming of a variety of tests may enable intra-individual comparisons for diagnostic purposes. The present work addresses the challenge of developing robust normative data for neuropsychological tests in older adults.
3 Mobile Toolbox: Enrollment of a Large Normative Sample Using the UCSF Brain Health Registry
- Rachel L Nosheny, Monica R Camacho, Bernard Landavazo, Aaron J Kaat, Zahra Hosseinian, Richard C Gershon, Michael W Weiner
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 781-782
-
- Article
-
- You have access Access
- Export citation
-
Objective:
A critical need in the neuropsychology field is development and validation of efficient, scalable assessments of cognition. The Mobile Toolbox (MTB), a novel suite of mobile device-compatible, app-based cognitive assessments, was developed to address this need. The goals of this study were (1) To collect longitudinal normative data for the MTB assessments in a large, ethnoculturally and educationally diverse cohort; (2) To assess the feasibility and usability of remote assessment using MTB.
Participants and Methods:Participants were recruited from the UCSF Brain Health Registry (BHR), an online cohort (N>100,000) that collects longitudinal cognitive, functional, behavioral, and health data using online neuropsychological tests and self- and study-partner report surveys. BHR participants who opted to learning about additional research opportunities were sent automated email invitations to enroll in the MTB study. Those who indicated study interest were provided instructions within the BHR online portal for downloading the MTB app. All participants had the opportunity to complete a single baseline administration of MTB (Word Meaning, Sequences, Spelling, Arranging Pictures, Arrow Matching, Faces and Names, Shape-Color Sorting, Number Match). Those who completed the baseline assessment within three days were invited to continue into the longitudinal study, where they complete MTB assessments at a single, short-term timepoint (day 7, 14, or 21; study arms sequentially assigned), and then at 6-month intervals. Enrollment across demographic groups was monitored, and study invitations were sent to specific demographic groups, with the goal of enrolling a sample of 800 participants in the longitudinal study: equal distribution across eight, 10-year age bands (ages 18-80+); 60% with <16 years of education; 10% non-Latinx Black, 15% Latinx, and 5% non-White other ethnocultural identity.
Results:Between January-June 2022, 48,110 BHR participants were invited to the MTB study. Of those, 8294 (17%) expressed interest, 3401 (7%) completed the baseline assessment, 850 (1.8%) were assigned to the longitudinal study, and 782 (1.6%) completed a short-term longitudinal assessment. Study staff received 797 help tickets submitted by participants asking for email support to complete MTB. The baseline cohort had and average age of 64 years and an average of 16.6 years of education, 76.2% female, 2.1% non-Latinx Black, 7.1% Latinx, 86.8% non-Latinx White, and 4% from other ethnocultural groups. The longitudinal cohort had an average age of 62.3 years and an average of 16.1 years of education, 80% female, 2.8% non-Latinx Black, 8.5% Latinx, 83.5% non-Latinx White; and 5% other ethnocultural group. Compared to those invited to the study, those who enrolled in the longitudinal study were older, had higher educational attainment, and were more likely to be female and self-identify as non-Latinx White (p<0.05 for all).
Conclusions:Efficient enrollment and task completion of a large cohort in a novel, app-based mobile cognitive assessment is feasible in a completely remote setting. Most participants were able to complete MTB without individual support, indicating good usability. This approach can be scaled up to efficiently assess cognition in many research and healthcare settings. A remaining challenge is achieving robust ethnocultural and educational diversity.
6 A review of neuropsychological measures of executive functioning in the Japanese and Japanese-American population
- Aya Haneda, Erin T Kaseda, Hirofumi Kuroda
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 421-422
-
- Article
-
- You have access Access
- Export citation
-
Objective:
There are approximately 1.5 million Japanese and Japanese Americans in the United States, with the Japanese population increasing steadily over the past two decades. Given the growing number of the Japanese population, it is likely that a clinical neuropsychologist may encounter a Japanese patient, particularly for neurocognitive disorder evaluations given the aging population. Literature has reported that cross-cultural bias in neuropsychological testing and cultural factors affect individuals’ test performance. In order to conduct and interpret neuropsychological assessments for this population, it is important to use normative data and consider the impact of various factors such as acculturation, language, and generation in the U.S. Availability of normative cognitive test data for Japanese-Americans is limited. Tests with most extensive use, adaptation, validation, and norming were identified. Many clinically used measures of executive functioning (EF) have been translated into Japanese and studied in multiple clinical populations. We present information on tests in this domain given their appropriateness for use in cross-linguistic and cross-cultural evaluations.
Participants and Methods:Available studies of neuropsychological tests measuring EF that have been translated and normed in the Japanese and/or Japanese-American patient population are reported. Review of the literature was conducted by authors of Japanese descent familiar with neuropsychological assessment and Japanese and Japanese-American culture. We prioritized studies published in both English and Japanese and those that included commonly utilized tests in the U.S, allowing for maximum accessibility and utility for Western-based neuropsychologists. Additionally, inclusion priority was given to studies published in English which report the clinical diagnoses, age range, and gender characteristics of the sample population. The Wisconsin card sorting test (WCST) and Trail Making Test (TMT) were reviewed.
Results:The WCST and the TMT, with its variant, was the most normed EF cognitive test currently available. The Keio version Japanese-Trail Making Test (J-TMT) and a simplified version of the Trail Making Test (S-TMT) has been utilized in Japan, however norms are still lacking. Of the available studies, the S-TMT and J-TMT were found to be moderately correlated with the TMT. The Keio version WCST (KWCST) (Kao et al., 2012) was correlated to education level (Abe et al., 2004), appropriately differentiating severity of social anxiety disorder (Fujii et al., 2013), patients with schizophrenia (Banno et al., 2012), and cognitive impairment in Parkinson’s disease (Yoshii et al., 2019).
Conclusions:Information regarding translated and normed tests are presented to assist clinical neuropsychologists provide competent services to Japanese-Americans. The J-TMT and the S-TMT may be clinically useful as an evaluation of attention for the Japanese population. The KWCST has also been found to be an appropriate tool for this population. However, publicly available norms for these assessments are still sparse, and there is very limited information about administration of these tests by English-speaking neuropsychologists with the use of interpreters. Further work is needed to increase access to and awareness of linguistically and culturally appropriate versions of clinical measures to better serve the Japanese and Japanese-American population.
39 Neurocognitive Function in People Living with HIV from Tijuana: a Comparison Between Norms for Latin-American Population and Norms for US-Mexico Border Region
- María L García-Gomar, Agustín J Negrete-Cortés, Ana J Castro-Alameda, José R Chavez-Mendez
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 719-720
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Global neurocognitive impairment (NCI) has been reported in white people living with HIV/AIDS (PLWHA) in 40%. In Latino populations there have been variable rates described from 30 to 77%. This variation has to do with the lack of normative data for Latino population and the application of norms for English-speakers, increasing the probability of misidentification of NCI. Thus, recognizing which are the best norms available for the Mexican population is important for the accurate identification of NCI. The aim of the present study was to investigate the rate and pattern of HIV associated neurocognitive impairment (NCI) and to compare rates of NCI between rates calculated using norms for the Latin-American population (NLAP) and norms for the US-Mexico border region (NP-NUMBRS).
Participants and Methods:CIOMS international ethical guidelines for the participation of human subjects in health research were followed. 82 PLWHA living in Tijuana (Mexico) participated in the study (Age: Mean=39.6, SD=10.9; 28.3% Female; Years of education: Mean=8.5, SD=3.6). PLWHA were recruited from the board-and-care home “Las Memorias” (73.4% on antiretroviral therapy; Years since HIV diagnosis: Mean=9.9, SD=7.1). Participants completed a neuropsychological test battery sensitive to detect HIV associated NCI that assessed four cognitive domains (verbal fluency, speed of information processing, executive function and learning/memory). Raw scores in these tests were transformed to percentiles using LAPN and transformed to T-scores using NP-NUMBRS. T-scores were averaged across tests to compute domain specific and global impairment scores. NCI was defined as percentile scores <16 and T-scores < 40. McNemar’s tests were used to compare the rate of NCI utilizing NLAP vs NP-NUMBRS.
Results:According to NLAP, rates of global NCI were about 13.4%. Utilizing NP-NUMBRS rates of global NCI were about 34.1%. However, there is a positive and significant correlation between Global Neurocognitive Function score in PLWHA according to NLAP and NP-NUMBRS (r=0.66, p<.05). Rates of global NCI in PLWHA were significantly lower when using LAP norms (McNemar Chi-Square=29.89; p<.001). Regarding the pattern of NCI according both norms learning and memory was the most affected cognitive domain with 34% of impairment according to NLAP vs 51% of impairment according to NP-NUMBRs.
Conclusions:Utilizing NP-NUMBRS, rates of NCI are consistent with findings of prior studies. Employing norms for LAP the rates of NCI are lower that the ones reported in the literature. This is an important finding since PLWHA included in the sample have several vulnerable factors such as deportation, prostitution, drug abuse and discrimination for sexual preference, factor that could impact cognition. The pattern of neurocognitive function was also similar to those of prior studies in HIV. To accurately make NCI diagnosis it is important to use norms that consider specific characteristics of the population. The diagnosis of NCI is important since these deficits present a strong risk of concurrent problems in a wide range of health behaviors like medication non-adherence in PLWHA.
4 Norm Selection and Application in Socially Responsible Neuropsychological Practice
- Daniel Saldana, Lucia Cavanagh, Paola Suarez, Mariana Cherner
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, p. 872
-
- Article
-
- You have access Access
- Export citation
-
Objective:
In the wake of the national controversy over demographically corrected normative comparisons used in neuropsychological assessment, the field finds itself in need of adopting better practices and providing stronger instruction in norm selection and application when assessing underrepresented populations. Neuropsychologists must employ critical thinking within their clinical decision-making that takes into account patient demographics, analysis of the measures themselves, normative samples, and statistical adjustments employed in normative studies. Not doing so may result in erroneous diagnostic conclusions, exposing underserved patient populations to poor or harmful clinical care and even misdiagnosis. The following case series presents several demographic considerations illustrating how selection and application of different (at times, ill-fitting) normative reference groups can affect treatment outcomes in the Latinx community. We examined the performance of various published norms when applied to monolingual and bilingual Spanish speakers.
Participants and Methods:This study samples three demographically diverse (i.e., education, age, and sex) clinical cases and applies regression-based and stratified norms to raw scores to demonstrate the possible differential outcomes when using different reference groups. One example is Ms. Congeniality, a 69-year-old, Spanish and English bilingual woman with 12 years of education who presented for a third revaluation at our clinic due to progressive memory loss. Her prior Spanish language profiles demonstrated impaired confrontation naming and steadily decreasing letter fluency over the past 10 years.
Results:Her performance on semantic fluency (i.e., animal naming) showed relative stability based on her raw scores (10 in 2012, 11 in 2016, and 12 in 2022). Using the Neuropsi A&M norms, which stratify performance across nine age ranges between ages 6-85 and three education ranges between 0-10+ years, her performance over the past 10 years ranged between the less than 1st percentile to the 9th percentile (1%, 1%, and 9%, respectively). However, using the NP-NUMBRS norms, which use regression-based continuous age (19-60) and education (0-20) predictors of test performance, her scores corresponded to steadily improved performance (8%, 28%, and 86%). Thus, this qualitative comparison demonstrates a likely overcorrection for individuals of advanced age when using norms based on samples that are a poor fit because they lack representation of older adults, as in NP-NUMBRS, and a possible undercorrection when using norms with overly broad education stratifications (e.g., 10-22 years, as in Neuropsi).
Conclusions:Application of ill-fitting normative standards can have far-reaching implications for interpretation of neuropsychological test results. Moreover, this case series exemplifies the need for higher-order instruction in norm selection, specifically for underserved communities who run the risk of being misdiagnosed. Through case examples, this study underscores the importance of understanding the unique effects of different demographic corrections in the context of limited available normative reference groups. This abstract is the first illustration in a series of papers aimed at facilitating the decision-making process within the framework of socially responsible neuropsychological practice.
24 Demographic Adjustment Is Not Demographic Correction: A Simulation Study
- Jacob A Fiala
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 706-707
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Prior studies have presented demographic adjustment as beneficial because it helps equalize, across demographic groups, the percentage of participants (recruited from the general population without prior diagnosis) who fell beneath the test impairment cutoff (e.g., Smith, et al., 2008). This methodology ignores the possibility that group differences in those falling beneath an impairment cutoff could reflect cognitive impairment prevalence differences between demographic groups in the undiagnosed general population. Demographic group differences in cognitive test scores reflect a mixture of two categories of influences: measurement bias (item/test/examiner bias, language/cultural bias, stereotype threat, etc.) and factors which differentially increase the number of low scores in one group by increasing relative risk (RR) for cognitive impairment (biological aging processes, cognitive reserve, social determinants of health [SDoH], etc.). The current simulation study examined how the effect of demographic adjustment on the diagnostic accuracy of a hypothetical test (operationalized as the area under the curve [AUC] in an ROC analysis) varied as the mixture of influences which caused demographic differences in scores were varied.
Participants and Methods:215,040 samples were randomly generated. Each sample consisted of two demographic groups, with Group 0 always representing the lower scoring group. Across samples, Group 1's baseline risk of impairment and Group 0's relative risk were varied, and these determined the prevalence of cognitive impairment in the groups. Three facets of measurement bias were varied in the simulation: how much lower Group 0's average score was than Group 1's, the degree of non-homogeneity of variance between groups, and how much less reliable the measure was for Group 0. Additional parameters were included and varied to ensure the robustness of findings across a variety of situations. Samples reflected all possible combinations of all varied parameters. For each sample, a baseline AUC was calculated when impairment was regressed on the unadjusted test score. Then, test scores were adjusted for demographic group and difference in adjusted and unadjusted AUC was calculated. This adjusted/unadjusted AUC difference was then regressed on the simulation parameters to quantify their relative influence.
Results:The more Group 0's average score was reduced by measurement bias, the more improvement in AUC was seen after adjustment (ß = 1.76). Trivial but significant main effects of variance non-homogeneity (ß = .09), increased relative risk (ß = -.08), and reduced reliability (ß = .02) were also found, but more importantly, each of these predictors significantly interacted with Group 0 mean score reduction, such that higher relative risks (ß = -1.22), lower reliability (ß = .36), and higher variance (ß = -.15) in Group 0 compared to Group 1 each reduced the association between Group 0 mean score reduction and improvement in AUC.
Conclusions:Demographic adjustment only improves AUC when the mean reduction in scores due to measurement bias is sufficiently high while risk for impairment, test reliability and test score variances are sufficiently equivalent among the demographic groups. When this is not the case, demographic adjustment can be counter-productive, reducing the AUC of the test. We conclude by proposing a novel method for adjusting test scores.
1 Race, Ethnicity, Education, Sex and Gender Effects on Neuropsychological Test Scores: Limitations of Current Evidence and Impact on Clinical Trials and Clinical Practice
- Phoebe A Katims, Robert M Bilder, Kristen D Enriquez
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 599-600
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Interpretation of neuropsychological (NP) tests depends on the quality of the normative standards available for the tests. Co-norming across tests is necessary when interpreting differences between scores on different tests. The relevance of specific norms for an individual examinee further depends on multiple design features of the standardization studies, including: when the studies were conducted, sampling strategy, inclusion/exclusion criteria, age, sex/gender, education, race and ethnicity, socioeconomic status, and region. This paper examines the standardization studies of the most widely used NP tests, identifies their strengths and weaknesses, and makes recommendations for interpretive caveats based on these analyses.
Participants and Methods:We reviewed the standardization strategies and coded information about the sampling frames, inclusion/exclusion criteria, stratification methods, demographic characteristics, and sample sizes overall and within each stratum where relevant. These methods were applied to the WAIS-IV, WMS-IV, CVLT3, D-KEFS, Pearson Advanced Clinical Solutions (ACS), Rey Complex Figure Test, WCST, Symbol Digit Modalities Test, RBANS, BVMT-R, HVLT, Halstead-Reitan (“Heaton et al”) Norms for Boston Naming, Finger Tapping, Grooved Pegboard), MOANS, and MOAANS (Boston Naming, Trail Making Test, Judgement of Line Orientation). We calculated multiple indexes for each test, including standard errors and confidence intervals for scaled scores.
Results:Most tests used age only as a stratification factor, providing “age corrected” scores for selected age bands. The sample sizes for the age strata range from 1 to ∼200 but were usually less than 100 participants/stratum. Sex differences were rarely reported and some studies had markedly uneven distributions of sex. Education was not used as a stratification factor in any study, and few norms attempted corrections for education. The possible interactions of age and education on test scores are seldom reported and cell sizes for combinations of age and education may be too small to enable robust estimates of scores, especially at lower levels of education and older ages. The possible impact of race and ethnicity are rarely interrogated except in ACS, Heaton and MOAANS norms, which all focus on “African American” participants. Discrepancies in scores across ACS, Heaton and MOAANS suggest marked sampling differences.
Conclusions:Existing norms have major limitations which may impact the clinical assessment of individuals and result in inappropriate treatment recommendations as well as lead to inappropriate classification in clinical trials, which may include score “cutoffs” based on widely used normative standards. Most norms use only age as a stratification factor, despite robust impacts of education on scores. Race and ethnicity are poorly represented, fail to reflect current demographic characteristics of the United States, and existing norms present major conflicts for African American groups, with the same raw scores differing by a full standard deviation depending only on the source of normative data. Sex differences are examined infrequently and it remains unclear to what extent sex or gender differences may affect some scores. There is an urgent need for new, preferably “dynamic” normative standards, that include sampling by socially and demographically meaningful metrics, to provide greater precision in assessment of neuropsychological scores and score discrepancies, and for evaluating the inclusion/exclusion criteria, and criteria for efficacy in clinical trials that use neurocognitive endpoints.
52 Open Access, Normative Morphometric Software Indicate Neurodegeneration Associated with Episodic Memory Dysfunction in Amnestic MCI
- Stephanie Fountain-Zaragoza, Olivia Horn, Kathryn E. Thorn, A. Zarina Kraal, Andreana Benitez
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 461-462
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Neurodegeneration in Alzheimer’s disease (AD) is typically assessed through brain MRI, and proprietary software can provide normative quantification of regional atrophy. However, proprietary software can be cost-prohibitive for research settings. Thus, we used the freely available software NOrmative Morphometry Image Statistics (NOMIS) which generates normative z-scores of segmented T1-weighted images from FreeSurfer to determine if these scores replicate established patterns of neurodegeneration in the context of amnestic mild cognitive impairment (aMCI), and whether these measures correlate with episodic memory test performance.
Participants and Methods:Patients with aMCI (n = 25) and cognitively normal controls (CN; n = 74) completed brain MRI and two neuropsychological tests of episodic memory (the Rey Auditory Verbal Learning Test and the Wechsler Logical Memory Tests I & II), from which a single composite of normed scores was computed. A subset returned for follow-up (aMCI n = 11, CN n = 52) after ∼15 months and completed the same procedures. T1-weighted images were segmented using FreeSurfer v6.0 and the outputs were submitted to NOMIS to generate normative morphometric estimates for AD-relevant regions (i.e., hippocampus, parahippocampus, entorhinal cortex, amygdala) and control regions (i.e., cuneus, lingual gyrus, pericalcarine gyrus), controlling for age, sex, head size, scanner manufacturer, and field strength. Baseline data were used to test for differences in ROI volumes and memory between groups and to assess the within-group associations between ROI volumes and memory performance. We also evaluated changes in ROI volumes and memory over the follow-up interval by testing the main effects of time, group, and the group X time interactions. Lastly, we tested whether change in volume was associated with declines in memory.
Results:At baseline, the aMCI group performed 2 SD below the CN group on episodic memory and exhibited smaller volumes in all AD-relevant regions (volumes 0.4 - 1.2 SD below CN group, ps < .041). There were no group differences in control region volumes. Memory performance was associated with volumes of the AD-relevant regions in the aMCI group (average rho = .51) but not with control regions. ROI volumes were not associated with memory in the CN group. At follow-up, the aMCI group continued to perform 2 SD below the CN group on episodic memory tests; however, change of performance over time did not differ between groups. The aMCI group continued to exhibit smaller volumes in all AD-relevant regions than the CN group, with greater declines in hippocampal volume (17% annual decline vs. 8% annual decline) and entorhinal volume (54% annual decline vs. 5% annual decline). There was a trending Group X Time interaction such that decrease in hippocampal volume was marginally associated with decline in memory for the aMCI group but not the CN group.
Conclusions:Normative morphometric values generated from freely available software demonstrated expected patterns of group differences in AD-related volumes and associations with memory. Significant effects were localized to AD-relevant brain regions and only occurred in the aMCI group. These findings support the validity of these free tools as reliable and cost-effective alternatives to proprietary software.
32 A Comparison of Cut-Off Points for Invalid Cognitive Test Performance Established on Nonclinical Versus Clinical Samples for South African Educationally Disadvantaged Individuals
- Sharon Truter, Ann B Shuttleworth-Edwards
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 444-445
-
- Article
-
- You have access Access
- Export citation
-
Objective:
In South Africa, most of the cognitive tests employed for neuropsychological evaluation are those developed in educationally advantaged settings such as the US, but the normative data accompanying the tests are unsuitable for use with South African examinees who have a disadvantaged quality of education, and/or whose primary language is other than English. A recently completed collation of Africa-based normative data (Shuttleworth-Edwards & Truter, 2022) includes a chapter on Performance Validity Tests (PVTs) with proposed cut-off points to assist in the identification of noncredible performance. The aim of this study was to compare the cut-off points established using educationally disadvantaged South African nonclinical normative samples for which only specificity percentages are available, with those established using clinical samples with designated valid and invalid performers for which both specificity and sensitivity data are available. A further aim was to compare the Africa-based cut-off points with age-equivalent cut-off points where available for US-based data on the targeted tests.
Participants and Methods:The collation of Africa-based studies delineates cut-off scores for invalid test performance based on both nonclinical as well as clinical populations for three stand-alone PVTs especially developed to identify invalid performance including the Dot Counting Test (DCT), the Rey Fifteen Item Test (FIT), and the Test of Memory Malingering (TOMM); and three commonly employed cognitive tests for which there are embedded validity indicators including the Digit Span Age-Corrected Scaled Score (ACSS) and Reliable Digit Span (RDS), the Rey Auditory Verbal Learning Test (RAVLT), and the Trail Making Test A and B (TMT A and B). For studies using nonclinical norming data alone, specificity percentages to derive the cut-off points were set at a minimum of 90%. For studies using clinical samples specificity was set at a minimum of 90%, and the associated sensitivity percentages were reported indicating each test’s ability to correctly identify those with an invalid performance. The studies included participants stratified for both child and adult age groups (age 8 to 79 years) from South African educationally disadvantaged backgrounds. The data were tabled together for descriptive comparison purposes, including a column for the US-base cut-off points for equivalent age stages where available.
Results:There was a high level of compatibility between the proposed cut-off points established for the South African nonclinical normative samples compared with those using clinical samples of designated valid and invalid performers. There was a trend for more lenient cut-offs for younger children and older adults compared to older children and younger adults. Compared with US-based data where available, adjustments towards leniency were called-for on all indicators.
Conclusions:Cut-off scores for invalid cognitive test performance can be verified by perusing data derived from nonclinical norming samples as well as those from clinical samples, although the latter have the advantage of providing the sensitivity data to demonstrate the efficacy of a proposed cut-off score for identifying noncredible test performance. Adjustments towards leniency need to be made for cut-off scores for young children and older adults within an educationally disadvantaged population, and for disadvantaged adult populations compared with US-based educationally advantaged populations.
7 A Comparison of Performance of Educationally Disadvantaged Non-English-Speaking Participants on a Category Verbal Fluency Test using English or the First Language
- Sharon Truter, Ann B Shuttleworth-Edwards
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 91-92
-
- Article
-
- You have access Access
- Export citation
-
Objective:
South Africa has a multi-lingual population where fewer than 10% of the population speak English as a first language. This poses a challenge regarding language usage for a verbal fluency task. This study investigated the difference in number of words produced by independent groups of non-English examinees required to produce words in English, or in their first language, on a category verbal fluency task.
Participants and Methods:A study on South African non-English first language participants was conducted using the Category Verbal Fluency test (animals) for a sample of nonclinical adults (N = 264) aged 18-60 years with 8-12 years of disadvantaged (poorly resourced) quality of education. Participants either had an African indigenous first language, or Afrikaans (a Dutch derivative) as a first language. The data were derived from one group of either African indigenous or Afrikaans first language participants who were required to use English for word production (Group A English) (n = 159; African indigenous n = 135; Afrikaans n = 24) and another group of participants who were required to use their first language (Group B First Language) (n = 105; African indigenous n = 83; Afrikaans n = 22). The comparative data were stratified for age ranges 18-20, 21-30, 31-40, 41-50 and 51-60 years. Level of education was broadly equivalent across the comparative groups. T-test analyses compared the number of words produced between the English versus indigenous African groups, and English versus Afrikaans first language groups for each age category.
Results:The comparison for the indigenous African first language participants, revealed no significant differences in word production for words produced in English or first language regardless of age. In the comparison for the Afrikaans first language participants there was a highly consistent tendency for better word production in Afrikaans than in English. These results indicate that socio-cultural factors may be influential for English language proficiency on a verbal fluency task, rather than the effect of first language usage “per se”.
Conclusions:Since the dismantling of the Apartheid system in South Africa thirty years ago, English has become the main language used in government and business and is the preferred language of tuition in schools for those speaking English or an African indigenous language, whereas during the Apartheid era, two official languages were used for government, business, and schooling (Afrikaans and English). Currently, many Afrikaans speaking individuals continue to have Afrikaans as the preferred primary language of tuition in the schools and it persists as the preferred language for use in many Afrikaans dominated business arenas. This study attests to a high level of English fluency amongst those South Africans with an indigenous African first language, who clearly are as fluent in word production using English as they are when using their first language, in contrast to the indications for Afrikaans speaking individuals. Practitioners need to be alert to sociocultural factors that can impact on the optimal use of language in test situations, which may not necessarily be the first language.
38 Craft Story 21, Argentine Baremization of a Memory test and Design of a Recognition Instance.
- Maria Agostina Carello, Nicolas Corvalän, Greta Keller, Micaela Maria Arruabarrena, Cecilia Palermo, Carlos Alberto Martinez Canyazo, Ismael Luis Calandri, Ricardo Francisco Allegri, Lucia Crivelli
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 718-719
-
- Article
-
- You have access Access
- Export citation
-
Objective:
Craft Story 21 is a practical, comprehensive, and freely available tool to assess logical memory in patients with memory impairment. Currently, the test does not have normative values in Spanish that adjust to our specific population. Furthermore, the original test does not have a recognition phase to increase the specificity of the memory profile by allowing a distinction between different amnesic profiles. Therefore, this study has two main aims: 1) the generation of normative data for the Craft Story 21 memory test, adjusting to the characteristics of our Spanish-speaking country according to sex, age, and educational level; and 2) the design and validation of the recognition phase of the test and the assessment of its psychometric properties.
Participants and Methods:The baremization sample comprised 81 healthy participants aged 41 to 91, assessed through the Uniform Data Set III (UDS III) battery of the National Alzheimer’s Coordinating Center (NACC). The design of the recognition phase included three steps: (1) construction of the scale and review by experts, (2) pilot study, and (3) analysis of its psychometric properties. In the latter, 190 participants were recruited and classified into two groups matched by age, sex, and educational level: Mild Cognitive Impairment (MCI n=96) according to Petersen’s (1999) criteria and healthy controls (HC n=94). In addition, the diagnostic accuracy of the test was studied by the ROC curve method, its concurrent validity by correlation with other memory tests (RAVLT), and its internal consistency with Cronbach’s alpha test.
Results:The Baremization sample was divided into 16 groups: 4 age groups (41-51, 51-61, 6171 and >72 years), two educational levels (6-12 years and >12 years), and sex (male and female). Performance was significantly different between age groups (p < 0.003**). No significant differences were found in Craft Story 21 performance between education (p > 0.09) or sex (p > 0.56) groups within the same age group. Normative values in terms of means and standard deviations are presented for each group. Regarding the design of the recognition phase, the groups did not show significant differences in age (p= 0.13), sex (p= 0.88), or schooling (p= 0.33). The overall score of Craft Story 21 test showed the ability to discriminate between healthy controls from patients with MCI (sensitivity = 81.6% and specificity = 72.4%). Its diagnostic accuracy by phase (immediate AUC= 0.86; delayed AUC= 0.86 and recognition AUC= 0.75) was superior than Rey Auditory and Verbal Learning Test (RAVLT): immediate (AUC= 0.79), delayed (AUC= 0.82) and recognition (AUC= 0.74). It presented evidence of concurrent validity with RAVLT in its immediate (r=0.56, p<0.001), delayed (r= 0.66, p<0.001) and recognition (r= 0.37, p<0.001) trails. The instrument also presented evidence of reliability (a= 0.82).
Conclusions:The Craft Story 21 test is a practical, brief and multicultural scale. Thus having appropriate scales for the specific population to be assessed to a more accurate and precise description of the memory profile. Additionally, the new Recognition phase of the test showed evidence of validity and reliability for assessing memory processes.
Phonological fluency norms for Spanish middle-aged and older adults provided by the SCAND initiative (P, M, & R)
- M.L. Delgado-Losada, S. Rubio-Valdehita, R. López-Higes, M. Campos-Magdaleno, M. Ávila-Villanueva, B. Frades-Payo, C. Lojo-Seoane
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 30 / Issue 2 / February 2024
- Published online by Cambridge University Press:
- 19 July 2023, pp. 172-182
-
- Article
-
- You have access Access
- Open access
- HTML
- Export citation
-
Objective:
Verbal fluency tests are quick and easy to administer neuropsychological measures and are regularly used in neuropsychological assessment. Additionally, phonological fluency is a widely used paradigm that is sensitive to cognitive impairment. This paper offers normative data of phonological verbal fluency (letters P, M, R) for Spanish middle- and older-aged adults, considering sociodemographic factors, and different measures such as the total number of words, errors (perseveration and intrusions), and 15 sec-segmented scores.
Method:A total of 1165 cognitively unimpaired participants aged between 50 and 89 years old, participated in the study. Data for P were obtained for all participants. Letters M and R were also administered to a subsample of participants (852) aged 60 to 89 years. In addition, errors and words produced every 15 seconds were collected in the subsample. To verify the effect of sociodemographic variables, linear regression was used. Adjustments were calculated for variables that explained at least 5% of the variance (R2 ≥ .05).
Results:Means and standard deviations by age, scaled scores, and percentiles for all tests across different measures are shown. No determination coefficients equal to or greater than .05 were found for sex or age. The need to establish adjustments for the educational level was only found in some of the measures.
Conclusions:The current norms provide clinically useful data to evaluate Spanish-speaking natives from Spain aged from 50 to 89 years. Specific patterns of cognitive impairment can be analyzed using these normative data and may be important in neuropsychological assessment.
Normative Data for Adult Mandarin-Speaking Populations: A Systematic Review of Performance-Based Neuropsychological Instruments
- Wei (Gabriel) Qi, Xiaoning Sun, Yue Hong
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 28 / Issue 5 / May 2022
- Published online by Cambridge University Press:
- 10 August 2021, pp. 520-540
-
- Article
- Export citation
-
Objectives:
Normative data are essential for neuropsychological evaluations, but they are scarce for Mandarin-speaking populations, despite Mandarin being the language with the most native speakers. Several normative data studies have been reported in recent years for Mandarin speakers, who reside in different countries/regions (e.g., mainland China, Taiwan, and Singapore, etc.). This review aims to serve as a reference guide to appropriate norms when working with a Mandarin-speaking patient and to guide future endeavors in test validation and development in areas where studies to date fall short.
Method:We conducted a systematic review utilizing the PsycInfo, PubMed, and China Knowledge Resource Integrated databases as well as additional literature search through citations. We performed evaluations of the existing norms based on their test selection, cognitive domains covered, sample size, language, regions of participant recruitment, stratification by age/gender/education levels, and reporting of other psychometric properties. We focused on articles that included performance-based tests for adults but excluded those with purely clinical norms or from commercial publishers.
Results:We reviewed 1155 articles found through literature search and identified 43 articles reporting normative data for this population that met our inclusion criteria. Sixty-five distinctive tests and 127 versions were covered. The results are presented within two detailed tables organized by articles and tests, respectively.
Conclusions:We discussed the strengths and limitations of these normative reports. Practitioners are recommended to utilize normative data that most closely approximate a test-taker’s cultural and demographic backgrounds. Limitations of the current review are also discussed.
Normative Data for the ELSA-Brasil Neuropsychological Assessment and Operationalized Criterion for Cognitive Impairment for Middle-Aged and Older Adults
- Laiss Bertola, Isabela M. Benseñor, Alessandra C. Goulart, Andre R. Brunoni, Paulo Caramelli, Sandhi Maria Barreto, Luana Giatti, Larissa Salvador, Rosane Harter Griep, Arlinda B. Moreno, Paulo A. Lotufo, Claudia K. Suemoto
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 27 / Issue 3 / March 2021
- Published online by Cambridge University Press:
- 14 October 2020, pp. 293-303
-
- Article
- Export citation
-
Objectives:
Normative data should consider sociodemographic diversity for the accurate diagnosis of cognitive impairment. This study aims to provide normative data for a brief neuropsychological battery and present diagnostic criteria for cognitive impairment that could be used in primary care settings.
Methods:We selected 9618 Brazilian middle-aged and older adults after detailed exclusion criteria to avoid subtle cognitive impairment. We analyzed age, sex, and education influence on cognitive performance. To verify the evidence of criterion validity, we compared the cognitive performance of subjects with and without a depressive episode. Additionally, we verified the percentage of spurious scores under three different cutoffs.
Results:Age and education had the greatest impact on cognition. Normative scores were provided according to age and education groups. Participants with a depressive episode performed poorer than control subjects. The clinical cutoff of at least two scores below the 7th percentile revealed the adequate percentage of spurious and possible clinical performance.
Conclusions:The Longitudinal Study on Adult Health (ELSA-Brasil) provided normative data based on a unique selected set of cognitively normal subjects. Normative groups were selected based on age and education, and the battery was sensitive to the presence of a depressive episode. We suggested clinical cutoffs for the tests in this battery that could be used in primary care settings to improve the accurate diagnosis of cognitive impairment.
7c - Challenges but Optimism Regarding the Adoption of Trait Models of Personality Disorders: Author Rejoinder to Commentaries on the Five-Factor Model of Personality Disorders
- from Part II - Models
- Edited by Carl W. Lejuez, University of Kansas, Kim L. Gratz, University of Toledo, Ohio
-
- Book:
- The Cambridge Handbook of Personality Disorders
- Published online:
- 24 February 2020
- Print publication:
- 07 May 2020, pp 169-170
-
- Chapter
- Export citation
-
Summary
De Fruyt and De Clercq (this volume) and Sellbom (this volume) raise important issues surrounding the use of a five-factor model (FFM) of personality to conceptualize, assess, and diagnose personality disorder including how one includes a measure of impairment, the level of abstraction that is optimal (domains vs. facets), and the need for the development of formal test manuals, normative data, and means for identifying non-credible responding. In this response, the authors note their agreement with De Fruyt and De Clercq regarding the importance of assessing impairment but note that (a) it is already included to a large degree in the assessment of pathological FFM traits and (b) that they would prefer an approach that focuses explicitly on difficulties in occupational and social functioning. As to Sellbom’s comments suggesting that further work is necessary with regard to the development of test manuals, normative databases, and measures of valid responding – the authors agree and note some of the obstacles including the need for funding for the collection of normative data (and what consensus as to the kind – clinical only; community only; both) and development of test manuals. As to measures of credible responding, they note that many of these exist already for the family of FFM PD scales that they helped create and are aware of similar efforts for other popular measures of pathological traits.
Pathological Worry in Portugal: The Portuguese Version of the Penn State Worry Questionnaire (PSWQ)
- Antonia María Jiménez-Ros, José Carmona-Márquez, Luís Miguel Pascual
-
- Journal:
- The Spanish Journal of Psychology / Volume 22 / 2019
- Published online by Cambridge University Press:
- 26 December 2019, E63
-
- Article
- Export citation
-
Worry is a common phenomenon with people who anticipate and want to be prepared for future events. Pathological worry, however, is not limited to anticipating potentially dangerous events, but it is applied to small daily events, too. This kind of worry is perceived as uncontrollable, and it is strongly associated with catastrophism. The Penn State Worry Questionnaire (PSWQ) was developed to assess pathological worry. Despite its excellent psychometric characteristics, its internal structure is still controversial. The combination of regular and reversed items and certain methodological considerations may account for the discrepancies in the results of previous investigations. With the aim to analyze worry in Portugal and the psychometric properties of the PSWQ, for the present study, methodological options were considered in order to minimize previous problems. A sample of 558 Portuguese community participants took part in this study. Exploratory and Confirmatory Factor Analysis were performed with two independent random subsamples. The results showed the unidimensionality of PSWQ and the psychometric adequacy of both the full, 16-item version and a reduced, 11-item version (without reversed scored items). Normative data are presented, the suitability of both versions is discussed, and the authors conclude by encouraging the use of the reduced, 11-item version of the PSWQ in applied settings.
Predicting Progression to Parkinson’s Disease Dementia Using Multivariate Normative Comparisons
- J.A. Agelink van Rentergem, N.R. de Vent, H.M. Huizenga, J.M.J. Murre, ANDI consortium, B.A. Schmand
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 25 / Issue 7 / August 2019
- Published online by Cambridge University Press:
- 14 May 2019, pp. 678-687
-
- Article
- Export citation
-
Objective: Parkinson’s disease with mild cognitive impairment (PD-MCI) is a risk factor for progression to PD dementia (PDD) at a later stage of the disease. The consensus criteria of PD-MCI use a traditional test-by-test normative comparison. The aim of this study was to investigate whether a new multivariate statistical method provides a more sensitive tool for predicting dementia status at 3- and 5-year follow-ups. This method allows a formal evaluation of a patient’s profile of test scores given a large aggregated database with regression-based norms. Method: The cognitive test results of 123 newly diagnosed PD patients from a previously published longitudinal study were analyzed with three different methods. First, the PD-MCI criteria were applied in the traditional way. Second, the PD-MCI criteria were applied using the large aggregated normative database. Last, multivariate normative comparisons (MNCs) were made using the same aggregated normative database. The outcome variable was progression to dementia within 3 and 5 years. Results: The MNC was characterized by higher sensitivity and higher specificity in predicting progression to PDD at follow-up than the two PD-MCI criteria methods, although the difference in classification accuracy did not reach statistical significance. Conclusion: We conclude that MNCs could allow for a more accurate prediction of PDD than the traditional PD-MCI criteria, because there are encouraging trends in both increased sensitivity and increased specificity. (JINS, 2019, 25, 678–687)
Predictors of lexical retrieval in Hindi–English bilingual speakers
- Keerthi Ramanujan, Brendan S. Weekes
-
- Journal:
- Bilingualism: Language and Cognition / Volume 23 / Issue 2 / March 2020
- Published online by Cambridge University Press:
- 22 February 2019, pp. 265-273
-
- Article
- Export citation
-
When bilinguals name pictures while in ‘monolingual mode’, we expect that under conditions of language-constraint and no cognate facilitation, factors influencing lexical retrieval in monolinguals ought to exert similar effects on bilinguals. To this end, we carried out a L1-only naming task on early Hindi–English bilinguals. Results of linear mixed effects analysis reveal AoA, Familiarity, Image Agreement and Codability (availability of alternate names) to be the most significant predictors of lexical retrieval speed for early bilinguals, confirming our expectations. However, we report, for the first time, a by-subject variation in Codability for bilinguals. Implications of the results are discussed in the context of current theories of bilingual lexical access and competition. In preparation for this study, Hindi norms from bilinguals for items in the Snodgrass and Vanderwart set have been established, which will be of use for stimuli selection in experimental studies involving bilinguals.
Assessing Planning Ability Across the Adult Life Span in a Large Population-Representative Sample: Reliability Estimates and Normative Data for the Tower of London (TOL-F) Task
- Josef M. Unterrainer, Benjamin Rahm, Christoph P. Kaller, Philipp S. Wild, Thomas Münzel, Maria Blettner, Karl Lackner, Norbert Pfeiffer, Manfred E. Beutel
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 25 / Issue 5 / May 2019
- Published online by Cambridge University Press:
- 30 January 2019, pp. 520-529
-
- Article
-
- You have access Access
- Open access
- HTML
- Export citation
-
Objectives: The Tower of London (TOL) test has probably become the most often used task to assess planning ability in clinical and experimental settings. Since its implementation, efforts were made to provide a task version with adequate psychometric properties, but extensive normative data are not publicly available until now. The computerized TOL-Freiburg Version (TOL-F) was developed based on theory-grounded task analyses, and its psychometric adequacy has been repeatedly demonstrated in several studies but often with small and selective samples. Method: In the present study, we now report reliability estimates and normative data for the TOL-F stratified for age, sex, and education from a large population-representative sample collected in the Gutenberg Health Study in Mainz, Germany (n=7703; 40–80 years). Results: The present data confirm previously reported adequate indices of reliability (>.70) of the TOL-F. We also provide normative data for the TOL-F stratified for age (5-year intervals), sex, and education (low vs. high education). Conclusions: Together, its adequate reliability and the representative age-, sex-, and education-fair normative data render the computerized TOL-F a suitable diagnostic instrument to assess planning ability. (JINS, 2019, 25, 520–529)
Validation of the Rowland Universal Dementia Assessment Scale (RUDAS) in a multicultural sample across five Western European countries: diagnostic accuracy and normative data
- T. Rune Nielsen, Kurt Segers, Valérie Vanderaspoilden, Peter Bekkhus-Wetterberg, Guro Hanevold Bjørkløf, Ulrike Beinhoff, Lennart Minthon, Anna Pissiota, Magda Tsolaki, Mara Gkioka, Gunhild Waldemar
-
- Journal:
- International Psychogeriatrics / Volume 31 / Issue 2 / February 2019
- Published online by Cambridge University Press:
- 18 July 2018, pp. 287-296
-
- Article
- Export citation
-
Background:
With increasing cultural diversity and growing elderly immigrant populations in Western European countries, the availability of brief cognitive screening instruments adequate for assessment of dementia in people from diverse backgrounds becomes increasingly important. The aim of the present study was to investigate diagnostic accuracy of the Rowland Universal Dementia Assessment Scale (RUDAS) in a multicultural sample and to calculate normative data as a basis for demographic adjustment of RUDAS scores.
Methods:The study was a prospective international cross-sectional multi-center study. Receiver operating characteristic curve analysis was used to examine diagnostic accuracy. Regression analysis was used to assess the impact of demographic variables.
Results:Data was collected from 341 cognitively intact participants and 80 people with dementia with a wide age- and educational range. Of the 421 included participants, 239 (57%) had immigrant background. The RUDAS had high diagnostic accuracy with an area under the curve (AUC) of 0.93. The optimal cut-off score was <25 (sensitivity 0.80, specificity 0.90). Regression analysis revealed that RUDAS scores were mainly affected by education and were unrelated to data collection site and immigrant status. Education-adjusted normative data was calculated as a basis for education adjustment of RUDAS scores. Applying education-adjusted RUDAS scores slightly but significantly improved diagnostic accuracy with an AUC of 0.95.
Conclusion:We found the RUDAS to have excellent diagnostic properties in our multicultural sample. However, we suggest that RUDAS scores should be adjusted for education to increase diagnostic accuracy and that the choice of cut-off score should be considered based on the clinical context and expected base rate of dementia.