7 results
1 The Mobile Toolbox for Monitoring Cognitive Change
- Richard Gershon, Cindy J. Nowinski, Aaron Kaat
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 779-780
-
- Article
-
- You have access Access
- Export citation
-
Objective:
To present the Mobile Toolbox (MTB), comprised of an expandable library of cognitive and other tests, including adapted versions of NIH Toolbox® measures. The MTB provides a complete research platform for app creation, study management, data collection, and data management. We will describe the MTB project and MTB research platform and demonstrate examples of assessments.
Participants and Methods:MTB is the product of an NIH-funded, multi-institutional effort involving Northwestern University, Sage Bionetworks, Penn State, University of California San Francisco, University of California San Diego, Emory University, and Washington University. The MTB assessment library is a dynamic repository built upon Sage Bionetworks mobile health platform. All MTB measures are created or adapted for a mobile interface using iOS and Android smartphones. Guided by the principles of open science, many components are open source to allow researchers and developers to integrate externally developed tests, including supplemental scales (e.g., passively collected contextual factors) assessing variables such as mood and fatigue that might influence cognitive test performance.
Results:The current MTB library includes eight core cognitive tests based on well-established neuropsychological measures: two language tasks (Spelling and Word Meaning), two executive functioning tasks (Arrow Matching and Shape-Color Sorting), an associative memory task (Faces and Names), an episodic memory task (Arranging Pictures), a working memory task (Sequences) and a processing speed task (Numbers and Symbols). Additional cognitive assessments from other popular test libraries including the International Cognitive Ability Resource (ICAR), Cognitive Neuroscience Test Reliability and Clinical Applications for Schizophrenia (CNTRACS) and Test My Brain are currently being implemented, as are non-cognitive measures from the NIH Toolbox Emotion Battery and the Patient-Reported Outcomes Measurement Information System (PROMIS). The MTB library includes measures suitable for use in research studies incorporating point-in-time and burst designs as well as ecological momentary assessment (EMA).
Conclusions:The MTB was created to address many of the scientific, practical, and technical challenges to cognitive assessment by capitalizing on advances in technology measurement and cognitive research. Initial psychometric evaluation of measures has been performed, and additional clinical validation is underway in studies with persons at risk for cognitive impairment or Alzheimer’s disease (AD), diagnosed with mild cognitive impairment (MCI) or AD, Parkinson’s disease, and HIV-associated Neurocognitive Disorders. Calculation of norms and reliable change indicators is in progress. The MTB is currently available to beta testers with public release planned for Summer, 2023. Clinical researchers will be able to use the MTB system to design smartphone-based test batteries, deploy and manage mobile data collection in their research studies, and aggregate and analyze results in the context of large-scale norming data.
2 Validity and Reliability of Mobile Toolbox Cognitive Assessments
- Cindy J Nowinski, Aaron Kaat, Jerry Slotkin, Erika La Forte, Yusuke Shono, Miriam Novack, Sarah Pila, Elizabeth Dworak, Stephanie R Young, Zahra Hosseinian, Hubert Adam, Richard Gershon
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 780-781
-
- Article
-
- You have access Access
- Export citation
-
Objective:
To present validation evidence for the first eight cognitive measures available through Mobile Toolbox (MTB). These measures use a remote self-administered platform to assess language, working memory, episodic memory, executive function, and processing speed.
Participants and Methods:We used two separate samples, recruited as part of a larger study, to validate MTB measures. Sample I, comprised of 92 English-speaking adults ages 18-85, was used to assess internal consistency and construct validity. Participants were first administered “gold standard” cognitive measures (Wechsler Memory Scale-IV Verbal Paired Associates I and II; Wechsler Adult Intelligence Scale-IV Symbol Search, Digit Span, Coding, and Letter-Number Sequencing; Delis-Kaplan Executive Function System Color-Word Interference Test, Peabody Picture Vocabulary Test, Wechsler Individual Achievement Test-4 Spelling, and the Wisconsin Card Sorting Test), after which they completed MTB (pre-loaded on a study-provided smartphone) on their own. Internal consistency was evaluated using measure-appropriate indices (split-half reliability, Cronbach’s alpha or IRT-based indices). Pearson correlation coefficients between MTB tests and measures of similar constructs were used to evaluate concurrent validity. For two tests with timing-dependent scores, Arrow Matching and Shape-Color Sorting, separate analyses were performed for iOS and Android devices. Sample II, with 1,120 English-speaking participants ages 18-90, was used to evaluate age-related change. Participants completed MTB measures remotely on their own smartphones, in a preset order, within a 14-day period. Spearman correlation coefficients, corrected for education, were calculated to evaluate relationships between age and test scores.
Results:Sample I participants were 67% female, 52% white, 99% non-Hispanic; average age=48 (SD= 17). Education was: < high school (1%); high school (55%); some college (21%); college (15%); graduate degree (8%). Internal consistency estimates ranged from 0.81 to 0.99. Pearson correlations between MTB and external measures ranged from 0.41 to 0.86 (all p < .01). Of the timed tests, only Shape-Color sorting showed significant score differences between Android and iOS devices. Sample II was 57% female, 13% Hispanic, 72% white, mean age = 45 (SD = 21). Education distribution was: < high school (2%); high school (34%); some college (34%), college (20%); graduate degree (11%). Measures of executive function (r = -0.50; r=-0.57) and processing speed (r= -0.61) showed the expected negative correlation with age (all p <0.001). Negative correlations, although weaker, were also seen on measures of working memory (r=-0.2) and episodic memory (r=-0.2, r=-0.37; p.<.001). Vocabulary performance improved with age (r=0.4; p<.001), while spelling scores remained stable (r=0.09).
Conclusions:Initial studies support the validity and reliability of the first eight MTB cognitive measures in two diverse samples. MTB tests showed satisfactory construct validity, as demonstrated by the associations between MTB and well-established tests. Furthermore, most MTB measures correlated with age in the expected directions. Executive function, processing speed and memory typically decrease with age and this decrease was reflected in MTB test performance. In contrast, spelling and vocabulary, typically preserved as we age, did not decrease in our sample. Our results support the use of MTB in cognitive aging research.
4 Continuum of Measurement: Reviewing the Advantages and Disadvantages of Self-Administered Remote Cognitive Tests and Their Examiner Administered Alternatives
- Julie Hook, Cindy J. Nowinski, Richard Gershon
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 29 / Issue s1 / November 2023
- Published online by Cambridge University Press:
- 21 December 2023, pp. 782-783
-
- Article
-
- You have access Access
- Export citation
-
Objective:
To describe advantages and disadvantages of using digital assessments remotely and in-person to inform clinical and research practice.
Participants and Methods:As part of a larger study,1120 adults completed a battery of remotely administered tests (Mobile Toolbox) and a subset of this sample completed examiner administered in-person testing (NIH Toolbox® Cognition Battery). Attention was given to making the sample reflective of the US 2020 Census during participant recruitment. Of the 1120 participants, the majority of the sample were female (57%) and Caucasian (72%) and had a mean age of 45 (SD = 21). In terms of education, equal percentages had high school (34%) or some college (34%).
Results:NIH Toolbox cognitive tests of processing speed, language, executive function, attention, and episodic memory were administered via a trained examiner and correlates of these tests were self-administered remotely via a smartphone. Using examples, we will show which aspects of cognitive assessment had the best correlations between remote self-administration and face-to-face examination and which had lower correlations.
Conclusions:Digital remote assessments can help overcome barriers by enabling repeated testing in naturalistic conditions, reducing participant burden and expense, and increasing research accessibility for populations currently under-represented. Moreover, the ubiquity of internet-connected devices vastly increases opportunities to remotely monitor other dimensions relevant to cognition using smartphone apps and wearable sensors. In addition to improving access to testing, digitally administered assessments dramatically improve some individual’s tolerance to testing with shorter tests that can be administered via computer adaptive testing (CAT). Despite these benefits, some aspects of the cognitive assessment cannot be adequately replicated remotely and thus yield lower correlations to their examiner-administered alternatives. Clinical and research implications are discussed.
The NIH Toolbox: Overview of Development for Use with Hispanic Populations
- Richard C. Gershon, Rina S. Fox, Jennifer J. Manly, Dan M. Mungas, Cindy J. Nowinski, Ellen M. Roney, Jerry Slotkin
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 26 / Issue 6 / July 2020
- Published online by Cambridge University Press:
- 17 February 2020, pp. 567-575
-
- Article
- Export citation
-
Objective:
Hispanics/Latinos are the largest and fastest-growing minority population in the United States. To facilitate appropriate outcome assessment of this expanding population, the NIH Toolbox for Assessment of Neurological and Behavioral Function® (NIH Toolbox®) was developed with particular attention paid to the cultural and linguistic needs of English- and Spanish-speaking Hispanics/Latinos.
Methods:A Cultural Working Group ensured that all included measures were appropriate for use with Hispanics/Latinos in both English and Spanish. In addition, a Spanish Language Working Group assessed all English-language NIH Toolbox measures for translatability.
Results:Measures were translated following the Functional Assessment of Chronic Illness Therapy (FACIT) translation methodology for instances where language interpretation could impact scores, or a modified version thereof for more simplified translations. The Spanish versions of the NIH Toolbox Cognition Battery language measures (i.e., Picture Vocabulary Test, Oral Reading Recognition Test) were developed independently of their English counterparts.
Conclusions:The Spanish-language version of the NIH Toolbox provides a much-needed set of tools that can be selected as appropriate to complement existing protocols being conducted with the growing Hispanic/Latino population in the United States.
Self-Efficacy Buffers the Relationship between Educational Disadvantage and Executive Functioning
- Laura B. Zahodne, Cindy J. Nowinski, Richard C. Gershon, Jennifer J. Manly
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 21 / Issue 4 / April 2015
- Published online by Cambridge University Press:
- 16 April 2015, pp. 297-304
-
- Article
- Export citation
-
Previous studies showed that control beliefs are more strongly related to global cognition and mortality among adults with low education, providing preliminary evidence that self-efficacy buffers against the negative impact of educational disadvantage on physical and cognitive health. The current study extends these findings to a nationally representative sample of men and women aged 30 to 85 and explores which cognitive domains are most strongly associated with self-efficacy, educational attainment, and their interaction. Data were obtained from 1032 adult (30–85) participants in the United States norming study for the NIH Toolbox. Self-efficacy, executive functioning, working memory, processing speed, episodic memory, and vocabulary were assessed with the NIH Toolbox. Multivariate analysis of covariance and follow-up regressions tested the hypothesis that self-efficacy would be more strongly related to cognitive performance among individuals with lower education, controlling for age, sex, race, ethnicity, education, reading level, testing language, and depressive symptoms. Higher education was associated with higher self-efficacy and better performance on all cognitive tests. Higher self-efficacy was associated with better set-switching and attention/inhibition. Significant self-efficacy by education interactions indicated that associations between self-efficacy and executive abilities were stronger for individuals with lower education. Specifically, individuals with low education but high self-efficacy performed similarly to individuals with high education. This study provides evidence that self-efficacy beliefs buffer against the negative effects of low educational attainment on executive functioning. These results have implications for future policy and/or intervention work aimed at reducing the deleterious effects of educational disadvantage on later cognitive health. (JINS, 2015, 21, 297–304)
The Cognition Battery of the NIH Toolbox for Assessment of Neurological and Behavioral Function: Validation in an Adult Sample
- Sandra Weintraub, Sureyya S. Dikmen, Robert K. Heaton, David S. Tulsky, Philip David Zelazo, Jerry Slotkin, Noelle E. Carlozzi, Patricia J. Bauer, Kathleen Wallner-Allen, Nathan Fox, Richard Havlik, Jennifer L. Beaumont, Dan Mungas, Jennifer J. Manly, Claudia Moy, Kevin Conway, Emmeline Edwards, Cindy J. Nowinski, Richard Gershon
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 20 / Issue 6 / July 2014
- Published online by Cambridge University Press:
- 24 June 2014, pp. 567-578
-
- Article
- Export citation
-
This study introduces a special series on validity studies of the Cognition Battery (CB) from the U.S. National Institutes of Health Toolbox for the Assessment of Neurological and Behavioral Function (NIHTB) (Gershon, Wagster et al., 2013) in an adult sample. This first study in the series describes the sample, each of the seven instruments in the NIHTB-CB briefly, and the general approach to data analysis. Data are provided on test–retest reliability and practice effects, and raw scores (mean, standard deviation, range) are presented for each instrument and the gold standard instruments used to measure construct validity. Accompanying papers provide details on each instrument, including information about instrument development, psychometric properties, age and education effects on performance, and convergent and discriminant construct validity. One study in the series is devoted to a factor analysis of the NIHTB-CB in adults and another describes the psychometric properties of three composite scores derived from the individual measures representing fluid and crystallized abilities and their combination. The NIHTB-CB is designed to provide a brief, comprehensive, common set of measures to allow comparisons among disparate studies and to improve scientific communication. (JINS, 2014, 20, 1–12)
Which Psychosocial Factors Best Predict Cognitive Performance in Older Adults?
- Laura B. Zahodne, Cindy J. Nowinski, Richard C. Gershon, Jennifer J. Manly
-
- Journal:
- Journal of the International Neuropsychological Society / Volume 20 / Issue 5 / May 2014
- Published online by Cambridge University Press:
- 31 March 2014, pp. 487-495
-
- Article
- Export citation
-
Negative affect (e.g., depression) is associated with accelerated age-related cognitive decline and heightened dementia risk. Fewer studies examine positive psychosocial factors (e.g., emotional support, self-efficacy) in cognitive aging. Preliminary reports suggest that these variables predict slower cognitive decline independent of negative affect. No reports have examined these factors in a single model to determine which best relate to cognition. Data from 482 individuals 55 and older came from the normative sample for the NIH Toolbox for the Assessment of Neurological and Behavioral Function. Negative and positive psychosocial factors, executive functioning, working memory, processing speed, and episodic memory were measured with the NIH Toolbox Emotion and Cognition modules. Confirmatory factor analysis and structural equation modeling characterized independent relations between psychosocial factors and cognition. Psychosocial variables loaded onto negative and positive factors. Independent of education, negative affect and health status, greater emotional support was associated with better task-switching and processing speed. Greater self-efficacy was associated with better working memory. Negative affect was not independently associated with any cognitive variables. Findings support the conceptual distinctness of negative and positive psychosocial factors in older adults. Emotional support and self-efficacy may be more closely tied to cognition than other psychosocial variables. (JINS, 2014, 20, 1–9)