Hostname: page-component-848d4c4894-wzw2p Total loading time: 0 Render date: 2024-04-30T17:38:08.480Z Has data issue: false hasContentIssue false

6 Remote Smartphone Cognitive and Motor Testing in Frontotemporal Dementia Research: Feasibility, Reliability, and Validity

Published online by Cambridge University Press:  21 December 2023

Adam M Staffaroni*
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Jack Carson Taylor
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Annie L Clark
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Hilary W Heuer
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Amy B Wise
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Masood Manoochehri
Affiliation:
Columbia University, New York, NY, USA.
Leah Forsberg
Affiliation:
Mayo Clinic, Rochester, MN, USA
Carly T Mester
Affiliation:
Mayo Clinic, Rochester, MN, USA
Meghana Roa
Affiliation:
Mayo Clinic, Rochester, MN, USA
Danielle Brushaber
Affiliation:
Mayo Clinic, Rochester, MN, USA
Julio C Rojas
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Joel H Kramer
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Bradley F Boeve
Affiliation:
Mayo Clinic, Rochester, MN, USA
Howard J Rosen
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
Adam L Boxer
Affiliation:
University of California, San Francisco, San Francisco, CA, USA.
*
Correspondence: Adam M. Staffaroni, PhD; University of California, San Francisco, Weill Institute for Neurosciences, Department of Neurology, Memory and Aging Center, San Francisco, CA, USA; adam.staffaroni@ucsf.edu
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.
Objective:

Therapeutics targeting frontotemporal dementia (FTD) are entering clinical trials. There are challenges to conducting these studies, including the relative rarity of the disease. Remote assessment tools could increase access to clinical research and pave the way for decentralized clinical trials. We developed the ALLFTD Mobile App, a smartphone application that includes assessments of cognition, speech/language, and motor functioning. The objectives were to determine the feasibility and acceptability of collecting remote smartphone data in a multicenter FTD research study and evaluate the reliability and validity of the smartphone cognitive and motor measures.

Participants and Methods:

A diagnostically mixed sample of 207 participants with FTD or from familial FTD kindreds (CDR®+NACC-FTLD=0 [n=91]; CDR®+NACC-FTLD=0.5 [n=39]; CDR®+NACC-FTLD>1 [n=39]; unknown [n=38]) were asked to remotely complete a battery of tests on their smartphones three times over two weeks. Measures included five executive functioning (EF) tests, an adaptive memory test, and participant experience surveys. A subset completed smartphone tests of balance at home (n=31) and a finger tapping test (FTT) in the clinic (n=11). We analyzed adherence (percentage of available measures that were completed) and user experience. We evaluated Spearman-Brown split-half reliability (100 iterations) using the first available assessment for each participant. We assessed test-retest reliability across all available assessments by estimating intraclass correlation coefficients (ICC). To investigate construct validity, we fit regression models testing the association of the smartphone measures with gold-standard neuropsychological outcomes (UDS3-EF composite [Staffaroni et al., 2021], CVLT3-Brief Form [CVLT3-BF] Immediate Recall, mechanical FTT), measures of disease severity (CDR®+NACC-FTLD Box Score & Progressive Supranuclear Palsy Rating Scale [PSPRS]), and regional gray matter volumes (cognitive tests only).

Results:

Participants completed 70% of tasks. Most reported that the instructions were understandable (93%), considered the time commitment acceptable (97%), and were willing to complete additional assessments (98%). Split-half reliability was excellent for the executive functioning (r’s=0.93-0.99) and good for the memory test (r=0.78). Test-retest reliabilities ranged from acceptable to excellent for cognitive tasks (ICC: 0.70-0.96) and were excellent for the balance (ICC=0.97) and good for FTT (ICC=0.89). Smartphone EF measures were strongly associated with the UDS3-EF composite (ß's=0.6-0.8, all p<.001), and the memory test was strongly correlated with total immediate recall on the CVLT3-BF (ß=0.7, p<.001). Smartphone FTT was associated with mechanical FTT (ß=0.9, p=.02), and greater acceleration on the balance test was associated with more motor features (ß=0.6, p=0.02). Worse performance on all cognitive tests was associated with greater disease severity (ß's=0.5-0.7, all p<.001). Poorer performance on the smartphone EF tasks was associated with smaller frontoparietal/subcortical volume (ß's=0.4-0.6, all p<.015) and worse memory scores with smaller hippocampal volume (ß=0.5, p<.001).

Conclusions:

These results suggest remote digital data collection of cognitive and motor functioning in FTD research is feasible and acceptable. These findings also support the reliability and validity of unsupervised ALLFTD Mobile App cognitive tests and provide preliminary support for the motor measures, although further study in larger samples is required.

Type
Poster Session 01: Medical | Neurological Disorders | Neuropsychiatry | Psychopharmacology
Copyright
Copyright © INS. Published by Cambridge University Press, 2023