INTRODUCTION
The clock drawing test (CDT) is one of the oldest and most widely used neuropsychological tests due to its ease of administration, brevity, and ability to capture a wide range of neuropsychological functions (Cosentino et al., Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004; Libon et al., Reference Libon, Malamut, Swenson, Sands and Cloud1996). The CDT is comprised of two conditions, producing a drawing to command, followed by copying a model of a clock. Successful performance requires accessing the semantic attributes associated with a clock, the necessary linguistic abilities to translate the command for time setting into the correct graphomotor response, motor operations, spatial reasoning and organization, working memory, and the capacity for mental planning (Cosentino et al., Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004; Libon et al., Reference Libon, Malamut, Swenson, Sands and Cloud1996).
The literature using traditional paper and pencil CDT is substantial and includes many investigations of its accuracy in detecting cognitive changes in aging and neurodegenerative disease (Hazan et.al, Reference Hazan, Frankenburg, Brenkel and Shulman2018). CDT performance has also been shown to distinguish between dementia subtypes and between mild cognitive impairment (MCI) subtypes (Ahmed et al., Reference Ahmed, Brennan, Eppig, Price, Lamar, Delano-Wood and Libon2016; Cosentino et al., Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004; Kozora & Cullum, Reference Kozora and Collum1994; Libon et al., Reference Libon, Malamut, Swenson, Sands and Cloud1996; Price et al., Reference Price, Cunningham, Coronado, Freedland, Cosentino, Penney, Penisi, Bowers, Okun and Libon2011; Royall et al., Reference Royall, Cordes and Polk1998). For example, Ahmed et al. (Reference Ahmed, Brennan, Eppig, Price, Lamar, Delano-Wood and Libon2016) found that CDT errors across MCI subtypes are highly associated with language skills, including naming and verbal concept formation. Prior research using analog scoring methods has shown that while participants with AD typically improve from the command to the copy test condition, participants with disproportionate dysexecutive impairment, as seen in vascular dementia (VaD) and Parkinson’s disease (PD) often fail to improve. This behavior is thought to be secondary to the impaired frontal systems operations that can typify these disorders (Cosentino et al., Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004; Libon et al., Reference Libon, Malamut, Swenson, Sands and Cloud1996; Price et al., Reference Price, Cunningham, Coronado, Freedland, Cosentino, Penney, Penisi, Bowers, Okun and Libon2011). Indeed, it has been shown that participants with VaD make more errors overall and tend to make the same errors on both command and copy conditions, suggesting an inability to alter mental set as test conditions change (Cosentino et al., Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004; Libon et al., Reference Libon, Malamut, Swenson, Sands and Cloud1996; Price et al., Reference Price, Cunningham, Coronado, Freedland, Cosentino, Penney, Penisi, Bowers, Okun and Libon2011). Analog clock drawing behavior has also been shown to be associated with neuroimaging biomarkers of disease. For example, Shoyama et al. (Reference Shoyama, Nishioka, Okumura, Kose, Tsuji, Ukai and Shinosaki2011) obtained analog clock drawings to command from young normal controls and assessed brain activity using multichannel near-infrared spectroscopy. These investigators found that total time to completion was correlated with increased prefrontal oxygen hemoglobin recruitment.
Despite its merits and longevity, the traditional CDT pose some challenges as a diagnostic and screening tool. For example, standard 3, 5, or 10-point scoring systems tend to capture only a small number of features or errors that might indicate cognitive impairment. Additional problems associated with analog clock drawing scoring systems revolve around the need to establish inter-rater reliability and the time necessary to score protocols (Price et al., Reference Price, Cunningham, Coronado, Freedland, Cosentino, Penney, Penisi, Bowers, Okun and Libon2011). These problems tend to limit how the CDT could be used in settings such as primary medical care to screen for neurocognitive impairment.
Over the past decade, innovations in digital technology have enabled researchers to create a digital clock drawing test (dCDT) that captures a wide range of clock drawing behavior in real time yielding thousands of variables or features (Libon et al., Reference Libon, Penney, Davis, Tabby, Eppig, Nieves and Garret2014; Müller et al., Reference Müller, Herde, Preische, Zeller, Heymann, Robens, Elbing and Laske2019; Schejter-Margalit et al., Reference Schejter-Margalit, Kizony, Shirvan, Cedarbaum, Bregman, Thaler, Giladi and Mirelman2021; Souillard-Mandar et al., Reference Souillard-Mandar, Davis, Rudin, Au, Libon and Swenson2016). Recent research has shown that machine learning algorithms using features extracted from the dCDT are able to classify dementia and non-dementia patients into their respective groups (Binaco et al., Reference Binaco, Calzaretto, Epifano, McGuire, Umer, Emrani and Polikar2020; Souillard-Mandar et al., Reference Souillard-Mandar, Davis, Rudin, Au, Libon and Swenson2016; Dion et al., Reference Dion, Arias, Amini, Davis, Penney, Libon and Price2020). For example, Bianco et al. (Reference Binaco, Calzaretto, Epifano, McGuire, Umer, Emrani and Polikar2020) analyzed digital clock drawing features using machine learning algorithms. In this research, neural networks employing an information theoretic feature selection approach was able to achieve the best 2-group classification at or above 83% between patients diagnosed with AD versus and MCI; and between amnestic versus mixed/dysexecutive MCI, and between CN versus amnestic or mixed/dysexecutive MCI subtypes. In another study, Davoudi et al. (Reference Davoudi, Dion, Amini, Tighe, Price, Libon and Rashidi2021) extracted digital clock drawing kinematic, time-based, and visuospatial features and examined how well these features could classify AD, VaD, and normal control participants into their respective groups. Optimal area under the curve was achieved using a combination of command and copy variables measuring kinematic (mean pen pressure, ratio of pen pressure to velocity), time-based, and graphomotor features.
Perhaps some of the most innovative and potentially informative data that can be extracted using the dCDT are the variety of timed-based parameters. For example, prior research has revealed that the majority of clock drawing time is spent not actually drawing. This behavior–called think time or time spent not putting ink on the test form has been demonstrated in patients with multiple sclerosis (Libon et al., Reference Libon, Penney, Davis, Tabby, Eppig, Nieves and Garret2014), MCI (Dion et al., Reference Dion, Arias, Amini, Davis, Penney, Libon and Price2020), and community volunteers evaluated as part of the Framingham Heart Study (Piers et al., Reference Piers, Devlin, Ning, Yulin, Wasserman, Massaro and Libon2017). Digital clock drawing research has also uncovered a number of decision-making latency variables defined by the time elapsed between clock drawing components (Libon et al., Reference Libon, Penney, Davis, Tabby, Eppig, Nieves and Garret2014, Piers et al., Reference Piers, Devlin, Ning, Yulin, Wasserman, Massaro and Libon2017). Research shows that these decision-making latencies vary in the command versus the copy test condition (Libon et al., Reference Libon, Penney, Davis, Tabby, Eppig, Nieves and Garret2014; Piers et al., Reference Piers, Devlin, Ning, Yulin, Wasserman, Massaro and Libon2017). Another recent validation study in non-demented older adults found that total clock drawing time positively correlated with performance in multiple cognitive domains, while selected decision-making latencies were negatively correlated with performance on many of the same tasks (Dion et al., Reference Dion, Arias, Amini, Davis, Penney, Libon and Price2020).
Behavior often seen on the CDT includes the tendency of patients to initiate the drawing of numbers inside the clock face using anchor digits (i.e., the numbers 12, 6, 3, 9). Lamar et al. (Reference Lamar, Ajilore, Leow, Charlton, Cohen, GadElkarim and Kumar2016) studied cognitively normal (CN) older adults who use an anchoring organizational strategy involving key digits of the clock face (numbers 12, 3, 6, and 9). Participants using this strategy had better performance on executive and memory tasks and exhibited greater regional integration within the left orbitofrontal and temporal cortices and the right anterior cingulate/right frontal gyrus.
In sum, there is growing support that digital clock drawing metrics aid in the differential diagnosis of cognitive diseases of aging and underlying disruptions in brain function. However, the dCDT (Libon et al., Reference Libon, Penney, Davis, Tabby, Eppig, Nieves and Garret2014; Souillard-Mandar et al., Reference Souillard-Mandar, Davis, Rudin, Au, Libon and Swenson2016) require some post-processing. Moreover, normative data is limited. To help make the transition from research to widespread clinical use it would be useful for a test to require little to no post-processing and clock drawing indices expressed as standard scores measuring constructs that underlie successful performance. Recently, a dCDT, DCTclockTM, has become commercially available as part of the Linus health platform (https://linus.health). The DCTclockTM builds upon previous dCDT research, capturing metrics previously described in the literature (e.g., ‘think time,’ spatial organization, drawing size) with machine learning analytics. The DCTclockTM diverges from prior dCDT by introducing a cloud-based scoring platform requiring no examiner post-processing, four age-adjusted composite scores for both command and copy conditions, and a composite total command/copy score designed to be user friendly and aid clinical interpretation. In a recent paper, Rentz and colleagues (Reference Rentz, Papp, Mayblyum, Sanchez, Klein, Souillard-Mandar and Johnson2021) studied a group of CN participants who had amyloid and tau positron emission tomography (PET) imaging and a group of participants with MCI or early AD. Among participants with imaging biomarkers of amyloid and tau, the DCTclockTM total score and spatial reasoning index scores were associated with greater amyloid and tau burden. Despite these interesting findings, there is limited research on these DCTclockTM metrics to date.
The current study sought to further investigate the utility of DCTclockTM generated metrics for distinguishing between statistically defined MCI subtypes. In the current study, the DCTclockTM was administered to memory clinic patients who were classified as presenting with subtle cognitive impairment (SbCI; Edmonds et al., Reference Edmonds, Delano-Wood, Galasko, Salmon and Bondi2015) or MCI using statistically determined criteria (Bondi et al., Reference Bondi, Edmonds, Jak, Clark, Delano-Wood, McDonald and Salmon2014; Jak-Bondi et al., Reference Jak, Bondi, Delano-Wood, Wierenga, Corey-Bloom, Salmon and Delis2009). Past research regarding MCI suggests different clinical and pathology outcomes depending on specific MCI subtypes (Schneider et al., Reference Schneider, Arvanitakis, Leurgans and Bennett2009). Therefore, a test that is able to dissociate between MCI subtypes would have considerable utility in both primary and special care settings. The goal of the current research was to assess differences across participant groups in the total score and composite metrics generated by DCTclockTM.
METHODS
Participants
Participants in the current research (n = 103; 100% White older adults) were patients recruited from Rowan University, New Jersey Institute for Successful Aging, Memory Assessment Program (MAP). All MAP patients underwent a comprehensive neuropsychological evaluation and were examined by a social worker and board-certified geriatric psychiatrist. An Magnetic resonance imaging (MRI) study of the brain and appropriate serum blood tests were obtained to evaluate for reversible causes of dementia. A clinical diagnosis was determined for each patient at an interdisciplinary team conference. Participants diagnosed with MCI presented with subjective cognitive complaints and/or evidence of cognitive impairment relative to age and education, preservation of general functional abilities, and the absence of dementia. Participants were excluded if there was any history of head injury, substance abuse, or major psychiatric disorders, including major depression, epilepsy, B12, folate, or thyroid deficiency. For all participants, a knowledgeable family member was available to provide information regarding functional status. This study was approved by the Rowan University Institutional Review Board with consent obtained consistent with the Declaration of Helsinki.
Neuropsychological Assessment
The neuropsychological protocol used to classify MCI subtype assessed three domains of cognition: executive control, naming/lexical access, and episodic memory. Measures of visuospatial functioning were not assessed or used for MCI subtype classification. From this protocol, nine parameters, three from each neurocognitive domain, were used to classify MCI subtype as described below (Emrani et al., Reference Emrani, Libon, Lamar, Price, Jefferson, Gifford and Au2018). All test scores were expressed as z-scores derived from normative data.
Executive Control
This cognitive domain was assessed with three tests including The Boston Revision of the Wechsler Memory Scale-Mental Control subtest (Lamar et al., Reference Lamar, Price, Davis, Kaplan and Libon2002); the letter fluency test (Spreen & Strauss, Reference Spreen and Strauss1990); and the Trail Making Test-Part B (Reitan & Wolfson, Reference Reitan and Wolfson1985). The dependent variable for the mental control subtest was the total non-automatized accuracy index (see Lamar et al., Reference Lamar, Price, Davis, Kaplan and Libon2002 for full details). The dependent variables obtained from the letter fluency test and Trail Making Test-Part B were demographically corrected scores provided by Heaton et al. (Reference Heaton, Miller, Taylor and Grant2004).
Lexical Access/Language
This domain was also assessed with three tests, including the 60-item version of the Boston Naming Test (BNT) (Kaplan et al., Reference Kaplan, Goodglass and Weintraub1983); a test of semantic (‘animals’) fluency where participants were asked to produce as many names of animals in 60s excluding perseverations and extra-category intrusion responses (Spreen & Strauss, Reference Spreen and Strauss1990); and the Wechsler Adult Intelligence Scale-III (WAIS-III) Similarities subtest (Wechsler, Reference Wechsler1997). The dependent variables for the BNT and ‘animal’ fluency tests were standard scores adjusted for age, sex, and race obtained from Heaton et al. (Reference Heaton, Miller, Taylor and Grant2004). The dependent variable obtained from the WAIS-III Similarities subtest was the age-corrected scale score (Wechsler, Reference Wechsler1997).
Memory and Learning
This cognitive domain was assessed with the 9-word California Verbal Learning Test (CVLT)-Mental Status test (Delis et al., Reference Delis, Kramer, Kaplan and Ober2000). This test was scored and administered using standard instructions. Three CVLT-short form variables were used in the current research including total immediate free recall, delayed free recall, and the delayed recognition measure adjusted for age, sex, and education.
Determination of Clinical Subtypes
Single and Multi-Domain MCI. Jak et al. (Reference Jak, Bondi, Delano-Wood, Wierenga, Corey-Bloom, Salmon and Delis2009) criteria were used to determine MCI subtype. Single domain MCI was diagnosed when participants scored >1.0 standard deviation below normative expectations on any of two of the three measures within a single cognitive domain. Mixed MCI was diagnosed when participants scored >1.0 standard deviation below normative expectations on any of two of the three measures within two or more cognitive domains. Based on these procedures, 21 participants were diagnosed with single domain amnestic MCI (aMCI), 6 participants were diagnosed with single domain dysexecutive MCI, and 22 were diagnosed with mixed or multi-domain MCI. Because of the small number of dysexecutive MCI participants, a combined mixed/dysexecutive (mx/dys) MCI subgroup (n = 28) was constructed. This decision was made based on prior research (Emrani et al., Reference Emrani, Libon, Lamar, Price, Jefferson, Gifford and Au2018, Eppig et al., Reference Eppig, Wambach, Nieves, Price, Lamar, Delano-Wood, Giovannetti, Bettcher, Penney, Swenson, Lippa, Kabasakalian, Bondi and Libon2012; Libon et al., Reference Libon, Bondi, Price, Lamar, Eppig, Wambach and Penney2011) where mixed/dysexecutive participants presented with similar patterns of impairment on executive tests. Table 1 shows descriptive statistics for neuropsychological performance, demographics, and clinical ratings in each group.
Characteristics of neuropsychologically-defined clinical MCI subgroups
Note: WMS = Wechsler Memory Scale; WAIS-III = Wechsler Adult Intelligence Test; CVLT = California Verbal Learning Test; MMSE = Mini-Mental State Examination; WRAT-IV = Wide Range Achievement Test. CN = normal cognition; SbCI = subtle cognitive impairment; aMCI = amnestic mild cognitive impairment; mx/dysMCI = mixed/dysexecutive mild cognitive impairment.
SbCI. Thirty-three of the 54 participants not meeting Jak et al. (Reference Jak, Bondi, Delano-Wood, Wierenga, Corey-Bloom, Salmon and Delis2009) criteria for MCI were classified as presenting with subtle MCI (SbCI) using a modification of Edmonds et al. (Reference Edmonds, Delano-Wood, Galasko, Salmon and Bondi2015) criteria. These participants scored >1 sd below the mean on two of the nine neuropsychological measures in different cognitive domains (Edmonds et al., Reference Edmonds, Delano-Wood, Galasko, Salmon and Bondi2015).
Cognitive Normal (CN) Group
Twenty-one participants did not meet criteria for either SbCI (Edmonds et al., Reference Edmonds, Delano-Wood, Galasko, Salmon and Bondi2015) or MCI (Bondi et al., Reference Bondi, Edmonds, Jak, Clark, Delano-Wood, McDonald and Salmon2014; Jak et al., Reference Jak, Bondi, Delano-Wood, Wierenga, Corey-Bloom, Salmon and Delis2009). One individual presented with some, but very little cognitive impairment, such that only one of the nine neuropsychological parameters was below the 1 SD cutoff. All of these participants were combined into a single group and labeled as presenting with CN.
The dCDT
DCTclockTM is based on the traditional paper and pencil clock drawing task and was originally designed, with cooperation from the Clock Sketch Consortium (Libon et al., Reference Libon, Penney, Davis, Tabby, Eppig, Nieves and Garret2014), at Lahey Clinic and the Massachusetts Institute of Technology (Souillard-Mandar et al., Reference Souillard-Mandar, Davis, Rudin, Au, Libon and Swenson2016). It was further developed and licensed for research use by Digital Cognition Technologies Inc. now part of Linus Health, and is cleared by the Food and Drug Administration for cognitive assessment. Participants are presented with a paper test form containing a faint dot pattern and handed a digital pen that looks and functions like a normal pen but contains a camera sensor that captures pen position every 12 ms. The instructions used to administer the DCTclockTM are consistent with traditional CDT administration and included both command and copy test conditions. In the command condition, participants are asked to, “draw the face of a clock, put in all numbers, and set the hands for 10 after 11.” Upon completion of the command test condition, the copy test condition is administered whereby participants are asked to copy a model of a clock with hands set for ‘10 after 11’. The digital pen allows for the capture of thousands of clock drawing features to be analyzed as a series of time-stamped (x,y) coordinates.
DCTclockTM produces multiple objective measurements that were derived from approximately 5000 digital clock drawings using machine learning algorithms (Binaco et al., Reference Binaco, Calzaretto, Epifano, McGuire, Umer, Emrani and Polikar2020; Davis et al., Reference Davis, Libon, Au, Pitman and Penney2014). Machine learning algorithms were previously developed to calculate meaningful clock scores based on their ability to discriminate performance between thousands of healthy controls and participants from different diagnostic groups including aMCI, AD dementia, PD and other neurodegenerative disorders (Davis et al., Reference Davis, Libon, Au, Pitman and Penney2014; Souillard-Mandar et al., Reference Souillard-Mandar, Davis, Rudin, Au, Libon and Swenson2016). Details on how the DCTclockTM algorithm and scoring process have been described in detail elsewhere (Rentz et al., Reference Rentz, Papp, Mayblyum, Sanchez, Klein, Souillard-Mandar and Johnson2021). Table 2 contains a description of the 9 DCTclockTM indices used for this analysis.
Neurocognitive Biomarkers captured with the DCTclock
Note: Score calculation is automated and cloud-based. Composite and subscale scores are calculated for both command and copy conditions and normed with respect to cognitively healthy individuals. Composite scales and subscale metrics are adjusted for age.
Statistical Analyses
Hierarchical linear regression models with block-wise predictor entry were constructed to investigate differences among groups on the DCTclockTM composite indices, and the total command/copy score. Due to the lack of normative data for education and sex for the composite indices, education and sex were entered into Step 1 of the hierarchical models for these variables to allow for the interpretation of group differences after controlling for variability among these factors. Unlike the composite indices, the DCTclockTM total command/copy score is not adjusted for age, and therefore we entered age, in addition to education and sex, in Step 1 of the hierarchical models using the total command/copy score. In Step 2, dummy coded variables representing between-group differences among the CN and MCI group subtypes were entered into the model. Dummy coding is a method frequently utilized in regression analysis to allow for the coding and incorporation of categorical predictors into the model (see Tabachnick & Fidell, Reference Tabachnick and Fidell2013 for details). This coding sets one level of the variable as the control group, to which all other groups are then compared. In order to obtain a description of all possible group differences, K − 1 dummy codes, where K represents the levels of the categorical predictor, were created and included into the regression analysis. The results produced from Step 2 were interpreted to assess for between-group differences after controlling for demographics.
RESULTS
Preliminary Analyses
Four participants with DCTclockTM composite index scores in excess of 3.29 were identified as outliers and removed from analyses (Tabachnick & Fidell, Reference Tabachnick and Fidell2013). No violations associated with the ordinary least squares estimator were identified. Descriptive statistics for all nine DCTclockTM parameters can be found in Table 3.
DCTclock indices (descriptive statistics)
Note. CN = cognitively normal; SbCI = subtle cognitive impairment; aMCI = amnestic cognitive impairment; mx/dysMCI = mild/dysexecutive cognitive impairment.
Hierarchical Regression Analyses
Distinguishing SbCI from CN
DCTclockTM measures that significantly distinguished SbCI participants from CN participants include: the Digital Cognition Technologies (DCT) total score (t = −2.85, p = .005), command spatial reasoning (t = −2.40, p = .018), copy drawing efficiency (t = −2.08, p = .04), copy information processing (t = −2.28, p = .025), and copy simple motor (t = −2.13, p = .035). For all of these measures participants in the SbCI group obtained lower scores than those in the CN group (Table 4). Overall, the model for DCT total score generated the greatest effect size (β = −0.33).
DCTclock hierarchical regression analysis summary
Note. n = 105; CI = confidence interval; sr2 = squared semi-partial correlation coefficient; a1 = female, 0 = male; DCTclock = total command/copy score; DE = drawing Efficiency; SCM = Simple/Complex Motor Operations; IP = Information Processing; SP = Spatial Reasoning; CN = normal cognition; SbCI = subtle cognitive impairment; aMCI = amnestic mild cognitive impairment; mx/dysMCI = mixed/dysexecutive cognitive impairment.
*p< .05;
**p< .01;
***p< .001.
Distinguishing MCI from CN
The DCTclockTM measures that significantly distinguished MCI from CN participants included: the DCT total score (aMCI: t = −2.07, p = .005; mx/dysMCI: t = −5.07, p < .001), command drawing efficiency (mx/dysMCI: t = −3.19, p = .002), command information processing (aMCI: t = −2.23, p = .028; mx/dysMCI: t = −2.77, p = .007), command spatial reasoning (aMCI: t = −3.01, p = .003; mx/dysMCI: t = −5.04, p < .001), copy drawing efficiency (mx/dysMCI: t = −3.13, p = .002), and copy information processing (mx/dysMCI: t = −2.97, p = .004).
Overall, of the three indices that distinguished aMCI from CN (total score, command information processing, and command spatial reasoning), the greatest effect size was achieved using the command spatial reason index (β = −.35). Of the six indices that distinguished mx/dysMCI from CN (total score, command drawing efficiency, command information processing, command spatial reasoning, copy drawing efficiency, copy information processing), the greatest effect size was achieved using the DCT total score and command spatial reason index (both β = −.59). None of the copy indices significantly distinguished aMCI from CN participants (p > .05).
Distinguishing mx/dysMCI from aMCI. DCTclockTM measures that significantly distinguished mx/dysMCI participants from aMCI participants included DCT total score (t = −2.82, p = .006), copy drawing efficiency (t = −2.11, p = .037), and copy Spatial Reasoning (t = −2.54, p = .012). Participants in the mx/dysMCI group scored lower on these three indices compared to those in the aMCI group. Overall, DCT total score and the copy spatial reasoning index score generated the greatest effect size (both βs = −0.33).
Distinguishing SbCI from MCI and CN
DCTclockTM measures that significantly distinguished SbCI participants from CN participants included the DCT total score (t = 2.85, p = .005), the command condition spatial reasoning index (t = 2.41, p = .018), and the copy condition drawing efficiency (t = 2.09, p = .04) and simple motor indices (t = 2.14, p = .035). Only the command condition spatial reasoning index distinguished SbCI from mx/dsyMCI (t = 3.04, p = .003) and none of the scores distinguished ScCI from aMCI.
DISCUSSION
Our findings suggest that DCTclockTM metrics can accurately distinguish between Jak/Bondi neuropsychological-defined clinical MCI subtypes, SbCI , and normal cognitive aging in a memory clinic sample. Critically, while individual index scores varied from one group comparison to the next, the DCTclockTM Total Score, a single score that aggregates across all command and copy condition metrics revealed significant differences in performance patterns across groups.
In previous research Cosentino et al. (Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004) found that clock drawing errors in the command condition were associated with overall illness severity and degrade access to semantic knowledge. Errors produced in the copy test condition were associated with dysexecutive difficulty. These findings underscore the complimentary, but different neurocognitive abilities that underlie successful clock drawing. It is very likely that these neurocognitive disabilities contribute to a reduced DCTclockTM total ccore. More research is necessary to test this supposition. Nonetheless, the current research suggests that the DCTclockTM total score could be a reasonable omnibus measure to screen for many of the important cognitive domains that underlie MCI and SbCI.
It has been suggested that the biological substrate underlying insidious onset AD/VaD spectrum syndromes (Emrani et al., Reference Emrani, Lamar, Price, Baliga, Wasserman, Matusz and Libon2021a) have their origin years before clinical symptoms emerge. Thus, there is an urgent need to develop effective and time efficient tests to screen for emergent neurodegenerative illness. The traditional venue to assess for pre-dementia/dementia illness has been the specialty memory clinic. Yet, the worldwide prevalence of dementia syndromes, such as AD, suggests that screening for dementia should become part of routine primary care. The brevity, ease of administration, autonomously scoring, and sensitivity to AD biomarkers suggests DCTclockTM could provide the means to screen for neurocognitive impairment in the primary care environment.
In addition to the total score, we found evidence that DCTclockTM index scores that capture more nuanced aspects of clock drawing performance also have utility, particularly for distinguishing between cognitive profiles to inform differential diagnosis. The index score with the best dissociation between CN versus SbCI and Jak/Bondi determined MCI groups in our sample was command spatial reasoning index, a compilation measuring clock face circularity and the spatial relationships of the components drawn within the clock face (i.e., digits, clock hands). These data suggest that nuanced changes in motor, executive, and visuospatial functioning critical for clock organization and construction may characterize SbCI and distinguish between profiles of early-stage amnestic versus executive cognitive decline. These findings lend empirical support to prior research showing heteromodal ventral stream alterations in normal control participants who did not use anchor digits to organize their clock drawings, thereby displaying less spatial organization/reasoning in their approach (Lamar et al., Reference Lamar, Ajilore, Leow, Charlton, Cohen, GadElkarim and Kumar2016). If looked at longitudinally, subtle motor and spatial reasoning deficits may be a harbinger of cognitive impairment given the role of ventral steam visual processing regions in signaling the emergence of SbCI and conversion from normal cognition to MCI and then to AD (Lee et al., Reference Lee, Seo, Choo, Kim, Lee, Lee and Woo2008; Thomann et al., Reference Thomann, Toro, Santos, Essig and Schröder2008). The findings of the current study also add to data reported by Rentz and colleagues (Reference Rentz, Papp, Mayblyum, Sanchez, Klein, Souillard-Mandar and Johnson2021), who showed that the spatial reasoning index score was associated with greater cerebral amyloid and tau burden. Interestingly, however, their finding was also specific to the spatial reasoning index score but from the copy condition rather than the command condition.
In the current study, copy condition index scores tended to have the most utility when distinguishing SbCIfrom normal cognition, and distinguishing mx/dysexecutive MCI from amnestic MCI and normal cognition. Of the various index scores in the copy condition, comparisons of group performance, with the exception of the amnestic MCI versus normal cognition comparison, most consistently differed on the drawing efficiency index. Consistent with the findings reported by Cosentino et al. (Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004), these findings might suggest that clock drawing to copy is specifically linked to dysexecutive difficulty. Group differences on copy condition index scores underscores the benefit of this test condition and is consistent with a large corpus of prior clock drawing literature (see Cosentino et al., Reference Cosentino, Jefferson, Chute, Kaplan and Libon2004; Price et al., Reference Price, Cunningham, Coronado, Freedland, Cosentino, Penney, Penisi, Bowers, Okun and Libon2011; Wiggins et al., Reference Wiggins, Dion, Formanski, Davoudi, Amini, Heilman, Penney, Davis, Garvan, Arnaoutakis, Tighe, Libon and Price2021). However, further research and replication will be needed to parse the differential contributions of the command versus copy conditions for DCTclockTM indices in normal aging and early-stages cognitive decline. Further research is also needed to clarify the potentially different ways in which DCTclockTM index scores relate to incident clinical cognitive profiles and neurodegenerative disease biomarkers.
The current research adds to a growing body of research demonstrating how digital technology can be engineered to extract and define subtle and very nuanced behavior that can differentiate between pre-MCI and MCI subtypes (Emrani et al., Reference Emrani, Lamar, Price, Baliga, Wasserman, Matusz and Libon2021a, Reference Emrani, Lamar, Price, Baliga, Wasserman, Matusz and Libon2021b) resulting in better diagnostic decision-making. Previous research has suggested that participants diagnosed with amnestic MCI may be at greater risk to progress to pathological confirmed AD (Guillozet et al., Reference Guillozet, Weintraub, Mash and Mesulam2003; Grundmanet al., Reference Grundman, Petersen, Ferris, Thomas, Aisen, Bennett, Foster, Jack, Galasko, Doody, Kaye, Sano, Mohs, Gauthier, Kim, Jin, Schultz, Schafer, Mulnard and van Dyck2004; Devlin et al., Reference Devlin, Brennan, Saad, Giovannetti, Hamilton, Wolk, Xie and Mechanic-Hamilton2021). Patients with mixed or dysexecutive MCI may be expected to revert to a CN state or progress to other dementia syndromes such as frontotemporal dementia, dementia with Lewy bodies, VaD associated with small vessel disease, or depression (Schneider et al., Reference Schneider, Arvanitakis, Leurgans and Bennett2009; Ferman et al., Reference Ferman, Smith, Kantarci, Boeve, Pankratz, Dickson, Graff-Radford, Wszolek, Van Gerpen, Uitti, Pedraza, Murray, Aakre, Parisi, Knopman and Petersen2013; Dugger et al., Reference Dugger, Davis, Malek-Ahmadi, Hentz, Sandhu, Beach, Adler, Caselli, Johnson, Serrano, Shill, Belden, Driver-Dunckley, Caviness, Sue, Jacobson, Powell and Sabbagh2015).
The current research is not without limitations. First, our sample size is modest, overwhelming white, and highly educated, which limits the generalizability of our findings. Gathering digital clock protocols from ethnically and racially diverse patients and non-native English speakers is critical. Also, the exact relation between DCTclockTM indices and education needs to be determined. Second, data were collected from self-referrals presenting to a specialized memory and aging program because of memory concerns. As stated above, to maximize the effectiveness for any neurocognitive screening test, data need to be collected in diverse setting such as primary medical care, family medicine, and obstetrics/gynecology where many women get their primary care. Third, biomarkers such as cerebral or cerebral spinal fluid (CSF) amyloid and tau levels, or brain volumetrics and vascular disease markers were not available for this analysis. We therefore cannot confirm the distinctness of our Jak/Bondi defined clinical groups, and how these groups relate to neurodegenerative neuropathology or cerebrovascular disease. In this regard, there is a need to gather DCTclockTM data on diverse clinical samples with dementia biomarkers for further validation. Fourth, we acknowledge that other neuropsychological tests/domains of cognitive functioning could have been used for classification of MCI groups. The rationale for using the protocol that we did was based on prior research showing that the specific neuropsychological tests used were able to illustrate key neurocognitive constructs and differentiate between MCI subtypes (Emrani et al., Reference Emrani, Libon, Lamar, Price, Jefferson, Gifford and Au2018). Moreover, in addition to Jak-Bondi criteria others mean to classify MCI patients in relation to DCTTM performance should be undertaken. Lastly, the current study lacks the inclusion of test data from the visuospatial functioning domain. This domain is relevant to clock drawing performance, and should be examined in the future.
Despite these limitations, the current study contributes to the literature in that this is the first report on the ability of DCTclockTM metrics to distinguish between CN and clinical SbCI/MCI subtypes. The data described above, along with recent findings described by Rentz and colleagues (Reference Rentz, Papp, Mayblyum, Sanchez, Klein, Souillard-Mandar and Johnson2021) build upon years of prior digital clock drawing and machine learning research (Binaco et al., Reference Binaco, Calzaretto, Epifano, McGuire, Umer, Emrani and Polikar2020; Lamar et al., Reference Lamar, Ajilore, Leow, Charlton, Cohen, GadElkarim and Kumar2016; Libon et al., Reference Libon, Penney, Davis, Tabby, Eppig, Nieves and Garret2014; Piers et al., Reference Piers, Devlin, Ning, Yulin, Wasserman, Massaro and Libon2017; Souillard-Mandar et al., Reference Souillard-Mandar, Davis, Rudin, Au, Libon and Swenson2016). Collectively, these data provide evidence for a commercialized and Federal drug administration (FDA)-approved digital clock drawing tool, DCTclockTM that has the capacity to leverage this technology for broader clinical and research use. The provision of normative data, automated scoring, and simplified composite metrics from the DCTclockTM system may improve the usability and efficiency of machine learning-based analytics of clock drawing performance. Finally, a tablet-based version of the DCTclock has recently been developed by Linus Health. As the field moves further toward tablet-based digital assessment, additional research is needed to investigate and compare the validity of digital pen versus table-based approaches to clock drawing assessment.
Supplementary material
For supplementary material accompanying this paper visit https://doi.org/10.1017/S1355617722000091
Financial Support
There is no financial support to disclose for this research.
Conflicts of Interest
David J. Libon and Rod Swenson receive royalties from Oxford University Press.
David J. Libon receives royalties from Linus Health.
Rhoda Au serves as a scientific advisor to Signant Health and a scientific consultant to Biogen Inc.
Open access
