Objective
Understanding early indicators of dementia may be key to improving quality of life and treatment for the millions of older adults affected by dementia each year (Alzheimer’s Association, 2013). Subjective memory complaints (SMCs) are a component of subjective cognitive decline, defined as a “self-perceived decline in any cognitive domain over time (Jessen et al., Reference Jessen2014).” SMCs have been identified as a potential early marker of Alzheimer’s disease (AD) pathology that may be informative prior to detectable changes in objective performance. In fact, SMCs are frequently used in research and clinical work as a sole proxy assessment of cognitive impairment in older adults. However, this practice may be problematic given that current guidelines indicate that SMCs should never be sufficient to diagnose even preclinical AD (Jessen et al., Reference Jessen2014). Further, diagnosis of Mild and Major neurocognitive disorder (NCD) requires both subjective and objective evidence of decline (American Psychiatric Association, 2013). The current study examines the utility of SMCs in relation to objective cognitive impairment and NCD diagnosis.
The evidence for a relationship between SMCs and objective cognitive impairment is mixed and often contradictory (Crumley, et al., Reference Crumley, Stetler and Horhota2014; Lenehan, et al., Reference Lenehan, Klekociuk and Summers2012; Reid and MacLullich, Reference Reid and MacLullich2006; Roberts, et al., Reference Roberts, Clare and Woods2009; Mitchell et al., Reference Mitchell, Beaumont, Ferguson, Yadegarfar and Stubbs2014 ; Weber and Maki, Reference Weber, Maki, Sievert and Brown2016). However, SMCs are consistently associated with depression and anxiety symptoms in both cognitively normal and cognitively impaired older adults (Yates, et al., Reference Yates, Clare and Woods2017; Norman et al., Reference Norman2020 ; Song et al., Reference Song2020). For example, Yates et al. (Reference Yates, Clare and Woods2017) found that SMCs were more strongly related to mood problems than objective impairment, both cross-sectionally and longitudinally. Meta-analyses demonstrate that SMCs and objective memory are correlated, but the effect is small and influenced by psychosocial factors, including depression and anxiety (Crumley, et al., Reference Crumley, Stetler and Horhota2014). Other researchers, however, have found that SMCs may be useful predictors of cognitive decline in individuals who are cognitively intact (Tsutsumimoto et al., Reference Tsutsumimoto2017). These seemingly contradictory findings may be due to examining SMCs in patients at specific stages of impairment; thus, we examined individuals with a range of impairment from cognitively normal to objective and diagnosable impairment.
In addition to subjective assessments of memory function, biological markers are needed to improve diagnostic accuracy in relation to NCDs and risk. Neural measures assessed using electroencephalogram (EEG), such as the P300 component of the event-related potential (ERP), may serve as an early indicator of memory impairment related to Mild and Major NCDs (Howe, et al., Reference Howe, Bani-Fatemi and De Luca2014; Waninger et al., Reference Waninger2018). The use of ERPs to examine cognitive impairment in older adults is a growing area of study. The P300 component is associated with genetic risk for AD (Howe, et al., Reference Howe, Bani-Fatemi and De Luca2014), objective measures of MCI (Waninger et al., Reference Waninger2018), and cognitive decline more broadly (Polich, Reference Polich2004). Thus, ERPs hold the potential to be a low-cost biomarker for early cognitive decline that can be administered and interpreted on-site and therefore, may serve as a tool for detecting the earliest stages of dementia (Newsome et al., Reference Newsome2013).
Our study builds on prior literature using a multimodal approach to assess the utility and reliability of SMCs in relation to P300 amplitude, objective measures of memory, and NCD diagnosis in a sample of primarily healthy older adults. Specifically, we expected that 1) P300 amplitude would be associated with other objective measures of memory performance and NCD diagnosis, 2) based on a majority of studies reviewed, SMCs would not be associated with objective memory performance, P300 amplitude, or NCD diagnosis, and 3) SMCs would be related to higher levels of stress, depression, and anxiety symptoms, and lower levels of overall psychological well-being.
Methods
Participants and procedures
Participants included 79 community-dwelling older adults (aged 60–75) recruited from the [Blinded for Review] with e-mails including a link to complete an online recruitment survey. Participants (N = 517) completed an initial online survey that assessed for SMCs, along with a range of other health and psychosocial information. One hundred and twenty individuals were e-mailed with the goal of identifying 80 participants who met inclusion criteria. Participants with self-reported family history of AD and worse self-reported memory were prioritized for initial contact in order to increase the likelihood of identifying participants with mild NCD. Eighty five of these 120 participants responded with interest in the study. Of the 85, 79 participants completed at least one of the two, in-person appointments. The first appointment included review of the informed consent form, a clinical interview, and a battery of neuropsychological assessments (reported below), which lasted approximately 2.5 hours. At the second appointment, participants completed the emotions battery of the NIH Toolbox and an EEG to assess the P300. The second visit lasted approximately 1.5 hours. This study was approved by the [Blinded for Review], and written informed consent was provided from all participants.
Self-report measures
Subjective memory complaints
SMCs were measured by the Change subscale of the Metamemory in Adulthood questionnaire (McDonough et al., Reference McDonough2020), which consists of 10 items assessing age-related memory changes over the past 10 years (e.g., “The older I get the harder is it to remember clearly” and “Compared to 10 years ago, I am much worse at remembering titles of books, films, or plays.”). This subscale was chosen based on prior work demonstrating good reliability and validity in relation to memory performance (McDonough et al., Reference McDonough2020). Table 1 provides a list of all items included in the measure. Participants rated the degree to which they agreed with each statement on a scale from 1 (agree strongly) to 5 (disagree strongly). Items were recoded, such that a higher score corresponded with more SMCs (range = 10–45; Cronbach’s alpha = 0.88).
Metamemory in adulthood questionnaire change subscale items
Perceived stress
Perceived stress was measured using the NIH Toolbox Emotion Battery (Kupst et al., Reference Kupst2015). Participants rated 10 items (e.g., “How often have you felt nervous and “stressed”?) based on their experience over the past month on a scale from 1 (never) to 5 (very often).
Psychological well-being
Psychological well-being was measured using the NIH Toolbox Emotion Battery, which includes the following subscales: positive affect, general life satisfaction, and meaning and purpose (Gershon et al., Reference Gershon2013). Uncorrected T-scores, which compare performance to the entire NIH toolbox nationally representative adult sample, were used in analyses.
Depression
Depression was measured with the Geriatric Depression Scale (GDS; Yesavage and Sheikh, Reference Yesavage and Sheikh1986), which includes 15 yes/no questions (e.g., “Do you feel that your life is empty?”) based on how participants felt over the past week. Items are summed, resulting in a possible score from 0 to 15. A total score was also calculated after excluding item 10 (i.e., “do you have more problems with memory than most”), which was also included and reported in the analysis and results.
Anxiety
Anxiety was measured with the Geriatric Anxiety Scale (GAS; Segal et al., Reference Segal2010), which includes 10 symptoms of anxiety or stress (e.g., “I could not control my worry.”) that are rated over the past week from 0 (not at all) to 3 (all of the time).
EEG recording and P300 Task
Tasks used to elicit the P300 component are important to consider when studying an older adult population. For example, hearing impairments are often used as exclusion criteria for auditory ERP tasks, which may exclude many older adult participants, given that up to 80% of older adults may have some level of hearing loss (Sprinzl and Riechelmann, Reference Sprinzl and Riechelmann2010). Thus, visual ERP tasks eliciting the P300, which may be more sensitive for detecting cognitive changes (Waninger et al., Reference Waninger2018), were used for the current study.
Continuous EEG was recorded with an active 32-electrode system (ActiCHamp, Brain Products, GmBH; Munich, Germany) while participants completed a visual go/nogo computer task during which they were presented a stream of continuous stimuli and asked to use a mouse click to blast aliens (frequent targets, 70%) and asteroids (infrequent targets, 15%), but not astronauts (non-targets, 15%). The task consisted of 10 blocks of 40 trials each. Each trial consisted of the stimulus presented for 200ms, followed by a blank screen for 1000 ms and then a fixation cross presented for 300–700 ms (in 100 ms intervals).
Data processing
EEG data were processed using Brain Vision Analyzer, Version 2.1 (Brain Products, Gilching, Germany). Data were re-referenced to the average of the mastoid electrodes and filtered from 0.1 to 30 Hz (Butterworth, 4th order). Stimulus-locked epochs were created with a duration of 1450 ms, beginning 200 ms prior to stimulus onset, and corrected for eye movement artifacts using the algorithm developed by Gratton et al. (Reference Gratton, Coles and Donchin1983). Segments that contained voltage steps >50 µV between sample points, a voltage difference of 175 µV within a 400 ms interval, or a maximum voltage difference of <0.5 µV within 100 ms intervals were automatically rejected. Data were further segmented by trial type (i.e., alien, asteroid, astronaut), with epochs spanning 1200 ms beginning 200 ms prior to stimulus onset. Baseline correction was then applied using the 200 ms pre-stimulus interval and stimulus-locked ERPs were averaged for each trial type separately. Parietal P300 amplitude was scored as the mean area at Pz between 350 ms and 600 ms following the presentation of frequent and infrequent targets (asteroids and aliens, respectively). Two participants were excluded from ERP analyses due to either poor EEG quality or insufficient task accuracy. A P300 difference score was then created by subtracting frequent targets (i.e., aliens) from infrequent targets (i.e., asteroids) to isolate the P300 (i.e., oddball) response to the infrequent targets versus frequent targets; this difference score was used in all subsequent analyses.
Neuropsychological performance and diagnostic rating
Objective memory performance
Objective memory performance was measured with the California Verbal Learning Test, 3rd Edition (CVLT-3; Delis et al., Reference Delis2017), which is a well-validated measure of short and long-delay verbal recall. Scaled scores (normed by age group) were used in analyses.
Diagnostic rating
Participants completed a brief clinical interview and a short neuropsychological battery, including the following tests: The Test of Premorbid Functioning, the Brief Visuospatial Memory Test-Revised, the Wechsler Memory Scale 4th edition Logical Memory subtest, the CVLT-3, subtests from the Wechsler Adult Intelligence Scale-IV (i.e., Digit span, Block design, Similarities), a clock drawing, FAS and Animal Naming, Delis-Kaplan Executive Function System Trails subtests, the Boston Naming Test, the GDS, and the GAS. Based on the pattern of standardized scores (standardized based on age and education when possible) and information obtained during the clinical interview, participants were assigned a diagnostic rating based on review by two clinicians—one licensed clinical psychologist and a psychology resident. Ratings ranged from 0 to 6 (1 = probable normal, 2 = possible normal, 3 = possible Mild NCD, 4 = probable Mild NCD, 5 = possible Major NCD, 6 = probable Major NCD), with higher indicating a greater level of impairment. Ratings were based on DSM-5 diagnostic criteria for Mild and Major NCD, including information from a clinical interview and neuropsychological battery developed by a board certified geropsychologist. If there was limited evidence of either subjective or objective impairment, a “possible” rating was given consistent with the level of impairment. For example, a rating of “possible Mild NCD” was established if a participant denied subjective decline or use of compensatory strategies, but performed below expectations on multiple objective tests of memory, whereas, a “probable Mild NCD” was based directly on DSM-5 criteria for a Mild NCD. See Table 2 for full diagnostic rating criteria.
Neuropsychological diagnosis rating
Diagnostic ratings (1–6) were based on consensus between two independent raters after a clinical interview and brief neuropsychological battery completed with the participant. ADL = activities of daily living.
Analysis
All statistical analyses were conducted using IBM SPSS Statistics 26. Linear regression models were used to assess the relationships between SMCs, psychosocial variables, and objective measures of cognitive functioning while controlling for age, gender, and education. Unstandardized slope estimates are reported for all regressions. Age was not controlled for in analyses predicting standardized neuropsychological outcomes (i.e., CVLT-3), as these were already normed based on age group.
Results
The final sample was comprised of 79 older adults (63.3% female) aged 61–75 years (M = 68.10, SD = 3.88). Most participants identified as White (77.2%; 11.4% Black; 3.8% Asian; 7.6% other) and had a college degree or higher (79.7%). Seven participants were excluded from EEG analyses due to incomplete or unreliable data. Approximately 24.1% of the sample met diagnostic criteria for possible or probable Mild NCD; however, the majority of participants scored in the average or above range on an objective verbal memory task (i.e., CVLT long delay: 83.5%). See Table 3 for descriptive statistics and bivariate correlations.
Means, standard deviations, and correlations
a P300 outliers removed (n = 4).
* p < 0.05.
** p < 0.01.
*** p < 0.056.
Controlling for gender and education, we assessed whether our objective measures of memory (i.e., CVLT-3 recall scores) were associated with the P300. Increased P300 amplitude was associated with higher long-delay verbal memory recall score (b = 0.43, t(65) = 2.84, p = .006, partial r 2 = 0.11; see Figure 1), although the relationship was non-significant with the short-delay verbal memory recall score on the CVLT-3 (b = 0.28, t(65) = 1.90, p = 0.062). Further, lower P300 amplitude was significantly associated with higher (i.e., worse) diagnostic rating (b = −0.11, t(64) = −2.23, p = 0.029, partial r 2 = 0.07; see Figure 2), controlling for age, gender, and education.
Grand averaged difference waveforms (infrequent targets–frequent targets) for participants who scored below average (n = 11), within the average range (n = 19), and above average (n = 39) on a neuropsychological assessment of verbal memory (i.e., CVLT-3 long delay). Average range was indicated by a scaled score of 8–12.
Grand averaged difference waveforms (infrequent targets – frequent targets) for participants with probable – possible normal diagnostic ratings (n = 52) and possible Mild NCD – probable dementia diagnostic ratings (n = 17).
Consistent with our prediction on the relationship between SMCs and objective cognitive measures, results of multiple regression analyses controlling for gender and education level revealed that SMCs were not associated with short-delay (b = −0.018, t(72) = −0.32, p = 0.747) or long-delay verbal memory recall scores on the CVLT-3 (b = −0.05, t(72) = −0.79, p = 0.432). Further, controlling for age, gender, and education level, SMCs were also not associated with diagnostic rating (b = 0.026, t(71) = 1.29, p = 0.198) or P300 amplitude (b = 0.036, t(61) = 0.71, p = 0.481).
Finally, results of multiple regression analyses controlling for age, gender, and education level indicated that SMCs were associated with higher perceived stress (b = 0.43, t(65) = 3.07, p = 0.003, partial r 2 = 0.13), depression (b = 0.12, t(69) = 4.47, p < 0.001, partial r 2 = 0.23), and anxiety symptoms (b = 0.15, t(71) = 3.88, p < 0.001, partial r 2 = 0.17). The relationship between SMCs and depression remains significant (b = 0.10, t(69) = 3.87, p < 0.001, partial r 2 = 0.18), even if item 10 (i.e., “do you have more problems with memory than most”) is removed from the total score. SMCs were also associated with worse overall psychological well-being (b = −0.29, t(65) = −2.09, p = 0.040, partial r 2 = 0.06).
Conclusions
Subjective reports of cognitive decline, including SMCs, are currently a component of the diagnostic criteria for DSM-5 Mild and Major NCD diagnoses—and yet the literature is not clear as to whether these complaints actually relate to objective cognitive impairment. The current study took a multimodal approach to examine objective measures of cognitive functioning, including neuropsychological test performance, diagnostic ratings, and neurophysiological measure of cognitive functioning (i.e., the P300). Critically, all of these objective measures related to one another—findings which bolster construct validity. However, none of these measures related to subjective complaints, which were only associated with psychosocial indicators of distress.
In the current study, SMCs were related to mood and psychosocial difficulties rather than objective measures of neural and cognitive functioning. Specifically, SMCs were related to higher levels of perceived stress, more depressive and anxiety symptoms, and worse overall psychological well-being. Our findings are consistent with prior literature demonstrating that SMCs are strongly influenced by mood and may not be a reliable indicator of cognitive impairment or progression to dementia (Balash et al., Reference Balash2013; Brodaty et al., Reference Brodaty2017; Edmonds et al., Reference Edmonds2014). These results add to a literature questioning the utility of SMCs as a criterion in the diagnosis of Mild or Major NCDs. However, there is a growing literature demonstrating that psychiatric symptoms such as depression and anxiety may have predictive utility as markers of neurodegenerative disease (Liew, Reference Liew2019; Liew, Reference Liew2020). Further, research suggests that SMCs may be most valuable as a disease indicator prior to the onset of objective impairments (Jessen et al., Reference Jessen2014). Thus, in future research, it may be important to examine whether the predictive validity of SMCs and mood symptoms may be strongest prior to the onset of objective impairments, while reported SMCs may decline as NCDs progress and insight also declines.
NIH has indicated the importance of identifying neuromarkers of DSM-5 diagnoses such as Mild and Major NCDs. In this regard, our findings provide support for further examination of P300 amplitude as a neuromarker for detecting early memory impairments in aging. Specifically, we found that P300 amplitude was associated with participants’ current diagnostic rating, and with a key clinical measure of amnestic-type memory impairment that has been most closely linked to AD (Newsome et al., Reference Newsome2013). Prior research has also demonstrated that ApoE €4 carriers, individuals at increased risk for AD, are characterized by reduced P300 amplitude (Irimajiri, et al., Reference Irimajiri, Golob and Starr2010; Lai et al., Reference Lai2010). Further, prior research suggests that ERPs may provide a measure of cognitive functioning that is not influenced by cultural or education effects (Campanella, Reference Campanella2013). These advantages, combined with our findings, support the potential use of P300 amplitude obtained from visual tasks as an important neural indicator of cognitive impairment—consistent with NIH’s vision of identifying neurocorrelates of neuropsychiatric disorders. However, given the relatively small effects detected in the current study, additional research is needed.
Limitations and future directions
Though demographics within the current sample are consistent with the geographical area from which they reside, the higher levels of education and socioeconomic status may limit generalizability. Although the sample included mostly healthy older adults, a number of participants met criteria for possible Mild NCD or greater impairment. Although this sample is appropriate for identifying early cognitive changes in relatively healthy older adults, the current sample could not assess these relationships among individuals with more marked impairment—which will be an important avenue for future research. Additionally, the current study emphasized objective verbal memory, which may not generalize to non-Alzheimer’s types of Major NCDs (e.g., fronto-temporal, vascular, etc.). Finally, recent research indicates that age-anchored measures of SMCs comparing performance to an individual’s peers may be most reliably related to objective cognitive impairment (Chapman et al., Reference Chapman2021; Perrotin et al., Reference Perrotin2012; Tandetnik et al., Reference Tandetnik2015). The measure used in the current study was anchored based on intra-individual change, which supports prior work demonstrating that these types of memory complaints in particular may be unrelated to objective functioning.
Future research may benefit from examining the generalizability of these findings to more diverse populations and individuals with clinically diagnosed NCDs. Further, the use of additional neuropsychological tests that allow for differential diagnosis of Mild and Major NCD subtypes may improve the specificity and application of these results to clinical settings. Finally, examination of these relationships longitudinally will be vital in determining the predictive utility of both P300 amplitude and SMCs. Future studies might examine the degree to which the P300 may provide an early indicator of impairment, and whether it prospectively predicts decline. Further, studies examining SMCs should include both age-anchored and intra-individual measures.
Summary and recommendations
Many individuals develop concerns about their thinking and memory as they age, which may lead to selective attention to memory problems and increased SMCs. This may be especially common among individuals who are experiencing high stress, anxiety, and depressive symptoms. Our study adds to the previous literature by demonstrating that SMCs were most strongly associated with recent stress, overall psychological well-being, depression, and anxiety symptoms—and were unrelated to objective memory impairment associated with NCDs. Further, the P300 was associated with objective, but not subjective impairment, demonstrating the potential utility for this measure for early detection methods. However, future research is needed to evaluate the sensitivity of the P300 amplitude across more diverse, severe, and under-represented populations.
It is important to acknowledge that memory complaints obtained from a significant other still provide significant diagnostic value, as these are less influenced by a patient’s mood or stress. Thus, when a patient reports SMCs, collecting additional information from a significant other may be key to determine an accurate diagnosis (as is suggested in the DSM-5). When a significant other is not available, SMCs should be queried with specific questions to determine a patient’s use of compensatory strategies that are a change from previous functioning. Such descriptions may allow clinicians to determine if a referral for objective testing may be beneficial, but retain the potential to be diagnostically misleading. For example, it is common for individuals with both Mild NCD and AD to lack insight into their impairment and deny memory problems entirely (Mak et al., Reference Mak2015).
Despite the disadvantages of SMCs in relation to cognition, SMCs may provide valuable clinical information about the patient’s subjective experiences and potential psychological and psychosocial concerns that should be assessed. For example, SMCs may provide a pathway for healthcare workers to identify a need to assess for otherwise unreported mood and anxiety problems among older patients. This is important because older adults may not necessarily associate their cognitive complaints with stress, anxiety, or depression, and therefore, they may not seek appropriate treatment. Further, our results do not preclude the potential usefulness of SMCs as a potential risk indicator in the pre-prodromal phase of NCDs before objective impairment arises. Finally, our results support the recommendation by previous studies to re-evaluate patient reported SMCs as a diagnostic criterion for Mild NCD (Lenehan, et al., Reference Lenehan, Klekociuk and Summers2012) and provide support for further examination of P300 amplitude as an additional, less biased assessment. Ultimately, research consistently supports that objective testing for cognitive impairment provides the most consistent and sensitive measure of early cognitive changes, and the P300 may be a useful addition in research and clinical practice.
Conflict of interest
The authors report no conflicts with any product mentioned or concept discussed in this paper.
Source of funding
This study was funded through a pilot grant from Florida State University’s (FSU) Institute for Successful Longevity and an FSU Team Science for Translational Research Seed Grant, funded by the FSU Office of Research. This manuscript was supported in part by a grant from the NIH/NIMH (T32 MH093311).
Description of authors’ roles
J. Sheffler, M. Meynadasy, and G. Hajcak, study completion, conceptualization, and composition of total article and analysis. D. Taylor and D. Kiosses, writing and editing. All authors reviewed the final version and agree to be accountable for all aspects of the work.
Open access
