Skip to main content

The ecological validity of neuropsychological assessment and the role of depressive symptoms in moderate to severe traumatic brain injury

  • NAOMI CHAYTOR (a1) (a2), NANCY TEMKIN (a3) (a4) (a5), JOAN MACHAMER (a3) and SUREYYA DIKMEN (a3) (a4) (a6)

Evaluating the ecological validity of neuropsychological tests has become an increasingly important topic. Previous research suggests that neuropsychological tests have a moderate level of ecological validity when predicting everyday functioning. The presence of depressive symptoms, however, may impact the relationship between neuropsychological tests and real world performance. The current study empirically tests this hypothesis in a sample of 216 participants with moderate to severe traumatic brain injury (TBI) who completed neuropsychological testing, self-report of mood symptoms, and report of everyday functioning six months post-injury. Contrary to some previous research and clinical lore, results indicated that depression was weakly related to neuropsychological test performance, although it was more strongly related to everyday functioning. Neuropsychological test performance was also significantly related to everyday functioning. The ecological validity of the neuropsychological tests together was not impacted by depressive symptoms, when predicting significant other ratings of functional status. However, patient self-report seems somewhat less related to neuropsychological performance in those with significant depressive symptoms. Neuropsychological test performance was equally related to self and other report of everyday functioning in patients without significant depressive symptoms. (JINS, 2007, 13, 377–385.)

Corresponding author
Correspondence and reprint requests to: Naomi S. Chaytor, Ph.D., Regional Epilepsy Center, Harborview Medical Center, P.O. Box 359745, 325 9th Avenue, Seattle, Washington 98104-2499. E-mail:
Hide All


Burgess, P.W., Alderman, N., Evans, J., Emslie, H., & Wilson, B.A. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4, 547558.
Burt, D.B., Zembar, M.J., & Niederehe, G. (1995). Depression and memory impairment: A meta-analysis of the association, its pattern, and specificity. Psychological Bulletin, 117, 285305.
Buschke, H. (1973). Selective reminding for analysis of memory and learning. Journal of Verbal Learning & Verbal Behavior, 12, 543550.
Bush, B.A., Novak, T.A., Schneider, J.J., & Madan, A. (2004). Depression following traumatic brain injury: The validity of the CES-D as a brief screening device. Journal of Clinical Psychology in Medical Settings, 11, 195201.
Chaytor, N. & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181197.
Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21, 217227.
Choi, S.C. (1977). Tests of equality of dependent correlation coefficients. Biometrika, 64, 645647.
Christodoulou, C., Melville, P., Scheri, W.F., Morgan, T., MacAllister, W.S., Canfora, D.M., Berry, S.A., & Krupp, L.B. (2005). Perceived cognitive dysfunction and observed neuropsychological performance: Longitudinal relation in persons with multiple sclerosis. Journal of the International Neuropsychological Society, 11, 614619.
Dikmen, S., Bombardier, C., Machamer, J., Fann, J., & Temkin, N. (2004). Natural history of depression in traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 85, 14571464.
Dikmen, S., Machamer, J., Miller, B., Doctor, J., & Temkin, N. (2001). Functional status examination: A new instrument for assessing outcome in traumatic brain injury. Journal of Neurotrauma, 18, 127140.
Evans, J.J., Chua, S.E., McKenna, P.J., & Wilson, B.A. (1997). Assessment of the dysexecutive syndrome in schizophrenia. Psychological Medicine, 27, 112.
Fann, J.R., Uomoto, J.M., & Katon, W.J. (2001). Cognitive improvement with treatment of depression following mild traumatic brain injury. Psychosomatics, 42, 4854.
Franzen, M.D. & Arnett, P.A. (1997). The validity of neuropsychological assessment procedures. In H.W. Reese & M.D. Franzen (Eds.), Biological and neuropsychological mechanisms: Life-span developmental psychology. Mahwah, NJ: Lawrence Erlbaum Associates.
Goldstein, G. & McCue, M. (1995). Differences between patient and informant functional outcome ratings in head-injured individuals. International Journal of Rehabilitation and Health, 1, 2535.
Grant, I., Olshen, R.A., Atkinson, J.H., Heaton, R.K., Nelson, J., McCutchan, J.A., & Weinrich, J.D. (1993). Depressed mood does not explain neuropsychological deficits in HIV-infected persons. Neuropsychology, 7, 5361.
Heaton, R.K., Marcotte, T.D., Mindt, M.R., Sadek, J., Moore, D.J., Bentley, H., McCutchan, J.A., Reicks, C., Grant, I., & the HNRC Group (2004). The impact of HIV-associated neuropsychological impairment on everyday functioning. Journal of the International Neuropsychological Society, 10, 317331.
Heinrichs, R.W. (1990). Current and emergent applications of neuropsychological assessment: Problems with validity and utility. Professional Psychology: Research and Practice, 21, 171176.
Jones, J.E., Hermann, B.P., Woodard, J.L., Barry, J.J., Gilliam, F., Kanner, A.M., & Meador, K.J. (2005). Screening for major depression in epilepsy with common self-report depression inventories. Epilepsia, 46, 731735.
Jorge, R.E., Robinson, R.G., Moser, D., Tateno, A., Crespo-Facorro, B., & Arndt, S. (2004). Major depression following traumatic brain injury. Archives of General Psychiatry, 61, 4250.
Kaitaro, T., Koskinen, S., & Kaipio, M. (1995). Neuropsychological problems in everyday life: A 5-year follow-up study of young severely closed-head-injured patients. Brain Injury, 9, 713727.
Kreutzer, J.S., Seel, R.T., & Gourley, E. (2001). The prevalence and symptom rates of depression after traumatic brain injury: A comprehensive examination. Brain Injury, 15, 563576.
Long, C.J. & Collins, L.F. (1997). Ecological validity and forensic neuropsychological assessment. In R.J. McCaffrey, A.D. Williams, J.M. Fisher, & L.C. Laing (Eds.), The Practice of Forensic Neuropsychology: Meeting Challenges in the Courtroom. New York: Plenum Press.
Long, C.J. & Kibby, M.Y. (1995). Ecological validity of neuropsychological tests: A look at neuropsychology's past and the impact that ecological issues may have on its future. Advances in Medical Psychotherapy, 8, 5978.
McCauley, S.R., Pedroza, C., Brown, S., Boake, C., Levin, H.S., Goodman, H.S., & Merritt, S.G. (2006). Confirmatory factor structure of the center for epidemiologic studies-depression scales (CES-D) in mild-to-moderate traumatic brain injury. Brain Injury, 20, 519527.
Parikh, R.M., Eden, D.T., Price, T.R., & Robinson, R.G. (1988). The sensitivity and specificity of the Center for Epidemiologic Studies Depression Scale in screening for post-stroke depression. International Journal of Psychiatry and Medicine, 18, 169181.
Psychological Corporation. (1999). Wechsler Abbreviated Scale of Intelligence. San Antonio, TX: Harcourt Brace & Company.
Radloff, L.S. (1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385401.
Rapoport, M.J., McCullagh, S., Shammi, P., & Feinstein, A. (2005). Cognitive impairment associated with major depression following mild and moderate traumatic brain injury. The Journal of Neuropsychiatry and Clinical Neurosciences, 17, 6165.
Reitan, R.M. & Wolfson, D. (1988). Traumatic brain injury: Recovery and rehabilitation, Vol. 2. Tucson, AZ: Neuropsychology Press.
Reitan, R.M. & Wolfson, D. (1995). Category Test and Trail Making Test as measures of frontal lobe functions. The Clinical Neuropsychologist, 9, 5056.
Rohling, M.L., Green, P., Allen, L.M., & Iverson, G.L. (2002). Depressive symptoms and neurocognitive test scores in patients passing symptom validity tests. Archives of Clinical Neuropsychology, 17, 205222
Satz, P., Forney, D.L., Zaucha, K., Asarnow, R.R., Light, R., McCleary, C., Levin, H., Kelly, D., Bergsneider, M., Hovda, D., Martin, N., Namerow, N., & Becker, D. (1998). Depression, cognition, and functional correlates of recovery outcome after traumatic brain injury. Brain Injury, 12, 537553.
Sbordone, R.J. (1996). Ecological validity: Some critical issues for the neuropsychologist. In R.J. Sbordone & C.J. Long (Eds.), Ecological Validity of Neuropsychological Testing, pp. 1541. Delray Beach, FL: GR Press/St. Lucie Press.
Sbordone, R.J. (1997). The ecological validity of neuropsychological testing. In A.M. Horton, D. Wedding, & J. Webster (Eds.), The Neuropsychology Handbook, Vol. 1, Foundations and Assessment (2nd ed.). New York: Springer Publishing Company.
Sbordone, R.J. & Guilmette, T.J. (1999). Ecological validity: Prediction of everyday and vocational functioning from neuropsychological test data. In J.J. Sweet (Ed.), Forensic neuropsychology: Fundamentals and practice. Lisse, The Netherlands: Swets and Zeitlinger.
Silver, C.H. (2000). Ecological validity of neuropsychological assessment in childhood traumatic brain injury. Journal of Head Trauma Rehabilitation, 15, 973988.
Spreen, O. & Benton, A. (1977). Neurosensory Center Comprehensive Examination for Aphasia. Victoria, B.C., Canada: University of Victoria Neuropsychology Laboratory.
Sunderland, A., Harris, J.E., & Baddeley, A.D. (1983). Do laboratory tests predict everyday memory? A neuropsychological study. Journal of Verbal Learning and Verbal Behavior, 22, 341357.
Temkin, N.R., Anderson, G.D., Winn, H.R., Ellenbogen, R.G., Britz, G.W., Schuster, J., Lucas, T., Newell, D.W., Mansfield, P.N., Machamer, J.E., Barber, J., & Dikmen, S.S. (2007). Magnesium sulfate for neuroprotection after traumatic brain injury: A randomized trial. Lancet Neurology, 1, 2938.
Temkin, N., Machamer, J., & Dikmen, S. (2003). Correlates of functional status 3–5 years after traumatic brain injury with CT abnormalities. Journal of Neurotrauma, 20, 229241.
Veiel, H.O. (1997). A preliminary profile of neuropsychological deficits associated with major depression. Journal of Clinical and Experimental Neuropsychology, 19, 587603.
Wechsler, D. (1997). Wechsler Adult Intelligence Scales—III. San Antonio, TX: Psychological Corporation.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of the International Neuropsychological Society
  • ISSN: 1355-6177
  • EISSN: 1469-7661
  • URL: /core/journals/journal-of-the-international-neuropsychological-society
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Full text views

Total number of HTML views: 3
Total number of PDF views: 63 *
Loading metrics...

Abstract views

Total abstract views: 212 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 23rd January 2018. This data will be updated every 24 hours.