Skip to main content
    • Aa
    • Aa

Impairment versus deficiency in neuropsychological assessment: Implications for ecological validity


Neuropsychological test interpretation has relied on pre- and postmorbid comparisons, as exemplified by the use of demographically adjusted normative data. We argue that, when the assessment goal is to predict real-world functioning, this interpretive method should be supplemented by “absolute” scores. Such scores are derived from comparisons with the general healthy adult population (i.e., demographically unadjusted normative data) and reflect examinees’ current ability, that is, the interaction between premorbid and injury/disease-related factors. In support of this view, we found that substantial discrepancies between demographically adjusted and absolute scores were common in a traumatic brain injury sample, especially in participants with certain demographic profiles. Absolute scores predicted selected measures of functional outcome better than demographically adjusted scores and also classified participants’ functional status more accurately, to the extent that these scores diverged. In conclusion, the ecological validity of neuropsychological tests may be improved by the consideration of absolute scores. (JINS, 2009, 15, 94–102.)

Corresponding author
*Correspondence and reprint requests to: Noah Silverberg, G.F. Strong Rehab Centre, 4255 Laurel Street, Vancouver, British Columbia V5Z 2G9. E-mail:
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

American Academy of Clinical Neuropsychology Board of Directors. (2007). American Academy of Clinical Neuropsychology (AACN) practice guidelines for neuropsychological assessment and consultation. The Clinical Neuropsychologist, 21, 209231.

C Boake . (1996). Supervision Rating Scale: A measure of functional outcome from brain injury. Archives of Physical Medicine and Rehabilitation, 77, 765772.

N. Chaytor & M Schmitter-Edgecombe . (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181197.

N. Chaytor , M. Scmitter-Edgecombe , & R Burr . (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21, 217227.

J.R. Crawford , P.H. Garthwaite , & C.B Gault . (2007). Estimating the percentage of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries: A generic method with applications. Neuropsychology, 21, 419430.

S.F. Crowe , K. Mahony , & M Jackson . (2004). Predicting competency in automated machine use in an acquired brain injury population using neuropsychological measures. Archives of Clinical Neuropsychology, 19, 673691.

S. Gauthier , B. Reisberg , M. Zaudig , R.C. Petersen , K. Ritchie , K. Broich , S. Belleville , H. Brodaty , D. Bennet , H. Chertkow , J.L. Cummings , M. de Leon , H. Feldman , M. Ganguli , H. Hampel , P. Schetlens , M.C. Tierney , P. Whitehouse , B. Windblad , & International Psychogeriatric Association Expert Conference on mild cognitive impairment. (2006). Mild cognitive impairment. Lancet, 367, 12621270.

T.J. Guilmette , L.D. Hagan , & A.J Giuliano . (2008). Assigning qualitative descriptions to test scores in neuropsychology: Forensic implications. The Clinical Neuropsychologist, 22, 122139.

B.J. Hallam , N.D. Silverberg , A.K. Lamarre , I.R. Mackenzie , & H.H Feldman . (2008). Clinical presentation of prodromal frontotemporal dementia. American Journal of Alzheimer’s Disease and Other Dementias, 22, 456467.

R.T. Lange , G.J. Chelune , & D.S Tulsky . (2006). Development of WAIS-III General Ability Index Minus WMS-III memory discrepancy scores. The Clinical Neuropsychologist, 20, 382395.

R.T. Lange , M.R. Schoenberg , G.J. Chelune , J.G. Scott , & R.L Adams . (2005). Developmental of the WAIS-III General Ability Index Estimate (GAI-E). The Clinical Neuropsychologist, 19, 7386.

H.S. Levin , C. Boake , J. Song , S. McCauley , C. Contant , P. Diaz-Marchan , S. Brundage , H. Goodman , & K.J Kotria . (2001). Validity and sensitivity to change of the Extended Glasgow Outcome Scale in mild to moderate traumatic brain injury. Journal of Neurotrauma, 18, 575584.

J.J. Manly & R.J Echemendia . (2007). Race-specific norms: Using the model of hypertension to understand issues of race, culture, and education in neuropsychology. Archives of Clinical Neuropsychology, 22, 319325.

L.S. Miller & M.L Rohling . (2001). A statistical interpretive method for neuropsychological test data. Neuropsychology Review, 11, 143169.

D.B Peterson . (2005). International classification of functioning, disability, and health: An introduction for rehabilitation psychologists. Rehabilitation Psychology, 50, 105112.

R.E. Ready , L. Stierman , & J.S Paulsen . (2001). Ecological validity of neuropsychological and personality measures of executive functions. The Clinical Neuropsychologist, 15, 314323.

R.M. Reitan & D Wolfson . (2005). The effect of age and education transformations and neuropsychological test scores of persons with diffuse or bilateral brain damage. Applied Neuropsychology, 12, 181189.

S. Sherrill-Pattison , J. Donders , & E Thompson . (2000). Influence of demographic variables on neuropsychological test performance after traumatic brain injury. The Clinical Neuropsychologist, 14, 496503.

D.M. Spooner & N.A Pachana . (2006). Ecological validity in neuropsychological assessment: A case for greater consideration in research with neurologically intact populations. Archives of Clinical Neuropsychology, 21, 327337.

B. Steinberg & L Bieliauskas . (2005). Introduction to the special edition: IQ-based MOANS norms for multiple neuropsychological instruments. The Clinical Neuropsychologist, 19, 277279.

H. Tuokko , D.D. Garrett , I. McDowell , N. Silverberg , & B Kristjansson . (2003). Cognitive decline in high-functioning older adults: Reserve or ascertainment bias? Aging and Mental Health, 7, 259270.

H. Tuokko & T.S Woodward . (1996). Development and validation of a demographic correction system for neuropsychological measures used in the Canadian Study of Health and Aging. Journal of Clinical and Experimental Neuropsychology, 18, 479616.

B. van Baalen , E. Odding , M.P. van Woensel , & M.A van Kessel . (2006). Reliability and sensitivity to change of measurement instruments used in a traumatic brain injury population. Clinical Rehabilitation, 20, 686700.

N. Walker , D. Mellick , C.A. Brooks , & G.G Whiteneck . (2003). Measurement participation across impairment groups using the Craig Handicap Assessment Reporting Technique. American Journal of Physical Medicine and Rehabilitation, 82, 936941.

J.M Williams . (1997). The prediction of premorbid memory ability. Archives of Clinical Neuropsychology, 12, 745756.

J.T. Wilson , L.E. Pettigrew , & G.M Teasdale . (1998). Structured interviews for the Glasgow Outcome Scale and the Extended Glasgow Outcome Scale: Guidelines for their use. Journal of Neurotrauma, 15, 573585.

C.L. Yantz , B.E. Gavett , J.K. Lynch , & M.J McCaffrey . (2006). Potential for interpretation disparities of Halstead-Reitan neuropsychological battery performances in a litigating sample. Archives of Clinical Neuropsychology, 21, 809817.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of the International Neuropsychological Society
  • ISSN: 1355-6177
  • EISSN: 1469-7661
  • URL: /core/journals/journal-of-the-international-neuropsychological-society
Please enter your name
Please enter a valid email address
Who would you like to send this to? *



Altmetric attention score

Full text views

Total number of HTML views: 2
Total number of PDF views: 47 *
Loading metrics...

Abstract views

Total abstract views: 146 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 25th May 2017. This data will be updated every 24 hours.