Skip to main content
    • Aa
    • Aa

NIH EXAMINER: Conceptualization and Development of an Executive Function Battery

  • Joel H. Kramer (a1), Dan Mungas (a2), Katherine L. Possin (a1), Katherine P. Rankin (a1), Adam L. Boxer (a1), Howard J. Rosen (a1), Alan Bostrom (a1), Lena Sinha (a1), Ashley Berhel (a1) and Mary Widmeyer (a3)...

Executive functioning is widely targeted when human cognition is assessed, but there is little consensus on how it should be operationalized and measured. Recognizing the difficulties associated with establishing standard operational definitions of executive functioning, the National Institute of Neurological Disorders and Stroke entered into a contract with the University of California-San Francisco to develop psychometrically robust executive measurement tools that would be accepted by the neurology clinical trials and clinical research communities. This effort, entitled Executive Abilities: Measures and Instruments for Neurobehavioral Evaluation and Research (EXAMINER), resulted in a series of tasks targeting working memory, inhibition, set shifting, fluency, insight, planning, social cognition and behavior. We describe battery conceptualization and development, data collection, scale construction based on item response theory, and lay the foundation for studying the battery's utility and validity for specific assessment and research goals. (JINS, 2013, 19, 1–9)

Corresponding author
Correspondence and reprint requests to: Joel H. Kramer, 675 Nelson Rising Lane, Suite 190, MC 1207, San Francisco, CA 94158. E-mail:
Hide All
AmievaH., PhillipsL., Della SalaS. (2003). Behavioral dysexecutive symptoms in normal aging. Brain and Cognition, 53(2), 129132.
ArnettP.A., RaoS.M., GrafmanJ., BernardinL., LuchettaT., BinderJ.R., LobeckL. (1997). Executive functions in multiple sclerosis: An analysis of temporal ordering, semantic encoding, and planning abilities. Neuropsychology, 11(4), 535544.
AronA.R., WatkinsL., SahakianB.J., MonsellS., BarkerR.A., RobbinsT.W. (2003). Task-set switching deficits in early-stage Huntington's disease: Implications for basal ganglia function. Journal of Cognitive Neuroscience, 15(5), 629642.
AsimakopulosJ., BoychuckZ., SondergaardD., PoulinV., MenardI., Korner-BitenskyN. (2012). Assessing executive function in relation to fitness to drive: a review of tools and their ability to predict safe driving. Australian Occupational Therapy Journal, 59(6), 402427. doi:10.1111/j.1440-1630.2011.00963
BarkleyR.A. (2010). Differential diagnosis of adults with ADHD: The role of executive function and self-regulation. Journal of Clinical Psychiatry, 71(7), e17. doi:10.4088/JCP.9066tx1c
BooneK.B., MillerB.L., LeeA., BermanN., ShermanD., StussD.T. (1999). Neuropsychological patterns in right versus left frontotemporal dementia. Journal of International Neuropsychological Society, 5(7), 616622.
BucknerR.L. (2004). Memory and executive function in aging and AD: Multiple factors that cause decline and reserve factors that compensate. Neuron, 44(1), 195208.
CaeyenberghsK., LeemansA., LeunissenI., GooijersJ., MichielsK., SunaertS., SwinnenS.P. (2012). Altered structural networks and executive deficits in traumatic brain injury patients. Brain Structure and Function. doi:10.1007/s00429-012-0494-2
Cahn-WeinerD.A., BoyleP.A., MalloyP.F. (2002). Tests of executive function predict instrumental activities of daily living in community-dwelling older individuals. Applied Neuropsychology, 9(3), 187191.
Cambridge-Cognition. (1996). CANTAB® . Cambridge: Cambridge Cognition Limited.
CaseR., KurlandM.D., GoldbergJ. (1982). Operational efficiency and the growth of short-term memory span. Journal of Experimental Child Psychology, 33, 386404.
ChiaravallotiN.D., DeLucaJ. (2003). Assessing the behavioral consequences of multiple sclerosis: An application of the Frontal Systems Behavior Scale (FrSBe). Cognitive and Behavioral Neurology, 16(1), 5467.
ConwayA.R., KaneM.J., BuntingM.F., HambrickD.Z., WilhelmO., EngleR.W. (2005). Working memory span tasks: A methodological review and user's guide. Psychonomic Bulletin Review, 12(5), 769786.
DelisD.C., KaplanE., KramerJ.H. (2001). Delis-Kaplan Executive Function System. San Antonio: The Psychological Corporation.
FloresJ., OstroskyF., LozanoA. (2008). Batería Neuropsicológica de Funciones Ejecutivas y Lóbulos Frontales (Battery of Executive Functions and Frontal Lobe, Spanish) San Antonio: Pearson, Inc.
FoongJ., RozewiczL., QuaghebeurG., DavieC.A., KartsounisL.D., ThompsonA.J., RonM.A. (1997). Executive function in multiple sclerosis. The role of frontal lobe pathology. Brain, 120(Pt 1), 1526.
GersteneckerA., MastB., DuffK., FermanT.J., LitvanI. (2013). Executive dysfunction is the primary cognitive impairment in progressive supranuclear palsy. Archives of Clinical Neuropsychology, 28(2), 104113. doi:10.1093/arclin/acs098
GioiaG.A., IsquithP.K., GuyS.C., KenworthyL. (2000). Behavior rating inventory of executive function. Child Neuropsychology, 6(3), 235238. doi:10.1093/arclin/acs098
GriffinS.L., MindtM.R., RankinE.J., RitchieA.J., ScottJ.G. (2002). Estimating premorbid intelligence: Comparison of traditional and contemporary methods across the intelligence continuum. Archives of Clinical Neuropsychology, 17(5), 497507. doi:S0887617701001366 [pii]
HambletonR.K., SwaminathanH., RogersH.J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
HellmuthJ., MirskyJ., HeuerH.W., MatlinA., JafariA., GarbuttS., BoxerA.L. (2012). Multicenter validation of a bedside antisaccade task as a measure of executive function. Neurology, 78(23), 18241831. doi:10.1212/WNL.0b013e318258f785
HutchinsonA.D., MathiasJ.L. (2007). Neuropsychological deficits in frontotemporal dementia and Alzheimer's disease: A meta-analytic review. Journal of Neurology, Neurosurgery, and Psychiatry, 78(9), 917928. doi:10.1136/jnnp.2006.100669
KramerJ.H., JurikJ., ShaS.J., RankinK.P., RosenH.J., JohnsonJ.K., MillerB.L. (2003). Distinctive neuropsychological patterns in frontotemporal dementia, semantic dementia, and Alzheimer disease. Cognitive and Behavioral Neurology, 16(4), 211218.
KrayJ., LindenbergerU. (2000). Adult age differences in task switching. Psychology of Aging, 15(1), 126147.
KruegerC.E., BirdA.C., GrowdonM.E., JangJ.Y., MillerB.L., KramerJ.H. (2009). Conflict monitoring in early frontotemporal dementia. Neurology, 73(5), 349355. doi:10.1212/WNL.0b013e3181b04b24
KruegerC.E., RosenH.J., TaylorH.G., EspyK.A., SchatzJ., Rey-CasserlyC., KramerJ.H. (2011). Know thyself: Real-world behavioral correlates of self-appraisal accuracy. Clinical Neuropsychologist, 25(5), 741756. doi:10.1080/13854046.2011.569759
LevinH.S., HantenG. (2005). Executive functions after traumatic brain injury in children. Pediatric Neurology, 33(2), 7993.
LezakM.D. (2004). Neuropsychological assessment (4th ed.). New York, NY, USA.
LuksT.L., OliveiraM., PossinK.L., BirdA., MillerB.L., WeinerM.W., KramerJ.H. (2010). Atrophy in two attention networks is associated with performance on a Flanker task in neurodegenerative disease. Neuropsychologia, 48(1), 165170. doi:10.1016/j.neuropsychologia.2009.09.001
MalloyP., GraceJ. (2005). A review of rating scales for measuring behavior change due to frontal systems damage. Cognitive and Behavioral Neurology, 18(1), 1827.
MirskyJ.B., HeuerH.W., JafariA., KramerJ.H., SchenkA.K., ViskontasI.V., BoxerA.L. (2011). Anti-saccade performance predicts executive function and brain structure in normal elders. Cognitive and Behavioral Neurology, 24(2), 5058. doi:10.1097/WNN.0b013e318223f6c6
MiyakeA., FriedmanN.P., EmersonM.J., WitzkiA.H., HowerterA., WagerT.D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49100.
MonsellS. (2003). Task switching. Trends in Cognitive Science, 7(3), 134140. doi:S1364661303000287 [pii]
MoorhouseP., SongX., RockwoodK., BlackS., KerteszA., GauthierS., FeldmanH. (2010). Executive dysfunction in vascular cognitive impairment in the consortium to investigate vascular impairment of cognition study. Journal of Neurological Science, 288(1-2), 142146. doi:10.1016/j.jns.2009.09.017
MungasD., ReedB.R., KramerJ.H. (2003). Psychometrically matched measures of global cognition, memory, and executive function for assessment of cognitive decline in older persons. Neuropsychology, 17(3), 380392.
MunozD.P., EverlingS. (2004). Look away: The anti-saccade task and the voluntary control of eye movement. Nature Reviews: Neuroscience, 5(3), 218228.
OwenA.M., McMillanK.M., LairdA.R., BullmoreE. (2005). N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human Brain Mapping, 25(1), 4659. doi:10.1002/hbm.20131
PaulsenJ.S. (2011). Cognitive impairment in Huntington disease: Diagnosis and treatment. Current Neurology and Neuroscience Reports, 11(5), 474483. doi:10.1007/s11910-011-0215-x
PetersM., GiesbrechtT., JelicicM., MerckelbachH. (2007). The random number generation task: Psychometric properties and normative data of an executive function task in a mixed sample. Journal of International Neuropsychological Society, 13(4), 626634. doi:S1355617707070786
PossinK.L., FeigenbaumD., RankinK.P., SmithG.E., BoxerA.L., WoodK., KramerJ.H. (2013). Dissociable executive functions in behavioral variant frontotemporal and Alzheimer dementias. Neurology, 80(24), 21802185.
Psychology Software Tools, I. (2009). E-Prime 2. Sharpsburg, PA.
RavizzaS.M., CiranniM.A. (2002). Contributions of the prefrontal cortex and basal ganglia to set shifting. Journal of Cognitive Neuroscience, 14(3), 472483.
ReedB.R., EberlingJ.L., MungasD., WeinerM., KramerJ.H., JagustW.J. (2004). Effects of white matter lesions and lacunes on cortical function. Archives of Neurology, 61(10), 15451550.
ReitanR.M., WolfsonD. (1985). The Halstead–Reitan Neuropsychological Test Battery. Tucson: Neuropsychology Press.
SchenkA., BerhelA., VerdeS., WidmeyerM., KramerJ.H. (2008). Assessing the mental rigidity of FTD patients using a random number generation task [Abstract]. Journal of the International Neuropsychological Society, 14(S1), 266.
ShalliceT., BurgessP.W. (1991). Deficits in strategy application following frontal lobe damage in men. Brain, 114, 727741.
Shany-UrT., RankinK.P. (2011). Personality and social cognition in neurodegenerative disease. Current Opinion in Neurology, 24(6), 550555.
SlachevskyA., VillalpandoJ.M., SarazinM., Hahn-BarmaV., PillonB., DuboisB. (2004). Frontal assessment battery and differential diagnosis of frontotemporal dementia and Alzheimer disease. Archives of Neurology, 61(7), 11041107.
StussD.T. (2011). Traumatic brain injury: Relation to executive dysfunction and the frontal lobes. Current Opinion in Neurology, 24(6), 584589. doi:10.1097/WCO.0b013e32834c7eb9
StussD.T., FlodenD., AlexanderM.P., LevineB., KatzD. (2001). Stroop performance in focal lesion patients: Dissociation of processes and frontal lobe lesion location. Neuropsychologia, 39(8), 771786.
WeintraubS., DikmenS.S., HeatonR.K., TulskyD.S., ZelazoP.D., BauerP.J., GershonR.C. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80(11 Suppl. 3), S54S64. doi:10.1212/WNL.0b013e3182872ded
WilsonB., AldermanN., BurgessP.W., EmslieH., EvansJ.J. (1996). Behavioural Assessment of the Dysexecutive Syndrome. Bury St. Edmunds: Thames Valley Test Company.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Journal of the International Neuropsychological Society
  • ISSN: 1355-6177
  • EISSN: 1469-7661
  • URL: /core/journals/journal-of-the-international-neuropsychological-society
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary Materials

Kramer Supplementary Material
Supplementary Materials

 Word (30 KB)
30 KB


Altmetric attention score

Full text views

Total number of HTML views: 16
Total number of PDF views: 114 *
Loading metrics...

Abstract views

Total abstract views: 448 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 24th October 2017. This data will be updated every 24 hours.