Hostname: page-component-77f85d65b8-lfk5g Total loading time: 0 Render date: 2026-04-14T12:18:36.078Z Has data issue: false hasContentIssue false
  • English
  • Français

Rationale and Design of the National Neuropsychology Network

Published online by Cambridge University Press:  04 March 2021

David W. Loring Open the ORCID record for David W. Loring [Opens in a new window] ,
Russell M. Bauer ,
Lucia Cavanagh ,
Daniel L. Drane ,
Kristen D. Enriquez ,
Steven P. Reise ,
KuoChung Shih ,
Laura Glass Umfleet Open the ORCID record for Laura Glass Umfleet [Opens in a new window] ,
Dustin Wahlstrom  and
Fiona Whelan
...Show all authors
David W. Loring*
Affiliation:
Department of Neurology, Emory University School of Medicine, Atlanta, GA 30329, USA Department of Pediatrics, Emory University School of Medicine, Atlanta, GA 30322, USA
Russell M. Bauer
Affiliation:
Department of Clinical and Health Psychology, University of Florida, Gainesville, FL 32610, USA Brain Rehabilitation Research Center, Malcom Randall VAMC, Gainesville, FL 32610, USA
Lucia Cavanagh
Affiliation:
Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA 90024, USA
Daniel L. Drane
Affiliation:
Department of Neurology, Emory University School of Medicine, Atlanta, GA 30329, USA Department of Pediatrics, Emory University School of Medicine, Atlanta, GA 30322, USA
Kristen D. Enriquez
Affiliation:
Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA 90024, USA
Steven P. Reise
Affiliation:
Department of Psychology, University of California, Los Angeles, CA 90095, USA
KuoChung Shih
Affiliation:
Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA 90024, USA
Laura Glass Umfleet
Affiliation:
Department of Neurology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
Dustin Wahlstrom
Affiliation:
Pearson Clinical Assessment, San Antonio, TX 78259, USA
Fiona Whelan
Affiliation:
Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA 90024, USA
Keith F. Widaman
Affiliation:
Graduate School of Education, University of California, Riverside, CA 92521, USA
Robert M. Bilder
Affiliation:
Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, CA 90024, USA
*
Correspondence and reprint requests to: D.W. Loring, Emory Brain Health Center, 12 Executive Park, Atlanta, GA 30329, USA. E-mail: dloring@emory.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective.

The National Neuropsychology Network (NNN) is a multicenter clinical research initiative funded by the National Institute of Mental Health (NIMH; R01 MH118514) to facilitate neuropsychology’s transition to contemporary psychometric assessment methods with resultant improvement in test validation and assessment efficiency.

Method:

The NNN includes four clinical research sites (Emory University; Medical College of Wisconsin; University of California, Los Angeles (UCLA); University of Florida) and Pearson Clinical Assessment. Pearson Q-interactive (Q-i) is used for data capture for Pearson published tests; web-based data capture tools programmed by UCLA, which serves as the Coordinating Center, are employed for remaining measures.

Results:

NNN is acquiring item-level data from 500–10,000 patients across 47 widely used Neuropsychology (NP) tests and sharing these data via the NIMH Data Archive. Modern psychometric methods (e.g., item response theory) will specify the constructs measured by different tests and determine their positive/negative predictive power regarding diagnostic outcomes and relationships to other clinical, historical, and demographic factors. The Structured History Protocol for NP (SHiP-NP) helps standardize acquisition of relevant history and self-report data.

Conclusions:

NNN is a proof-of-principle collaboration: by addressing logistical challenges, NNN aims to engage other clinics to create a national and ultimately an international network. The mature NNN will provide mechanisms for data aggregation enabling shared analysis and collaborative research. NNN promises ultimately to enable robust diagnostic inferences about neuropsychological test patterns and to promote the validation of novel adaptive assessment strategies that will be more efficient, more precise, and more sensitive to clinical contexts and individual/cultural differences.

Keywords

Collaborative neuropsychologyPsychological testsClinical decision-makingModern psychometric methods

Information

Type
Regular Research
Information
Journal of the International Neuropsychological Society , Volume 28 , Issue 1 , January 2022 , pp. 1 - 11
Copyright
Copyright © INS. Published by Cambridge University Press, 2021

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

Footnotes

*

NNN Study Group Members: Russell M. Bauer, Robert M. Bilder, Lucia Cavanagh, Daniel L. Drane, Kristen Enriquez, Felicia C. Goldstein, Jude Henry. Kelsey C. Hewitt, David W. Loring, Stephen P. Reise, Kuo Chung Shih, Catherine Sugar, Sean Turner, Laura Glass Umfleet, Dustin Wahlstrom, Keith F. Widaman, Patricia Walshaw, Fiona Whelan.

References

REFERENCES

Abel, T.J., Rhone, A.E., Nourski, K.V., Kawasaki, H., Oya, H., Griffiths, T.D., … Tranel, D. (2015). Direct physiologic evidence of a heteromodal convergence region for proper naming in human left anterior temporal lobe. Journal of Neuroscience, 35(4), 1513–1520. doi: 10.1523/jneurosci.3387-14.2015 CrossRefGoogle ScholarPubMed
Barch, D.M., Gotlib, I.H., Bilder, R.M., Pine, D.S., Smoller, J.W., Brown, C.H., … Farber, G.K. (2016). Common measures for National Institute of Mental Health funded research. Biological Psychiatry, 79(12), e91–96. doi: 10.1016/j.biopsych.2015.07.006 CrossRefGoogle ScholarPubMed
Bauer, R.M., Iverson, G.L., Cernich, A.N., Binder, L.M., Ruff, R.M., & Naugle, R.I. (2012). Computerized neuropsychological assessment devices: joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology. The Clinical Neuropsychologist, 26(2), 177–196. doi: 10.1080/13854046.2012.663001 CrossRefGoogle ScholarPubMed
Bilder, R.M., Postal, K.S., Barisa, M., Aase, D.M., Cullum, C.M., Gillaspy, S.R., … Woodhouse, J. (2020a). InterOrganizational Practice Committee Recommendations/Guidance for Teleneuropsychology in Response to the COVID-19 pandemic. Archives of Clinical Neuropsychology, 35(6), 647–659. doi: 10.1093/arclin/acaa046 CrossRefGoogle Scholar
Bilder, R.M., Postal, K.S., Barisa, M., Aase, D.M., Cullum, C.M., Gillaspy, S.R., … Woodhouse, J. (2020b). InterOrganizational practice committee recommendations/guidance for Teleneuropsychology (TeleNP) in response to the COVID-19 pandemic. The Clinical Neuropsychologist, 34(7–8), 1314–1334. doi: 10.1080/13854046.2020.1767214 CrossRefGoogle ScholarPubMed
Bilder, R.M., & Reise, S.P. (2019). Neuropsychological tests of the future: How do we get there from here? The Clinical Neuropsychologist, 33(2), 220–245. doi: 10.1080/13854046.2018.1521993 CrossRefGoogle Scholar
Boake, C. (2000). Edouard Claparède and the Auditory Verbal Learning Test. Journal of Clinical and Experimental Neuropsychology, 22(2), 286–292. doi: 10.1076/1380-3395(200004)22:2;1-1;FT286 CrossRefGoogle ScholarPubMed
Brzezińska, A., Bourke, J., Rivera-Hernández, R., Tsolaki, M., Woźniak, J., & Kaźmierski, J. (2020). Depression in dementia or dementia in depression? Systematic review of studies and hypotheses. Current Alzheimer Research, 17(1), 16–28. doi: 10.2174/1567205017666200217104114 CrossRefGoogle ScholarPubMed
Busch, R.M., Frazier, T.W., Iampietro, M.C., Chapin, J.S., & Kubu, C.S. (2008). Clinical utility of the Boston Naming Test in predicting ultimate side of surgery in patients with medically intractable temporal lobe epilepsy: A double cross-validation study. Epilepsia, 17, 17.Google Scholar
Cella, D., Lai, J.S., Nowinski, C.J., Victorson, D., Peterman, A., Miller, D., … Moy, C. (2012). Neuro-QOL: brief measures of health-related quality of life for clinical research in neurology. Neurology, 78(23), 1860–1867. doi: 10.1212/WNL.0b013e318258f744 CrossRefGoogle ScholarPubMed
Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: a review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4), 181–197.CrossRefGoogle ScholarPubMed
Choi, S.W., Reise, S.P., Pilkonis, P.A., Hays, R.D., & Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research, 19(1), 125–136. doi: 10.1007/s11136-009-9560-5 CrossRefGoogle ScholarPubMed
Curtiz, Z. (Director). (1942). Casablanca [film]. Warner Bros. Pictures.Google Scholar
Cuthbert, B.N. (2020). The role of RDoC in future classification of mental disorders’. Dialogues Clin Neurosci. 22(1):81–85. doi: 10.31887/DCNS.2020.22.1/bcuthbert.Google Scholar
Cuthbert, B.N., & Insel, T.R. (2013). Toward the future of psychiatric diagnosis: the seven pillars of RDoC. BMC medicine, 11(1), 126.CrossRefGoogle ScholarPubMed
Drane, D.L., Ojemann, J.G., Phatak, V., Loring, D.W., Gross, R.E., Hebb, A.O., … Tranel, D. (2013). Famous face identification in temporal lobe epilepsy: Support for a multimodal integration model of semantic memory. Cortex, 49(6), 1648–1667. doi: 10.1016/j.cortex.2012.08.009 CrossRefGoogle ScholarPubMed
Drane, D.L., & Pedersen, N.P. (2019). Knowledge of language function and underlying neural networks gained from focal seizures and epilepsy surgery. Brain & Language, 189, 20–33. doi: 10.1016/j.bandl.2018.12.007 CrossRefGoogle ScholarPubMed
Duff, K., Suhrie, K.R., Dalley, B.C. A., Anderson, J.S., & Hoffman, J.M. (2019). External validation of change formulae in neuropsychology with neuroimaging biomarkers: A methodological recommendation and preliminary clinical data. The Clinical Neuropsychologist, 33(3), 478–489. doi: 10.1080/13854046.2018.1484518 CrossRefGoogle ScholarPubMed
Fox, P.T., & Friston, K.J. (2012). Distributed processing; distributed functions? Neuroimage, 61(2), 407–426. doi: 10.1016/j.neuroimage.2011.12.051 CrossRefGoogle ScholarPubMed
Gibbons, R.D., Weiss, D.J., Kupfer, D.J., Frank, E., Fagiolini, A., Grochocinski, V.J., … Immekus, J.C. (2008). Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services, 59(4), 361–368. doi: 10.1176/ps.2008.59.4.361 CrossRefGoogle ScholarPubMed
Gonzalez-Castillo, J., & Bandettini, P.A. (2015). What cascade spreading models can teach us about the Brain. Neuron, 86(6), 1327–1329. doi: 10.1016/j.neuron.2015.06.006 CrossRefGoogle ScholarPubMed
Grinnon, S.T., Miller, K., Marler, J.R., Lu, Y., Stout, A., Odenkirchen, J., & Kunitz, S. (2012). National institute of neurological disorders and stroke common data element project: Approach and methods. Clincal Trials, 9(3), 322–329. doi: 10.1177/1740774512438980 CrossRefGoogle ScholarPubMed
Hamilton, C.M., Strader, L.C., Pratt, J.G., Maiese, D., Hendershot, T., Kwok, R.K., … Haines, J. (2011). The PhenX Toolkit: Get the most from your measures. American Journal of Epidemiology, 174(3), 253–260. doi: 10.1093/aje/kwr193 CrossRefGoogle ScholarPubMed
Hermann, B., Loring, D.W., & Wilson, S. (2017). Paradigm shifts in the neuropsychology of epilepsy. Journal of the International Neuropsychological Society, 23(9-10), 791–805. doi: 10.1017/S1355617717000650 CrossRefGoogle ScholarPubMed
Hewitt, K.C., Rodgin, S., Loring, D.W., Pritchard, A.E., & Jacobson, L.A. (2020). Transitioning to telehealth neuropsychology service: Considerations across adult and pediatric care settings. The Clinical Neuropsychologist, 1–17. doi: 10.1080/13854046.2020.1811891 Google ScholarPubMed
Hoogland, J., van Wanrooij, L.L., Boel, J.A., Goldman, J.G., Stebbins, G.T., Dalrymple-Alford, J.C., … Weintraub, D. (2018). Detecting mild cognitive deficits in Parkinson’s Disease: Comparison of neuropsychological tests. Movement Disorders, 33(11), 1750–1759. doi: 10.1002/mds.110 CrossRefGoogle ScholarPubMed
Kotov, R., Krueger, R.F., Watson, D., Achenbach, T.M., Althoff, R.R., Bagby, R.M., Brown, T.A., Carpenter, W.T., Caspi, A., Clark, L.A., Eaton, N.R., Forbes, M.K., Forbush, K.T., Goldberg, D., Hasin, D., Hyman, S.E., Ivanova, M.Y., Lynam, D.R., Markon, K., Miller, J.D., … Zimmerman, M. (2017). The Hierarchical Taxonomy of Psychopathology (HiTOP): A dimensional alternative to traditional nosologies. Journal of abnormal psychology, 126(4), 454–477. doi: 10.1037/abn0000258 CrossRefGoogle ScholarPubMed
Lavoie, K., & Bacon, S. for the iCARE Study Team (2020). iCARE Study Questionnaire.Google Scholar
Lopez-Anton, R., Santabárbara, J., De-la-Cámara, C., Gracia-García, P., Lobo, E., Marcos, G., … Lobo, A. (2015). Mild cognitive impairment diagnosed with the new DSM-5 criteria: Prevalence and associations with non-cognitive psychopathology. Acta Psychiatrica Scandinavica, 131(1), 29–39. doi: 10.1111/acps.12297 CrossRefGoogle ScholarPubMed
Loring, D.W. (2010). History of neuropsychology through epilepsy eyes. Archives of Clinical Neuropsychology, 25(4), 259–273. doi: 10.1093/arclin/acq024.CrossRefGoogle ScholarPubMed
Loring, D.W., Strauss, E., Hermann, B.P., Perrine, K., Trenerry, M.R., Barr, W.B., Westerveld, M., Chelune, G.J., Lee, G.P., & Meador, K.J. (1999). Effects of anomalous language representation on neuropsychological performance in temporal lobe epilepsy. Neurology, 53(2), 260–264. https://doi.org/10.1212/wnl.53.2.260 CrossRefGoogle ScholarPubMed
Mansolf, M., Vreeker, A., Reise, S.P., Freimer, N.B., Glahn, D.C., Gur, R.E., … GROUP Investigators; WGSPD Consortium (2020). Extensions of multiple-group item response theory alignment: Application to psychiatric phenotypes in an international genomics consortium. Educational and Psychological Measurement, 80(5), 870–909.CrossRefGoogle Scholar
Marcopulos, B., & Lojek, E. (2019). Introduction to the special issue: Are modern neuropsychological assessment methods really “modern?” Reflections on the current neuropsychological test armamentarium. The Clinical Neuropsychologist, 33(2), 187–199. doi: 10.1080/13854046.2018.1560502 CrossRefGoogle Scholar
Mella, N., Vallet, F., Beaudoin, M., Fagot, D., Baeriswyl, M., Ballhausen, N., … Desrichard, O. (2020). Distinct effects of cognitive versus somatic anxiety on cognitive performance in old age: The role of working memory capacity. Aging and Mental Health, 24(4), 604–610. doi: 10.1080/13607863.2018.1548566 CrossRefGoogle ScholarPubMed
Moore, T.M., Scott, J.C., Reise, S.P., Port, A.M., Jackson, C.T., Ruparel, K., … Gur, R.C. (2015). Development of an abbreviated form of the Penn Line Orientation Test using large samples and computerized adaptive test simulation. Psychological Assessment, 27(3), 955–964. doi: 10.1037/pas0000102 CrossRefGoogle ScholarPubMed
Norman, M., Wilson, S.J., Baxendale, S., Barr, W.B., Block, C., Busch, R.M., … Hermann, B.P. (2021). Addressing neuropsychological disorders in adults with epilepsy: The International League Against Epilepsy (ILAE)/International Neuropsychological Society (INS) initiative. Epilepsia Open. doi: 10.1002/epi4.12478 CrossRefGoogle Scholar
Pawlowski, J., Segabinazi, J.D., Wagner, F., & Bandeira, D.R. (2013). A systematic review of validity procedures used in neuropsychological batteries. Psychology & Neuroscience, 6, 311–329.CrossRefGoogle Scholar
Postal, K.S., Bilder, R.M., Lanca, M., Aase, D.M., Barisa, M., Holland, A.A., … Salinas, C. (2020). Inter Organizational Practice Committee guidance/recommendation for models of care during the novel coronavirus pandemic. Archives of Clinical Neuropsychology. doi: 10.1093/arclin/acaa073 Google ScholarPubMed
Rabin, L.A., Paolillo, E., & Barr, W.B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: A follow-up survey of INS and NAN members. Archives of Clinical Neuropsychology, 31(3), 206–230. doi: 10.1093/arclin/acw007 CrossRefGoogle Scholar
Raspall, T., Donate, M., Boget, T., Carreno, M., Donaire, A., Agudo, R., … Salamero, M. (2005). Neuropsychological tests with lateralizing value in patients with temporal lobe epilepsy: Reconsidering material-specific theory. Seizure, 14(8), 569–576. doi: 10.1016/j.seizure.2005.09.007 CrossRefGoogle ScholarPubMed
Reise, S.P., Widaman, K., Bauer, R.M., Drane, D.L., Loring, D.W., Umfleet, L.G., … Bilder, R.M. (2021). Item response theory analyses of Matrix Reasoning: Towards a new short form or adaptive Test? Paper presented at the Annual Meeting of the International Neuropsychological Society, San Diego, CA.Google Scholar
Strauss, E., Satz, P., & Wada, J. (1990). An examination of the crowding hypothesis in epileptic patients who have undergone the carotid amytal test. Neuropsychologia, 28(11), 1221–1227.CrossRefGoogle ScholarPubMed
Teng, E.L., & Manly, J.J. (2005). Neuropsychological testing: helpful or harmful? Alzheimer Disease and Associated Disorders, 19(4), 267–271.CrossRefGoogle ScholarPubMed
Zahodne, L.B., Manly, J.J., Smith, J., Seeman, T., & Lachman, M.E. (2017). Socioeconomic, health, and psychosocial mediators of racial disparities in cognition in early, middle, and late adulthood. Psychology & Aging, 32(2), 118–130. doi: 10.1037/pag0000154 CrossRefGoogle ScholarPubMed
Supplementary material: File

Loring et al. supplementary material

Loring et al. supplementary material 1

Download Loring et al. supplementary material(File)
File 66.4 KB
Supplementary material: File

Loring et al. supplementary material

Loring et al. supplementary material 2

Download Loring et al. supplementary material(File)
File 14.6 KB
Supplementary material: File

Loring et al. supplementary material

Loring et al. supplementary material 3

Download Loring et al. supplementary material(File)
File 205.9 KB
Supplementary material: File

Loring et al. supplementary material

Loring et al. supplementary material 4

Download Loring et al. supplementary material(File)
File 19.8 KB