Hostname: page-component-8678677fb7-h96qj Total loading time: 0 Render date: 2026-10-12T11:55:19.937Z Has data issue: false hasContentIssue false
  • English
  • Français

Concurrent validity and reliability of at-home teleneuropsychological evaluations among people with and without HIV

Published online by Cambridge University Press:  13 December 2022

Maulika Kohli Open the ORCID record for Maulika Kohli [Opens in a new window] ,
Arin Fisher ,
Ni Sun-Suslow ,
Anne Heaton ,
Matthew S. Dawson ,
Jennifer Marquie ,
Donald R. Franklin ,
Maria Marquine ,
Jennifer E. Iudicello  and
Robert K. Heaton
...Show all authors
Maulika Kohli
Affiliation:
San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, USA HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA
Arin Fisher
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA
Ni Sun-Suslow
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA
Anne Heaton
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA
Matthew S. Dawson
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA
Jennifer Marquie
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA
Donald R. Franklin
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA
Maria Marquine
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA Department of Psychiatry, University of California San Diego, San Diego, CA, USA
Jennifer E. Iudicello
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA Department of Psychiatry, University of California San Diego, San Diego, CA, USA
Robert K. Heaton
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA Department of Psychiatry, University of California San Diego, San Diego, CA, USA
David J. Moore*
Affiliation:
HIV Neurobehavioral Research Program, University of California San Diego, San Diego, CA, USA Department of Psychiatry, University of California San Diego, San Diego, CA, USA
*
Corresponding author: David J. Moore, email: djmoore@health.ucsd.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Objective:

To determine the reliability of teleneuropsychological (TNP) compared to in-person assessments (IPA) in people with HIV (PWH) and without HIV (HIV−).

Methods:

Participants included 80 PWH (Mage = 58.7, SDage = 11.0) and 23 HIV− (Mage = 61.9, SDage = 16.7). Participants completed two comprehensive neuropsychological IPA before one TNP during the COVID-19 pandemic (March–December 2020). The neuropsychological tests included: Hopkins Verbal Learning Test-Revised (HVLT-R Total and Delayed Recall), Controlled Oral Word Association Test (COWAT; FAS-English or PMR-Spanish), Animal Fluency, Action (Verb) Fluency, Wechsler Adult Intelligence Scale 3rd Edition (WAIS-III) Symbol Search and Letter Number Sequencing, Stroop Color and Word Test, Paced Auditory Serial Addition Test (Channel 1), and Boston Naming Test. Total raw scores and sub-scores were used in analyses. In the total sample and by HIV status, test-retest reliability and performance-level differences were evaluated between the two consecutive IPA (i.e., IPA1 and IPA2), and mean in-person scores (IPA-M), and TNP.

Results:

There were statistically significant test-retest correlations between IPA1 and IPA2 (r or ρ = .603–.883, ps < .001), and between IPA-M and TNP (r or ρ = .622–.958, ps < .001). In the total sample, significantly lower test-retest scores were found between IPA-M and TNP on the COWAT (PMR), Stroop Color and Word Test, WAIS-III Letter Number Sequencing, and HVLT-R Total Recall (ps < .05). Results were similar in PWH only.

Conclusions:

This study demonstrates reliability of TNP in PWH and HIV−. TNP assessments are a promising way to improve access to traditional neuropsychological services and maintain ongoing clinical research studies during the COVID-19 pandemic.

Keywords

human immunodeficiency virusCOVID-19validation studyneuropsychologycognitiontelehealth

Information

Type
Research Article
Information
Journal of the International Neuropsychological Society , Volume 29 , Issue 2 , February 2023 , pp. 193 - 204
Copyright
Copyright © INS. Published by Cambridge University Press, 2022

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Antinori, A., Arendt, G., Becker, J., Brew, B., Byrd, D., Cherner, M., Clifford, D. B., Cinque, Q., Epstein, L. G., Goodkin, K., Gisslen, M., Grant, I., Heaton, R. K., Joseph, J., Marder, K., Marra, C. M., McArthur, J. C., Nunn, M., Price, R. W., …Wojna, V. E. (2007). Updated research nosology for HIV-associated neurocognitive disorders. Neurology, 69(18), 1789–1799.CrossRefGoogle ScholarPubMed
Barcellos, L. F., Horton, M., Shao, X., Bellesis, K. H., Chinn, T., Waubant, E., & Schaefer, C. (2021). A validation study for remote testing of cognitive function in multiple sclerosis. Multiple Sclerosis Journal, 27(5), 795–798.CrossRefGoogle ScholarPubMed
Becker, J. T., Caldararo, R., Lopez, O. L., Dew, M. A., Dorst, S. K., & Banks, G. (1995). Qualitative features of the memory deficit associated with HIV infection and AIDS: cross-validation of a discriminant function classification scheme. Journal of Clinical and Experimental Neuropsychology, 17(1), 134–142. https://doi.org/10.1080/13803399508406588 CrossRefGoogle ScholarPubMed
Benedict, R. H. B., Schretlen, D., Groninger, L., & Brandt, J. (1998). Hopkins verbal learning test – revised: Normative data and analysis of inter-form and test-retest reliability. The Clinical Neuropsychologist, 12(1), 43–55. https://doi.org/10.1076/clin.12.1.43.1726 CrossRefGoogle Scholar
Bilder, R. M., Postal, K. S., Barisa, M., Aase, D. M., Cullum, C. M., Gillaspy, S. R., Harder, L., Kanter, G., Lanca, M., Lechuga, D. M., Morgan, J. M., Most, R., Puente, A. E., Salinas, C. M., & Woodhouse, J. (2020). Inter organizational practice committee recommendations/Guidance for teleneuropsychology in response to the COVID-19 pandemic. Archives of Clinical Neuropsychology, 35(6), 647–659.CrossRefGoogle ScholarPubMed
Blackstone, K., Moore, D., Heaton, R., Franklin, D. R. Jr., Woods, S. P., Clifford, D. B., Collier, A. C., Marra, C. M., Gelman, B. B., McArthur, J. C., Morgello, S., Simpson, D. M., Rivera-Mindt, M., Deutsch, R., Ellis, R. J., Hampton Atkinson, J., & Grant, I. (2012). Diagnosing symptomatic HIV-associated neurocognitive disorders: Self-report versus performance-based assessment of everyday functioning. Journal of the International Neuropsychological Society, 18(1), 79–88.CrossRefGoogle ScholarPubMed
Bloem, B. R., Dorsey, E. R., & Okun, M. S. (2020). The coronavirus disease 2019 crisis as catalyst for telemedicine for chronic neurological disorders. JAMA Neurology, 77(8), 927–928.CrossRefGoogle ScholarPubMed
Borkowski, J. G., Benton, A. L., & Spreen, O. (1967). Word fluency and brain damage. Neuropsychologia, 5(2), 135–140. https://doi.org/10.1016/0028-3932(67)90015-2 CrossRefGoogle Scholar
Brearly, T. W., Shura, R. D., Martindale, S. L., Lazowski, R. A., Luxton, D. D., Shenal, B. V., & Rowland, J. A. (2017). Neuropsychological test administration by videoconference: A systematic review and meta-analysis. Neuropsychology Review, 27(2), 174–186. https://doi.org/10.1007/s11065-017-9349-1 CrossRefGoogle ScholarPubMed
Carey, C. L., Woods, S. P., Gonzalez, R., Conover, E., Marcotte, T. D., Grant, I., & Heaton, R. K. (2004). Predictive validity of global deficit scores in detecting neuropsychological impairment in HIV infection. Journal of Clinical and Experimental Neuropsychology, 26(3), 307–319. https://doi.org/10.1080/13803390490510031 CrossRefGoogle ScholarPubMed
Chapman, J. E., Gardner, B., Ponsford, J., Cadilhac, D. A., & Stolwyk, R. J. (2020). Comparing performance across in-person and videoconference-based administrations of common neuropsychological measures in community-based survivors of stroke. Journal of the International Neuropsychological Society, 27(7), 697–710.CrossRefGoogle ScholarPubMed
Cherner, M., Marquine, M. J., Umlauf, A., Morlett Paredes, A., Rivera Mindt, M., Suárez, P., Yassai-Gonzalez, D., Kamalyan, L., Scott, T., Heaton, A., Diaz-Santos, M., Gooding, A., Artiola i Fortuny, L., & Heaton, R. K. (2021). Neuropsychological norms for the US-Mexico border region in Spanish (NP-NUMBRS) project: Methodology and sample characteristics. The Clinical Neuropsychologist, 35(2), 253–268.CrossRefGoogle Scholar
Cooper, T., Woodward, B., Alom, S., & Harky, A. (2020). Coronavirus disease 2019 (COVID-19) outcomes in HIV/AIDS patients: A systematic review. HIV Medicine, 21(9), 567–577.CrossRefGoogle ScholarPubMed
Cullum, C. M., Hynan, L. S., Grosch, M., Parikh, M., & Weiner, M. F. (2014). Teleneuropsychology: Evidence for video teleconference-based neuropsychological assessment. Journal of the International Neuropsychological Society, 20(10), 1028–1033. https://doi.org/10.1017/S1355617714000873 CrossRefGoogle Scholar
Díaz-Santos, M., Suárez, P. A., Marquine, M. J., Umlauf, A., Rivera Mindt, M., Artiola i Fortuny, L., Heaton, R. K., & Cherner, M. (2021). Updated demographically adjusted norms for the Brief Visuospatial Memory Test-revised and Hopkins Verbal Learning Test-revised in Spanish-speakers from the U.S.-Mexico border region: The NP-NUMBRS project. Clinical Neuropsychologist, 35(2), 374–395. https://doi.org/10.1080/13854046.2020.1861329 CrossRefGoogle ScholarPubMed
Diehr, M. C., Heaton, R. K., Miller, W., & Grant, I. (1998). The Paced Auditory Serial Addition Task (PASAT): Norms for age, education, and ethnicity. Assessment, 5(4), 375–387. https://doi.org/10.1177/107319119800500407 CrossRefGoogle ScholarPubMed
Dikmen, S. S., Heaton, R. K., Grant, I., & Temkin, N. R. (1999). Test-retest reliability and practice effects of expanded Halstead-Reitan Neuropsychological Test Battery. Journal of the International Neuropsychological Society, 5(4), 346–356.CrossRefGoogle ScholarPubMed
Fusco, F. M., Sangiovanni, V., Tiberio, C., Papa, N., Atripaldi, L., & Esposito, V. (2020). Persons living with HIV may be reluctant to access to COVID-19 testing services: Data from ‘D. Cotugno’ Hospital, Naples, Southern Italy. Aids, 34(14), 2151–2152.CrossRefGoogle Scholar
Gajarawala, S. N., & Pelkowski, J. N. (2021). Telehealth benefits and barriers. The Journal for Nurse Practitioners, 17(2), 218–221.CrossRefGoogle ScholarPubMed
Gardner, M. M., Aslanzadeh, F. J., Zarrella, G. V., Braun, S. E., Loughan, A. R., & Parsons, M. W. (2021). Cancer, cognition, and COVID: Delivering direct-to-home tele-neuropsychology services to neuro-oncology patients. Neuro-Oncology Practice, 8(4), 485–496.CrossRefGoogle Scholar
Germine, L., Reinecke, K., & Chaytor, N. S. (2019). Digital neuropsychology: Challenges and opportunities at the intersection of science and software. Clinical Neuropsychologist, 33(2), 271–286. https://doi.org/10.1080/13854046.2018.1535662 CrossRefGoogle ScholarPubMed
Gooding, A., Seider, T., Marquine, M., Suarez, P., Umlauf, A., Rivera Mindt, M., & Cherner, M. (2021). Demographically-adjusted norms for the paced auditory serial addition test and letter number sequencing test in Spanish-speaking adults: Results from the neuropsychological norms for the U.S.-Mexico border region in Spanish (NP-NUMBRS) Project. Clinical Neuropsychologist, 35(2), 324–338. https://doi.org/10.1080/13854046.2019.1711199 CrossRefGoogle ScholarPubMed
Hampshire, A., Trender, W., Chamberlain, S. R., Jolly, A. E., Grant, J. E., Patrick, F., & Mehta, M. A. (2021). Cognitive deficits in people who have recovered from COVID-19. EClinicalMedicine, 39, 101044. https://doi.org/10.1016/j.eclinm.2021.101044 CrossRefGoogle ScholarPubMed
Harder, L., Hernandez, A., Hague, C., Neumann, J., McCreary, M., Cullum, C. M., & Greenberg, B. (2020). Home-Based pediatric teleneuropsychology: A validation study. Archives of Clinical Neuropsychology, 35(8), 1266–1275. https://doi.org/10.1093/arclin/acaa070 CrossRefGoogle ScholarPubMed
Hearps, A., Schafer, K., High, K., & Landay, A. (2016). HIV and aging: parallels and synergistic mechanisms leading to premature disease and functional decline. In Advances in geroscience (pp. 509–550). Springer.CrossRefGoogle Scholar
Heaton, R. K., Clifford, D. B., Franklin, D. R., Woods, S. P., Ake, C., Vaida, F., Ellis, R. J., Letendre, S. L., Marcotte, T. D., Atkinson, J. H., Rivera-Mindt, M., Vigil, O. R., Taylor, M. J., Collier, A. C., Marra, C. M., Gelman, B. B., McArthur, J. C., Morgello, S., Simpson, D. M., …Grant, I. (2010). HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy: CHARTER Study. Neurology, 75(23), 2087–2096. https://doi.org/10.1212/WNL.0b013e318200d727 CrossRefGoogle ScholarPubMed
Heaton, R., Miller, S., Taylor, M., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and Caucasian adults. Psychological Assessment Resources.Google Scholar
Heaton, R., Taylor, M., & Manly, J. (2003). Demographic effects and use of demographically corrected norms with the WAIS-III and WMS-III. In Clinical interpretation of the WAIS-III and WMS-III (pp. 181–210). Elsevier.CrossRefGoogle Scholar
Heaton, R. K., Franklin, D. R., Ellis, R. J., McCutchan, J. A., Letendre, S. L., LeBlanc, S., Corkran, S. H., Duarte, N. A., Clifford, D. B., Woods, S. P., Collier, A. C., Marra, C. M., Morgello, S., Mindt, M. R., Taylor, M. J., Marcotte, T. D., Atkinson, J. H., Wolfson, T., Gelman, B. B., …Grant, I. (2011). HIV-associated neurocognitive disorders before and during the era of combination antiretroviral therapy: differences in rates, nature, and predictors. Journal of NeuroVirology, 17(1), 3–16. https://doi.org/10.1007/s13365-010-0006-1 CrossRefGoogle ScholarPubMed
Heaton, R. K., Franklin, D. R., Deutsch, R., Letendre, S., Ellis, R. J., Casaletto, K., Marquine, M. J., Woods, S. P., Vaida, F., Atkinson, J. H., Marcotte, T. D., McCutchan, J. A., Collier, A. C., Marra, C. M., Clifford, D. B., Gelman, B. B., Sacktor, N., Morgello, S., Simpson, D. M., …Teshome, M. (2015). Neurocognitive change in the era of HIV combination antiretroviral therapy: The longitudinal CHARTER study. Clinical Infectious Diseases, 60(3), 473–480. https://doi.org/10.1093/cid/ciu862 CrossRefGoogle ScholarPubMed
Hemphill, J. F. (2003). Interpreting the magnitudes of correlation coefficients. American Psychologist, 58(1), 78–79.CrossRefGoogle ScholarPubMed
Kaplan, E. F., Goodglass, H., & Weintraub, S. (1983). The Boston Naming Test (2nd ed.). Lea & Febiger.Google Scholar
Lillicrap, L., Hunter, C., & Goldswain, P. (2019). Improving geriatric care and reducing hospitalisations in regional and remote areas: The benefits of telehealth. Journal of Telemedicine and Telecare, 27(7), 397–408. https://doi.org/10.1177/1357633X19881588 CrossRefGoogle ScholarPubMed
Marquine, M. J., Morlett Paredes, A., Madriaga, C., Blumstein, Y., Umlauf, A., Kamalyan, L., Rivera Mindt, M., Suarez, P., Artiola i Fortuni, L., Heaton, R. K., & Cherner, M. (2021). Demographically-adjusted norms for selected tests of verbal fluency: Results from the neuropsychological norms for the US-Mexico border region in Spanish (NP-NUMBRS) project. Clinical Neuropsychologist, 35(2), 269–292. https://doi.org/10.1080/13854046.2020.1762931 CrossRefGoogle ScholarPubMed
Marquine, M. J., Rivera Mindt, M., Umlauf, A., Suarez, P., Kamalyan, L., Morlett Paredes, A., Yassai-Gonzalez, D., Scott, T. M., Heaton, A., Diaz-Santos, M., Gooding, A., Artiola i Fortuny, L., Heaton, R. K., & Cherner, M. (2021). Introduction to the neuropsychological norms for the US-Mexico border region in Spanish (NP-NUMBRS) project. The Clinical Neuropsychologist, 35(2), 227–235. https://doi.org/10.1080/13854046.2020.1751882 CrossRefGoogle Scholar
Marra, D. E., Hamlet, K. M., Bauer, R. M., & Bowers, D. (2020). Validity of teleneuropsychology for older adults in response to COVID-19: A systematic and critical review. The Clinical Neuropsychologist, 34(7-8), 1411–1452.CrossRefGoogle ScholarPubMed
Matchanova, A., Babicz, M. A., Medina, L. D., Rahman, S., Johnson, B., Thompson, J. L., Beltran-Najera, I., Brooks, J., Sullivan, K. L., Walker, R. L., Podell, K., & Woods, S. P. (2020). Latent structure of a brief clinical battery of neuropsychological tests administered in-home via telephone. Archives of Clinical Neuropsychology, 36(6), 874–886.CrossRefGoogle Scholar
McNair, D. M., Lorr, M., & Droppleman, L. F. (1981). Profile of mood states. Educational and Industrial Testing Service.Google Scholar
Mgbako, O., Miller, E. H., Santoro, A. F., Remien, R. H., Shalev, N., Olender, S., Gordon, P., & Sobieszczyk, M. E. (2020). COVID-19, telemedicine, and patient empowerment in HIV care and research. AIDS and Behavior, 24(7), 1990–1993.CrossRefGoogle ScholarPubMed
Mirzaei, H., McFarland, W., Karamouzian, M., & Sharifi, H. (2020). COVID-19 among people living with HIV: A systematic review. AIDS and Behavior, 25(1), 85–92.CrossRefGoogle Scholar
Moffatt, J. J., & Eley, D. S. (2010). The reported benefits of telehealth for rural Australians. Australian Health Review, 34(3), 276–281.CrossRefGoogle ScholarPubMed
Moore, R. C., Paolillo, E. W., Sundermann, E. E., Campbell, L. M., Delgadillo, J., Heaton, A., Swendsen, J., & Depp, C. A. (2021). Validation of the mobile verbal learning test: Illustration of its use for age and disease-related cognitive deficits. International Journal of Methods in Psychiatric Research, 30(1), e1859.CrossRefGoogle ScholarPubMed
Mungas, D., Reed, B. R., Crane, P. K., Haan, M. N., & Gonzalez, H. (2004). Spanish and English Neuropsychological Assessment Scales (SENAS): Further development and psychometric characteristics. Psychological Assessment, 16(4), 347–359. https://doi.org/10.1037/1040-3590.16.4.347 CrossRefGoogle ScholarPubMed
Parikh, M., Grosch, M. C., Graham, L. L., Hynan, L. S., Weiner, M., Shore, J. H., & Cullum, C. M. (2013). Consumer acceptability of brief videoconference-based neuropsychological assessment in older individuals with and without cognitive impairment. The Clinical Neuropsychologist, 27(5), 808–817.CrossRefGoogle ScholarPubMed
Parsons, M. W., Gardner, M. M., Sherman, J. C., Pasquariello, K., Grieco, J. A., Kay, C. D., Pollak, L. E., Morgan, A. K., Carlson-Emerton, B., Seligsohn, K., Davidsdottir, S., Pulsifer, M. B., Zarrella, G. V., Burstein, S. M., & Mancuso, S. M. (2021). Feasibility and Acceptance of direct-to-home tele-neuropsychology services during the COVID-19 pandemic. Journal of the International Neuropsychological Society, 28(2), 210–215.CrossRefGoogle ScholarPubMed
Passell, E., Strong, R. W., Rutter, L. A., Kim, H., Scheuer, L., Martini, P., Grinspoon, L., & Germine, L. (2021). Cognitive test scores vary with choice of personal digital device. Behavior Research Methods, 53(6), 2544–2557. https://doi.org/10.3758/s13428-021-01597-3 CrossRefGoogle ScholarPubMed
Rentz, D. M. (2016). Validating use of technology for cognitive test assessment. EBioMedicine, 11, 23–24. https://doi.org/10.1016/j.ebiom.2016.08.002 CrossRefGoogle ScholarPubMed
Rivera Mindt, M., Marquine, M. J., Aghvinian, M., Scott, T. M., Cherner, M., Morlett Paredes, A., Taylor, M. J., Umlauf, A., Suarez, P., Diaz-Santos, M., Kamalyan, L., Heaton, A., Artiola i Fortuny, L., & Heaton, R. K. (2021). Demographically-adjusted norms for the processing speed subtests of the WAIS-III in a Spanish-speaking adult population: Results from the neuropsychological norms for the U.S.-Mexico border region in Spanish (NP-NUMBRS) project. Clinical Neuropsychologist, 35(2), 293–307. https://doi.org/10.1080/13854046.2020.1723707 CrossRefGoogle Scholar
Shore, J. H. (2013). Telepsychiatry: Videoconferencing in the delivery of psychiatric care. American Journal of Psychiatry, 170(3), 256–262. https://doi.org/10.1176/appi.ajp.2012.12081064 CrossRefGoogle ScholarPubMed
Speedie, S. M., Ferguson, A. S., Sanders, J., & Doarn, C. R. (2008). Telehealth: The promise of new care delivery models. Telemedicine and e-Health, 14(9), 964–967.CrossRefGoogle ScholarPubMed
Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643–662. https://doi.org/10.1037/h0054651 CrossRefGoogle Scholar
Suarez-Gonzalez, A., Rajagopalan, J., Livingston, G., & Alladi, S. (2021). The effect of COVID-19 isolation measures on the cognition and mental health of people living with dementia: A rapid systematic review of one year of quantitative evidence. EClinicalMedicine, 39, 101047. https://doi.org/10.1016/j.eclinm.2021.101047 CrossRefGoogle ScholarPubMed
Tailby, C., Collins, A. J., Vaughan, D. N., Abbott, D. F., O’Shea, M., Helmstaedter, C., & Jackson, G. D. (2020). Teleneuropsychology in the time of COVID-19: The experience of The Australian Epilepsy Project. Seizure, 83, 89–97. https://doi.org/10.1016/j.seizure.2020.10.005 CrossRefGoogle ScholarPubMed
Taylor, M. J., & Heaton, R. K. (2001). Sensitivity and specificity of WAIS-III/WMS-III demographically corrected factor scores in neuropsychological assessment. Journal of the International Neuropsychological Society, 7(7), 867–874.CrossRefGoogle ScholarPubMed
Wadsworth, H. E., Dhima, K., Womack, K. B., Hart, J. Jr., Weiner, M. F., Hynan, L. S., & Cullum, C. M. (2018). Validity of teleneuropsychological assessment in older patients with cognitive disorders. Archives of Clinical Neuropsychology, 33(8), 1040–1045. https://doi.org/10.1093/arclin/acx140 CrossRefGoogle ScholarPubMed
Wing, E. J. (2016). HIV and aging. International Journal of Infectious Diseases, 53, 61–68. https://doi.org/10.1016/j.ijid.2016.10.004 CrossRefGoogle ScholarPubMed
Woods, S. P., Scott, J. C., Sires, D. A., Grant, I., Heaton, R. K., & Tröster, A. I. (2005). Action (verb) fluency: Test-retest reliability, normative standards, and construct validity. Journal of the International Neuropsychological Society, 11(4), 408–415.CrossRefGoogle ScholarPubMed
World Health Organization (1997). Composite International Diagnostic Interview (CIDI, version 2.1), Geneva.Google Scholar
Wosik, J., Fudim, M., Cameron, B., Gellad, Z. F., Cho, A., Phinney, D., Curtis, S., Roman, M., Poon, E. G., Ferranti, J., Katz, J. N., & Tcheng, J. (2020). Telehealth transformation: COVID-19 and the rise of virtual care. Journal of the American Medical Informatics Association, 27(6), 957–962. https://doi.org/10.1093/jamia/ocaa067 CrossRefGoogle ScholarPubMed
Zeghari, R., Guerchouche, R., Tran-Duc, M., Bremond, F., Langel, K., Ramakers, I., Amiel, N., Lemoine, M. P., Bultingaire, V., Manera, V., Robert, P., & Konig, A. (2022). Feasibility study of an internet-based platform for tele-neuropsychological assessment of elderly in remote areas. Diagnostics (Basel), 12(4), 925. https://doi.org/10.3390/diagnostics12040925 CrossRefGoogle ScholarPubMed
Supplementary material: File

Kohli et al. supplementary material

Table S1

Download Kohli et al. supplementary material(File)
File 15.7 KB