Hostname: page-component-848d4c4894-wzw2p Total loading time: 0 Render date: 2024-05-31T05:33:25.345Z Has data issue: false hasContentIssue false
  • English
  • Français

What are the predictors of TOMM failure in clinical TBI populations? A retrospective analysis

Published online by Cambridge University Press:  11 July 2022

Thomas M. Gates Open the ORCID record for Thomas M. Gates [Opens in a new window] ,
Kasey Metcalf ,
Mark Sabaz ,
Kate Young ,
Thushara Anandakumar  and
Grahame K. Simpson
Thomas M. Gates*
Affiliation:
Liverpool Brain Injury Rehabilitation Unit, Liverpool Hospital, Sydney, Australia Brain Injury Rehabilitation Research Group, Ingham Institute for Applied Medical Research, Sydney, Australia
Kasey Metcalf
Affiliation:
Liverpool Brain Injury Rehabilitation Unit, Liverpool Hospital, Sydney, Australia
Mark Sabaz
Affiliation:
Department of Psychology, Sydney Children’s Hospital, Sydney, Australia
Kate Young
Affiliation:
Liverpool Brain Injury Rehabilitation Unit, Liverpool Hospital, Sydney, Australia
Thushara Anandakumar
Affiliation:
Liverpool Brain Injury Rehabilitation Unit, Liverpool Hospital, Sydney, Australia Department of Psychology, Sydney Children’s Hospital, Sydney, Australia
Grahame K. Simpson
Affiliation:
Liverpool Brain Injury Rehabilitation Unit, Liverpool Hospital, Sydney, Australia Brain Injury Rehabilitation Research Group, Ingham Institute for Applied Medical Research, Sydney, Australia John Walsh Centre for Rehabilitation Research, Faculty of Medicine and Health, University of Sydney, Sydney, Australia
*
Corresponding author: Thomas M. Gates, email: thomas.gates@health.nsw.gov.au
Get access Rights & Permissions [Opens in a new window]

Abstract

Objectives:

To determine base rates of invalid performance on the Test of Memory Malingering (TOMM) in patients with traumatic brain injury (TBI) undertaking rehabilitation who were referred for clinical assessment, and the factors contributing to TOMM failure.

Methods:

Retrospective file review of consecutive TBI referrals for neuropsychological assessment over seven years. TOMM failure was conventionally defined as performance <45/50 on Trial 2 or Retention Trial. Demographic, injury, financial compensation, occupational, and medical variables were collected.

Results:

Four hundred and ninety one TBI cases (Median age = 40 years [IQR = 26–52], 79% male, 82% severe TBI) were identified. Overall, 48 cases (9.78%) failed the TOMM. Logistic regression analyses revealed that use of an interpreter during the assessment (adjusted odds ratio [aOR] = 8.25, 95%CI = 3.96–17.18), outpatient setting (aOR = 4.80, 95%CI = 1.87–12.31) and post-injury psychological distress (aOR = 2.77, 95%CI = 1.35–5.70) were significant multivariate predictors of TOMM failure. The TOMM failure rate for interpreter cases was 49% (21/43) in the outpatient setting vs. 7% (2/30) in the inpatient setting. By comparison, 9% (21/230) of non-interpreter outpatient cases failed the TOMM vs. 2% (4/188) of inpatient cases.

Conclusions:

TOMM failure very rarely occurs in clinical assessment of TBI patients in the inpatient rehabilitation setting. It is more common in the outpatient setting, particularly in non-English-speaking people requiring an interpreter. The findings reinforce the importance of routinely administering stand-alone performance validity tests in assessments of clinical TBI populations, particularly in outpatient settings, to ensure that neuropsychological test results can be interpreted with a high degree of confidence.

Keywords

Cross-cultural comparisonMemoryNeuropsychological assessmentPerformance validityRehabilitationTraumatic brain injury
Type
Research Article
Information
Journal of the International Neuropsychological Society , Volume 29 , Issue 4 , May 2023 , pp. 336 - 345
Copyright
Copyright © INS. Published by Cambridge University Press, 2022

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Ashendorf, L., Constantinou, M., & McCaffrey, R. J. (2004). The effect of depression and anxiety on the TOMM in community-dwelling older adults. Archives of Clinical Neuropsychology, 19(1), 125–130. https://doi.org/10.1093/arclin/19.1.125 CrossRefGoogle ScholarPubMed
Australian Bureau of Statistics. (2017). 2016 Census QuickStats – Sydney – South West. Retrieved from https://quickstats.censusdata.abs.gov.au/census_services/getproduct/census/2016/quickstat/127?opendocument Google Scholar
Barber Rioja, V., & Rosenfeld, B. (2018). Addressing linguistic and cultural differences in the forensic interview. The International Journal of Forensic Mental Health, 17(4), 377–386. doi: 10.1080/14999013.2018.1495280 CrossRefGoogle Scholar
Bashem, J. R., Rapport, L. J., Miller, J. B., Hanks, R. A., Axelrod, B. N., & Millis, S. R. (2014). Comparisons of five performance validity indices in bona fide and simulated traumatic brain injury. The Clinical Neuropsychologist, 28(5), 851–875. doi: 10.1080/13854046.2014.927927 CrossRefGoogle ScholarPubMed
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289–300.CrossRefGoogle Scholar
Bodner, T., Merten, T., & Benke, T. (2019). Performance validity measures in clinical patients with aphasia. Journal of Clinical and Experimental Neuropsychology, 41(5), 476–483. doi: 10.1080/13803395.2019.1579783 CrossRefGoogle ScholarPubMed
Constantinou, M., Bauer, L., Ashendorf, L., Fisher, J. M., & McCaffrey, R. J. (2005). Is poor performance on recognition memory effort measures indicative of generalized poor performance on neuropsychological tests? Archives of Clinical Neuropsychology, 20(2), 191–198. doi: 10.1016/j.acn.2004.06.002 CrossRefGoogle ScholarPubMed
Coward, B. (2012). Predictors of cognitive outcome following traumatic brain injury: A retrospective study. (Unpublished doctoral dissertation). Macquarie University, Sydney, Australia.Google Scholar
Department of Veteran’s Affairs. (2009). VA/DoD clinical practice guideline for management of concussion/mild traumatic brain injury. Journal of Rehabilitation Research and Development, 46(6), CP1–CP68. doi: 10.1682/JRRD.2009.06.0076 CrossRefGoogle Scholar
Donders, J., Lefebre, N., & Goldsworthy, R. (2021). Patterns of performance and symptom validity test findings after mild traumatic brain injury. Archives of Clinical Neuropsychology, 36(3), 394–402. doi: 10.1093/arclin/acz057 CrossRefGoogle ScholarPubMed
Fox, D. D. (2011). Symptom validity test failure indicates invalidity of neuropsychological tests. The Clinical Neuropsychologist, 25(3), 488–495. doi: 10.1080/13854046.2011.554443 CrossRefGoogle ScholarPubMed
Fujii, D. E. M. (2018). Developing a cultural context for conducting a neuropsychological evaluation with a culturally diverse client: The ECLECTIC framework. The Clinical Neuropsychologist, 32(8), 1356–1392. doi: 10.1080/13854046.2018.1435826 CrossRefGoogle ScholarPubMed
Gierok, S. D., Dickson, A. L., & Cole, J. A. (2005). Performance of forensic and non-forensic adult psychiatric inpatients on the Test of Memory Malingering. Archives of Clinical Neuropsychology, 20(6), 755–760. doi: 10.1016/j.acn.2005.04.008 CrossRefGoogle ScholarPubMed
Green, P., Rohling, M. L., Lees-Haley, P. R., & Iii, L. M. A. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060. doi: 10.1080/02699050110088254 CrossRefGoogle Scholar
Greve, K. W., Bianchini, K. J., & Doane, B. M. (2006). Classification accuracy of the test of memory malingering in traumatic brain injury: Results of a known-groups analysis. Journal of Clinical and Experimental Neuropsychology, 28(7), 1176–1190. doi: 10.1080/13803390500263550 CrossRefGoogle ScholarPubMed
Harrison, R., Walton, M., Chitkara, U., Manias, E., Chauhan, A., Latanik, M., & Leone, D. (2020). Beyond translation: Engaging with culturally and linguistically diverse consumers. Health Expectations, 23(1), 159–168. doi: 10.1111/hex.12984 CrossRefGoogle ScholarPubMed
Johnson-Greene, D., Brooks, L., & Ference, T. (2013). Relationship between performance validity testing, disability status, and somatic complaints in patients with fibromyalgia. The Clinical Neuropsychologist, 27(1), 148–158. doi: 10.1080/13854046.2012.733732 CrossRefGoogle ScholarPubMed
Kemp, S., Coughlan, A. K., Rowbottom, C., Wilkinson, K., Teggart, V., & Baker, G. (2008). The base rate of effort test failure in patients with medically unexplained symptoms. Journal of Psychosomatic Research, 65(4), 319–325. doi: 10.1016/j.jpsychores.2008.02.010 CrossRefGoogle ScholarPubMed
Larrabee, G. J. (2007). Introduction: Malingering, research designs, and base rates. In Larrabee, G. J. (Ed.), Assessment of malingered neuropsychological deficits (pp. 3–13). New York, NY: Oxford University Press.Google Scholar
Larrabee, G. J., Millis, S. R., & Meyers, J. E. (2009). 40 plus or minus 10, a new magical number: Reply to Russell. The Clinical Neuropsychologist, 23(5), 841–849. doi: 10.1080/13854040902796735 CrossRefGoogle ScholarPubMed
Lee, B. G., Kent, J.-A., Marcopulos, B. A., Arredondo, B. C., & Wilson, M. (2021). Rey–Osterrieth complex figure normative data for the psychiatric population. The Clinical Neuropsychologist, Advance online publication. doi: 10.1080/13854046.2021.1897163 Google ScholarPubMed
Locke, D. E. C., Smigielski, J. S., Powell, M. R., & Stevens, S. R. (2008). Effort issues in post-acute outpatient acquired brain injury rehabilitation seekers. NeuroRehabilitation, 23(3), 273–281.CrossRefGoogle ScholarPubMed
Maffini, C. S., & Wong, Y. J. (2014). Assessing somatization with Asian American clients. In Benuto, L. T., Thaler, L. T., & Leany, B. D. (Eds.), Guide to psychological assessment with Asians (pp. 347–360). New York, NY: Springer.CrossRefGoogle Scholar
Martin, P. K., & Schroeder, R. W. (2020). Base rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology, 35(6), 717–725. doi: 10.1093/arclin/acaa017 CrossRefGoogle ScholarPubMed
Martin, P. K., Schroeder, R. W., & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29(6), 741–776. doi: 10.1080/13854046.2015.1087597 CrossRefGoogle ScholarPubMed
Martin, P. K., Schroeder, R. W., Olsen, D. H., Maloy, H., Boettcher, A., Ernst, N., & Okut, H. (2020). A systematic review and meta-analysis of the Test of Memory Malingering in adults: Two decades of deception detection. The Clinical Neuropsychologist, 34(1), 88–119. doi: 10.1080/13854046.2019.1637027 CrossRefGoogle ScholarPubMed
McWhirter, L., Ritchie, C. W., Stone, J., & Carson, A. (2020). Performance validity test failure in clinical populations-a systematic review. Journal of Neurology, Neurosurgery, & Psychiatry, 91(9), 945–952. doi: 10.1136/jnnp-2020-323776 CrossRefGoogle ScholarPubMed
Moore, B. A., & Donders, J. (2004). Predictors of invalid neuropsychological test performance after traumatic brain injury. Brain Injury, 18(10), 975–984. doi: 10.1080/02699050410001672350 CrossRefGoogle ScholarPubMed
Nijdam-Jones, A., Rivera, D., Rosenfeld, B., & Arango-Lasprilla, J. C. (2017). A cross-cultural analysis of the Test of Memory Malingering among Latin American Spanish-speaking adults. Law and Human Behavior, 41(5), 422–428. doi: 10.1037/lhb0000250 CrossRefGoogle ScholarPubMed
Nijdam-Jones, A., Rivera, D., Rosenfeld, B., & Arango-Lasprilla, J. C. (2019). The effect of literacy and culture on cognitive effort test performance: An examination of the Test of Memory Malingering in Colombia. Journal of Clinical and Experimental Neuropsychology, 41(10), 1015–1023. doi: 10.1080/13803395.2019.1644294 CrossRefGoogle ScholarPubMed
Nijdam-Jones, A., & Rosenfeld, B. (2017). Cross-cultural feigning assessment: A systematic review of feigning instruments used with linguistically, ethnically, and culturally diverse samples. Psychological Assessment, 29(11), 1321–1336. doi: 10.1037/pas0000438 CrossRefGoogle ScholarPubMed
Oudman, E., Krooshof, E., van Oort, R., Lloyd, B., Wijnia, J. W., & Postma, A. (2020). Effects of Korsakoff Amnesia on performance and symptom validity testing. Applied Neuropsychology: Adult, 27(6), 549–557. doi: 10.1080/23279095.2019.1576180 CrossRefGoogle ScholarPubMed
Paul, R., Rhee, G., Baker, L. M., Vaida, F., Cooley, S. A., & Ances, B. M. (2017). Effort and neuropsychological performance in HIV-infected individuals on stable combination antiretroviral therapy. Journal of Neurovirology, 23(5), 725–733. doi: 10.1007/s13365-017-0557-5 CrossRefGoogle ScholarPubMed
Ponsford, J., Downing, M., & Pechlivanidis, H. (2020). The impact of cultural background on outcome following traumatic brain injury. Neuropsychological Rehabilitation, 30(1), 85–100. doi: 10.1080/09602011.2018.1453367 CrossRefGoogle ScholarPubMed
Rai, J. K., & Erdodi, L. A. (2021). Impact of criterion measures on the classification accuracy of TOMM-1. Applied Neuropsychology: Adult, 28(2), 185–196. doi: 10.1080/23279095.2019.1613994 CrossRefGoogle ScholarPubMed
Rees, L. M., Tombaugh, T. N., & Boulay, L. (2001). Depression and the test of memory malingering. Archives of Clinical Neuropsychology, 16(5), 501–506. https://doi.org/10.1016/S0887-6177(00)00064-0 CrossRefGoogle ScholarPubMed
Rees, L. M., Tombaugh, T. N., Gansler, D. A., & Moczynski, N. P. (1998). Five validation experiments of the Test of Memory Malingering (TOMM). Psychological Assessment, 10(1), 10–20. doi: 10.1037/1040-3590.10.1.10 CrossRefGoogle Scholar
Salazar, X. F., Lu, P. H., Wen, J., & Boone, K. B. (2007). The use of effort tests in ethnic minorities and in non-English-speaking and English as a second language populations. In Boone, K. B. (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 405–427). New York, NY: The Guilford Press.Google Scholar
Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. doi: 10.1080/13854046.2018.1484517 CrossRefGoogle ScholarPubMed
Sherer, M., Sander, A. M., Ponsford, J., Vos, L., Poritz, J. M. P., Ngan, E., & Leon Novelo, L. (2020). Patterns of cognitive test scores and symptom complaints in persons with TBI who failed performance validity testing. Journal of the International Neuropsychological Society, 26(9), 932–938. doi: 10.1017/S1355617720000351 CrossRefGoogle ScholarPubMed
Sherry, N., Ernst, N., French, J. E., Eagle, S., Collins, M., & Kontos, M. (2021). Performance validity testing in patients presenting to a specialty clinic with a mild traumatic brain injury. Journal of Head Trauma Rehabilitation, Advance online publication. doi: 10.1097/HTR.0000000000000692 Google ScholarPubMed
Sherman, E. M. S., Slick, D. J., & Iverson, G. L. (2020). Multidimensional malingering criteria for neuropsychological assessment: A 20-year update of the malingered neuropsychological dysfunction criteria. Archives of Clinical Neuropsychology, 35(6), 735–764. doi: 10.1093/arclin/acaa019 CrossRefGoogle ScholarPubMed
Sieck, B. C., Smith, M. M., Duff, K., Paulsen, J. S., & Beglinger, L. J. (2012). Symptom validity test performance in the Huntington disease clinic. Archives of Clinical Neuropsychology, 28(2), 135–143. doi: 10.1093/arclin/acs109 CrossRefGoogle ScholarPubMed
Strutt, A. M., Scott, B. M., Lozano, V. J., Tieu, P. G., & Peery, S. (2012). Assessing sub-optimal performance with the Test of Memory Malingering in Spanish speaking patients with TBI. Brain Injury, 26(6), 853–863. doi: 10.3109/02699052.2012.655366 CrossRefGoogle ScholarPubMed
Suchy, Y. (2019). Introduction to special issue: Current trends in empirical examinations of performance and symptom validity. The Clinical Neuropsychologist, 33(8), 1349–1353. doi: 10.1080/13854046.2019.1672334 CrossRefGoogle ScholarPubMed
Sullivan, B. K., May, K., & Galbally, L. (2007). Symptom exaggeration by college adults in attention-deficit hyperactivity disorder and learning disorder assessments. Applied Neuropsychology, 14(3), 189–207. doi: 10.1080/09084280701509083 CrossRefGoogle ScholarPubMed
Sweet, J. J., Heilbronner, R. L., Morgan, J. E., Larrabee, G. J., Rohling, M. L., Boone, K. B., Kirkwoodg, M. W., Schroeder, R. W., Suhr, J. A. & Conference Participants. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 35(6), 1053–1106. doi: 10.1080/13854046.2021.1896036 CrossRefGoogle Scholar
Sweet, J. J., Klipfel, K. M., Nelson, N. W., & Moberg, P. J. (2021). Professional practices, beliefs, and incomes of U.S. neuropsychologists: The AACN, NAN, SCN 2020 practice and “salary survey”. The Clinical Neuropsychologist, 35(1), 7–80. doi: 10.1080/13854046.2020.1849803 CrossRefGoogle ScholarPubMed
Tombaugh, T. N. (1996). Test of memory malingering: TOMM. New York, NY: Multi-Health Systems.Google Scholar
Uiterwijk, D., Wong, D., Stargatt, R., & Crowe, S. F. (2021). Performance and symptom validity testing in neuropsychological assessments in Australia: A survey of practises and beliefs. Australian Psychologist, 56(5), 355–371. doi: 10.1080/00050067.2021.1948797 CrossRefGoogle Scholar
Victor, T. L., Boone, K. B., Serpa, J. G., Buehler, J., & Ziegler, E. A. (2009). Interpreting the meaning of multiple symptom validity test failure. The Clinical Neuropsychologist, 23(2), 297–313. doi: 10.1080/13854040802232682 CrossRefGoogle ScholarPubMed
Walter, J., Morris, J., Swier-Vosnos, A., & Pliskin, N. (2014). Effects of severity of dementia on a symptom validity measure. The Clinical Neuropsychologist, 28(7), 1197–1208. doi: 10.1080/13854046.2014.960454 CrossRefGoogle ScholarPubMed
Wodushek, T. R., & Domen, C. H. (2020). Comparing two models of performance validity assessment in patients with Parkinson’s disease who are candidates for deep brain stimulation surgery. Applied Neuropsychology: Adult, 27(1), 9–21. doi: 10.1080/23279095.2018.1473251 CrossRefGoogle ScholarPubMed