Skip to main content
    • Aa
    • Aa

Test–retest reliability of health utilities index scores: Evidence from hip fracture

  • C. Allyson Jones (a1) (a2), David Feeny (a1) (a2) (a3) and Ken Eng (a2)

Objectives: There is relatively little evidence on the test–retest reliability of utility scores derived from multiattribute measures. The objective was to estimate test–retest reliability for Health Utilities Index Mark 2 (HUI2) and Mark 3 (HUI3) utility scores in patients recovering from hip fracture.

Methods: We enrolled an inception cohort of hip fracture patients within 3 to 5 days of surgery. Baseline assessments included the Functional Independence Measure (FIM™), Folstein Mini-Mental State Examinations, and the HUI2 and HUI3 questionnaire. Follow-up assessments at 1, 3, and 6 months also included a global change question. Test–retest reliability was assessed as agreement between 3- and 6-month scores using the intraclass correlation coefficient (ICC). Two approaches were used to classify patients as stable; a third approach based on the generalizability theory was also used. Patients were classified as stable if their FIM™ overall scores changed by 10 points or fewer and if they classified themselves as having experienced no or only a little change according to their global change question.

Results: Complete data at both the 3- and 6-month assessments based on self-report were available for 196 patients; 141 patients with complete data were classified as stable. The ICCs for HUI2 and HUI3 for stable patients were 0.71 and 0.72; the ICCs derived from the generalizability theory were 0.76 and 0.77.

Conclusions: Test–retest reliability for HUI in this cohort was similar to reliability estimates for other preference-based multiattribute and generic health-profile measures—in the acceptable range for making valid group-level comparisons.

Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

BoyleMH, FurlongW, FeenyD, TorranceG, HatcherJ. 1995Reliability of the Health Utilities Index - Mark III used in the 1991 Cycle 6 General Social Survey Health Questionnaire. Qual Life Res. 4: 249257.

BrazierJ, WaltersSJ, NichollJP, KohlerB. 1996Using the SF-36 and Euroqol on an elderly population. Qual Life Res. 5: 195204.

BrazierJ, RobertsJ, DeverillM. 2002The estimation of a preference-based measure of health status from the SF-36. J Health Econ. 21: 271292.

CharlsonME, PompeiP, AlesKL, MacKenzieCR. 1987A new method of classifying prognostic comorbidity in longitudinal studies: Development and validation. J Chron Dis. 40: 373383.

CoonsSJ, RaoS, KeiningerDL, HaysRD. 2000A comparative review of generic quality-of-life instruments. Pharmacoeconomics. 17: 1335.

DeyoRA, DiehrP, PatrickDL. 1991Reproducibility and responsiveness of health status measures: Statistics and strategies for evaluation. Control Clin Trials. 12: 142S158S.

DormanP, SlatteryJ, FarrellB. 1998Qualitative comparison of the reliability of health status assessments with the EuroQol and the SF-36 questionnaires after stroke. Stroke. 29: 6368.

FeenyD, FurlongW, BarrRD, et al. 1992A comprehensive multiattribute system for classifying the health status of survivors of childhood cancer. J Clin Oncol. 10: 923928.

FeenyD, FurlongW, TorranceGW, et al. 2002Multi-attribute and single-attribute utility functions for the Health Utilities Index Mark 3 system. Med Care. 40: 113128.

FolsteinMF, FolsteinSE, McHughPR. 1975Mini-mental state. A practical method for grading the cognitive state of patients for the clinician. J Psychiatric Res. 12: 189198.

FurlongWJ, FeenyDH, TorranceGW, BarrRD. 2001The Health Utilities Index (HUI) system for assessing health-related quality of life in clinical studies. Ann Med. 33: 375384.

GrangerCV, HamiltonBB, LinacreJM, HeinemannAW, WrightBD. 1993Performance profiles for the functional independence measure. Am J Phys Med Rehabil. 72: 8489.

HaysRD, AndersonR, RevickiD. 1993Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res. 2: 441449.

HorsmanJ, FurlongW, FeenyD, TorranceG. 2003The Health Utilities Index (HUI®): Concepts, measurement properties and applications. Health Qual Life Outcomes. 1: 54.

LandisRJ, KochGG. 1977The measurement of observer agreement for categorical data. Biometrics. 33: 159174.

McHorneyCA, TarlovAR. 1995Individual-patient monitoring in clinical practice: Are available health status surveys adequate? Qual Life Res. 4: 293307.

NormanG. 2003Hi! How are you? Response shift, implicit theories and differing epistemologies. Qual Life Res. 12: 239249.

OttenbacherKJ, HsuY, GrangerCV, FiedlerRC. 1996The reliability of the functional independence measure: A quantitative review. Arch Phys Med Rehabil. 77: 12261232.

PetrellaN, OverendT, ChesworthB. 2002FIM after hip fracture: Is telephone administration valid and sensitive to change? Am J Phys Med Rehabil. 81: 639644.

PollakN, RheaultW, StoeckerJL. 1996Reliability and validity of the FIM for persons aged 80 years and above from a multilevel continuing care retirement community. Arch Phys Med Rehabil. 77: 10561061.

RabinR, deCharro F. 2001EQ-5D: A measure of health status from the EuroQol group. Ann Med. 33: 337343.

RevickiD, OsobaD, FaircloughD, et al. 2000Recommendations on health-related quality of life research to support labeling and promotional claims in the United States. Qual Life Res. 9: 887900.

RoccaforteWH, BurkeWJ, BayerBL, WengelSP. 1992Validation of a telephone version of the Mini-Mental State Examination. J Am Geriatr Soc. 40: 697702.

SchuckP. 2004Assessing reproducibility for internal data in health-related quality of life questionnaires: Which coefficient should be used? Qual Life Res. 13: 571586.

SegalME, GillardM, SchallR. 1996Telephone and in-person proxy agreement between stroke patients and caregivers for the functional independence measure. Am J Phys Med Rehabil. 75: 208212.

ShroutPE, FleissJL. 1979Intraclass correlations: Uses in assessing rater reliability. Psychol Bull. 86: 420428.

SmithPM, IlligSB, FiedlerRC, HamiltonBB, OttenbacherKJ. 1996Intermodal agreement of follow-up telephone functional assessment using the functional independence measure in patients with stroke. Arch Phys Med Rehabil. 77: 9431435.

Suarez-AlmazorME, KendallC, JohnsonJA, SkeithK, VincentD. 2000Use of health status measures in patients with low back pain in clinical settings. Comparison of specific, generic, and preference-based instruments. Rheumatology. 39: 783790.

TombaughTN, McIntyreNJ. 1992The Mini-Mental State Examination: A comprehensive review. J Am Geriatr Soc. 40: 922935.

TorranceGW, FeenyDH, FurlongWJ, et al. 1996Multi-attribute preference functions for a comprehensive health status classification system: Health Utilities Index Mark 2. Med Care. 34: 702722.

WallaceD, DuncanPW, LaiSM. 2002Comparison of the responsiveness of the Barthel Index and the motor component of the functional independence measure in stroke. The impact of using different methods for measuring responsiveness. J Clin Epidemiol. 55: 922928.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

International Journal of Technology Assessment in Health Care
  • ISSN: 0266-4623
  • EISSN: 1471-6348
  • URL: /core/journals/international-journal-of-technology-assessment-in-health-care
Please enter your name
Please enter a valid email address
Who would you like to send this to? *