Hostname: page-component-89b8bd64d-b5k59 Total loading time: 0 Render date: 2026-05-13T07:26:10.147Z Has data issue: false hasContentIssue false

Test–retest reliability of the Cost for Patients Questionnaire

Published online by Cambridge University Press:  11 July 2022

Thomas G. Poder
Affiliation:
Département de Gestion, Évaluation et Politique de Santé, École de Santé Publique de l’Université de Montréal, Montréal, QC, Canada Centre de Recherche de l’Institut Universitaire en Santé Mentale de Montréal, Montréal, QC, Canada
Lucien P. Coulibaly
Affiliation:
Faculté des Lettres et Sciences Humaines, Université de Sherbrooke, Sherbrooke, QC, Canada Centre de Recherche sur le Vieillissement, Sherbrooke, QC, Canada
Abakar Idriss Hassan
Affiliation:
Institut National de Santé Publique, Québec City, QC, Canada
Blanchard Conombo
Affiliation:
Department of Social and Preventative Medicine, Université Laval, Québec City, QC, Canada Population Health and Optimal Health Practices Research Unit, Centre de Recherche du CHU de Québec, Université Laval, Québec City, QC, Canada
Maude Laberge*
Affiliation:
Population Health and Optimal Health Practices Research Unit, Centre de Recherche du CHU de Québec, Université Laval, Québec City, QC, Canada Department of Operations and Decision Systems, Faculty of Administration, Université Laval, Québec City, QC, Canada VITAM—Centre de Recherche en Santé Durable, Université Laval, Québec City, QC, Canada
*
*Author for correspondence: Maude Laberge, E-mail: maude.laberge@fsa.ulaval.ca
Rights & Permissions [Opens in a new window]

Abstract

Objectives

To investigate the test–retest reliability of the Costs for Patients Questionnaire (CoPaQ).

Methods

Through an online survey, individuals were invited to participate in a two-step study to assess the test–retest reliability of the CoPaQ. Participants to the first step were invited to complete the questionnaire a second time 2 weeks after. Reliability was assessed by calculating Cohen’s Kappa coefficients and intraclass correlation coefficients (ICC) for discrete and continuous data, respectively. A sensitivity analysis was carried out.

Results

From a total of 1,200 participants who completed the first test, 403 completed the second test. The ICC varied from −0.00 to 0.98 with poor, moderate, good, and excellent results. The Kappa coefficients varied from −0.004 to 0.65 and were poor, slight, fair, moderate, and substantial. The sensitivity analysis showed the median value of ICC and Kappa coefficients for each category before and after the outliers’ exclusion. The median value of ICC changed from 0.30 (before) to 0.70 (after), and from 0.12 (before) to 0.04 (after), respectively, for each category. The median value of the Cohen’s Kappa coefficient increased from 0.44 (before) to 0.46 (after) and decreased from 0.32 (before) to 0.30 (after), respectively.

Conclusions

Test–retest reliability results indicated that the CoPaQ has a moderate reliability in terms of ICC and Kappa coefficients. The moderate reliability observed gives additional support for the applicability of this tool in economic evaluations of health interventions. Additional studies including on other properties and a cultural adaptation could further enhance the use of the tool.

Information

Type
Method
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2022. Published by Cambridge University Press
Figure 0

Table 1. Intraclass Correlation Coefficient (ICC) Results

Figure 1

Table 2. Kappa Results

Figure 2

Table 3. Interpretation of Intraclass Correlation Coefficient (ICC) and Cohen’s Kappa

Figure 3

Table 4. Characteristics of Test–Retest Participants

Figure 4

Table 5. Sensitivity Analyzes Results