Skip to main content

Dear policy maker: Have you made up your mind? A discrete choice experiment among policy makers and other health professionals

  • Marc A. Koopmanschap (a1), Elly A. Stolk (a1) and Xander Koolman (a2)

Objectives: The aim of this study was to get insight in what criteria as presented in Health technology assessment (HTA) studies are important for decision makers in healthcare priority setting.

Methods: We performed a discrete choice experiment among Dutch healthcare professionals (policy makers, HTA experts, advanced HTA students). In twenty-seven choice sets, we asked respondents to elect reimbursement of one of two different healthcare interventions, which represented unlabeled, curative treatments. Both treatments were incrementally compared with usual care. The results of the interventions were normal outputs of HTA studies with a societal perspective. Results were analyzed using a multinomial logistic regression model. Upon completion of the questionnaire, we discussed the exercise with policy makers.

Results: Severity of disease, costs per quality-adjusted life-year gained, individual health gain, and the budget impact were the most decisive decision criteria. A program targeting more severe diseases increased the probability of reimbursement dramatically. Uncertainty related to cost-effectiveness was also important. Respondents preferred health gains that include quality of life improvements over extension of life without improved quality of life. Savings in productivity costs were not crucial in decision making, although these are to be included in Dutch reimbursement dossiers for new drugs. Regarding subgroups, we found that policy makers attached relatively more weight to disease severity than others but less to uncertainty.

Conclusions: Dutch policy makers and other healthcare professionals seem to have reasonably well articulated preferences: six of seven attributes were significant. Disease severity, budget impact, and cost-effectiveness were very important. The results are comparable to international studies, but reveal a larger set of important decision criteria.

Hide All
1. Al, MJ, Feenstra, T, Brouwer, WBF. Decision makers’ views on health care objectives and budget constraints: Results from a pilot study. Health Policy. 2004;70:3348.
2. Al, MJ, Feenstra, TL, van Hout, BA. Optimal allocation of resources over health care programmes: Dealing with decreasing marginal utility and uncertainty. Health Econ. 2005;14:655667.
3. Baltussen, R, Ten Asbroek, AH, Koolman, X, et al. Priority setting using multiple criteria: Should a lung health programme be implemented in Nepal? Health Policy Plan. 2007;22:178185.
4. Council for Public Health and Health Care. Sensible and sustainable care. (English summary of report on Zoetermeer: Council for Public Health and Health Care; 2006.
5. Dakin, HA, Devlin, NJ, Odeyemi, IA. 2006. “Yes”, “no” or “yes, but”? multinomial modelling of NICE decision-making. Health Policy. 2006;77:352367.
6. Devlin, N, Parkin, D. Does NICE have a cost-effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Econ. 2004;13:437452.
7. Green, C, Gerard, K. Exploring the social value of health care interventions: A stated preference discrete choice experiment. Health Econ. 2009;18:951976.
8. Gyrd-Hansen, D. Investigating the social value of healthy changes. J Health Econ. 2004;23:11011116.
9. Kocur, G, Adler, T, Hyman, W, et al. Guide to forecasting travel demand with direct utility assessment. Washington DC: Urban Mass Transportation Administration, United States Department of Transportation, 1982. Report UMTA-NH-11-001082-1.
10. Lancsar, E, Louviere, J. Conducting discrete choice experiments to inform healthcare decision making: A user's guide. Pharmacoeconomics. 2008;26:661677.
11. Niezen, MGH, De Bont, A, Busschbach, JJV, et al. Finding legitimacy for the role of budget impact in drug reimbursement decisions. Int J Technol Assess Health Care. 2009;25:4955.
12. Pronk, MH, Bonsel, GJ. Outpatient drug policy by clinical assessment rather than financial constraints? The gate-keeping function of the out patient drug reimbursement system in the Netherlands. Eur J Health Econ. 2004;5:274277.
13. Rabinowicz, W. Prioritarianism and uncertainty: On the interpersonal addition theorem and the priority view. (accessed 2001).
14. Ratcliffe, J, Bekker, HL, Dolan, P, et al. Examining the attitudes and preferences of health care decision-makers in relation to access, equity and cost-effectiveness: A discrete choice experiment. Health Policy. 2009;90:4557.
15 Schwappach DLB, Strasmann, TJ. Quick and dirty numbers? The reliability of a stated-preference technique for the measurement of preferences for resource allocation. J Health Econ. 2006;25:432448.
16. Stolk, EA, van Donselaar, G, Brouwer, WB, et al. Reconciliation of economic concerns and health policy: Illustration of an equity adjustment procedure using proportional shortfall. Pharmacoeconomics. 2004;22:10971107.
17. UTS: Science. Software for the construction of optimal stated choice experiments: Theory and methods.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

International Journal of Technology Assessment in Health Care
  • ISSN: 0266-4623
  • EISSN: 1471-6348
  • URL: /core/journals/international-journal-of-technology-assessment-in-health-care
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary materials

Koopmanschaf et al. supplementary material
Supplementary tables

 Unknown (13 KB)
13 KB


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed