Skip to main content

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
Cancel
×
×
Home
  • Home
Chapter
  • Print publication year: 2007
  • Online publication date: September 2009

18 - The development of composite indicators to measure health care performance

Export citation
Summary

Introduction

Over the past decade the measurement of comparative performance has become a dominant feature of health care systems across the world (Smith, 2002). Interest is apparent at every level, ranging from the performance of individual clinicians, providers and health plans, right up to the level of entire health systems. The ultimate rationale for collecting, analysing and publishing information on relative performance is to bring about performance improvement. However, the mechanism by which this works will vary, depending on the context within which health care systems operate. For example, market-orientated systems rely to a greater extent on the operation of competitive pressures from consumers, who may use comparative information when making choices about their health care insurers or providers (Porter and Teisberg, 2004). In public health systems, the publication of comparative performance information may form the basis for regulatory intervention.

It is widely acknowledged that health care performance is multidimensional. Policy makers and the public have a legitimate interest in a wide range of aspects of performance, such as efficiency, the quality of the health care process, accessibility, clinical outcomes and responsiveness (Institute of Medicine, 2001). There is now a plethora of information available for the measurement of relative performance, and interpreting such data is therefore becoming increasingly complex. One widely adopted approach to summarizing the information contained in disparate indicators of health care performance is to create a single composite measure.

Recommend this book

Email your librarian or administrator to recommend adding this book to your organisation's collection.

Business Performance Measurement
  • Online ISBN: 9780511488481
  • Book DOI: https://doi.org/10.1017/CBO9780511488481
Please enter your name
Please enter a valid email address
Who would you like to send this to *

CAPTCHA *

Skip to the audio challenge
×
References
Almeida, C., Braveman, P., Gold, M. R., Szwarcwald, C. L., Ribeiro, J. M., Miglionico, A., Millar, J. S., Porto, S., Costa, N. R., Rubio, V. O., Segall, M., Starfield, B., Travessos, C., Uga, A., Valente, J., and Viacava, F. (2001). Methodological concerns and recommendations on policy consequences of the World Health Report 2000. Lancet, 357, 1692–7.
Appleby, J., and Mulligan, J. (2000). How Well is the NHS Performing? A Composite Performance Indicator Based on Public Consultation. London: King's Fund.
Appleby, J., and Street, A. (2001). Health system goals: life, death and … football. Journal of Health Services Research, 6(4), 220–5.
Canadian Institute for Health Information (2001a). Health Care in Canada 2001: A Second Annual Report. Ottawa: Canadian Institute for Health Information.
Canadian Institute for Health Information(2001b). Health Indicators 2001. Ottawa: Canadian Institute for Health Information.
CHI (2003). NHS performance ratings: acute trusts, specialist trusts, ambulance trusts 2002/2003. London: Commission for Health Improvement, www.chi.nhs.uk/ratings/.
CMS (2004). CMS HQI Demonstration Project: Composite Quality Score Methodology Overview. Baltimore: Centers for Medicare and Medicaid Services.
Crombie, I. K., and Davies, H. T. O. (1998). Beyond health outcomes: the advantages of measuring process. Journal of Evaluation in Clinical Practice, 4(1), 31–8.
Cutler, T. (2002). Star or black hole?Community Care, 30 May, 40–1.
Department of Health (2001). NHS Performance Ratings: Acute Trusts 2000/01. London: Department of Health.
Department of Health (2002). NHS Performance Ratings and Indicators: Acute Trusts, Specialist Trusts, Ambulance Trusts, Mental Health Trusts 2001/02. London: Department of Health.
Dolan, P., Gudex, C., Kind, P., and Williams, A. (1996). Valuing health states: a comparison of methods. Journal of Health Economics, 15, 209–31.
European Commission (2006). Composite indicators: an information server on composite indicators. Ispra, Italy: European Commission, Joint Research Centre, http://farmweb.jrc.ec.europa.eu/ci/JRC_2006EPI_PR.htm.
Freudenberg, M. (2003). Composite Indicators of Country Performance: A Critical Assessment, Science, Technology and Industry Working Paper 2003/16. Paris: Organisation for Economic Co-operation and Development.
Gravelle, H., and Smith, P. C. (2002). Sources of variations in measured performance. In Smith, P. C. (ed.), Some Principles of Performance Measurement and Performance Improvement, report prepared for the Commission for Health Improvement, 3–5. York: University of York, Centre for Health Economics.
Hauck, K., Shaw, R., and Smith, P. C. (2002). Reducing avoidable inequalities in health: a new criterion for setting health care capitation payments. Health Economics, 11(8), 667–77.
Healthcare Commission (2004). 2004 performance ratings. London: Healthcare Commission, http://ratings2004.healthcarecommission.org.uk/.
Healthcare Commission (2005). 2005 performance ratings. London: Healthcare Commission, http://ratings2005.healthcarecommission.org.uk/.
Iezzoni, L. I., Schwartz, M., Ash, A. S., Hughes, J. S., Daley, J., and Mackiernan, Y. D. (1995). Using severity-adjusted stroke mortality rates to judge hospitals. International Journal for Quality in Health Care, 7(2), 81–94.
Iezzoni, L. I., Schwartz, M., Ash, A. S., Hughes, J. S., Daley, J., and Mackiernan, Y. D. (1996). Severity measurement methods and judging hospital death rates for pneumonia. Medical Care, 34(1), 11–28.
Institute of Medicine (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: Institute of Medicine of the National Academies, Committee on Quality of Health Care in America.
Jacobs, R., and Dawson, D. (2003). Variation in unit costs of hospitals in the English NHS. Journal of Health Services Research and Policy, 8(4), 202–8.
Jacobs, R., Smith, P. C., and Goddard, M. (2005). How robust are hospital ranks based on composite performance measures?Medical Care, 43(12), 1177–84.
Jencks, S. F., Cuerdon, T., Burwen, D. R., Fleming, B., Houck, P. M., Kussmaul, A. E., Nilasena, D. S., Ordin, D. L., and Arday, D. R. (2000). Quality of medical care delivered to Medicare beneficiaries: a profile at state and national levels. Journal of the American Medical Association, 284(13), 1670–6.
Jencks, S. F., Huff, E. D., and Cuerdon, T. (2003). Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. Journal of the American Medical Association, 289(3), 305–12.
Kmietowicz, Z. (2003). Star rating system fails to reduce variation. British Medical Journal, 327, 184.
Miller, N. (2002). Missing the target. Community Care, 21 November, 36–8.
Mullen, P., and Spurgeon, P. (2000). Priority Setting and the Public. Abingdon: Radcliffe Medical Press.
Navarro, V. (2000). Assessment of the World Health Report. Lancet, 356, 1598–601.
Navarro, V. (2001). World Health Report 2000: response to Murray and Frenk. Lancet, 357, 1701–2.
Navarro, V. (2002). The World Health Report 2000: can health care systems be compared using a single measure of performance?American Journal of Public Health, 92(1), 31–4.
Nord, E. (2002). Measures of goal attainment and performance: a brief, critical consumer guide. Health Policy, 59(3), 183–91.
Porter, M. E., and Teisberg, E. O. (2004). Redefining competition in healthcare. Harvard Business Review, 82(3), 65–76.
Premier Inc. (2005). HQI demonstration overview. Washington, DC: Premier Inc., www.premierinc.com/all/quality/hqi/index.jsp.
Ridgway, V. F. (1956). Dysfunctional consequences of performance measurements. Administrative Science Quarterly, 1(2), 240–7.
Saisana, M., and Tarantola, S. (2002). State-of-the-art Report on Current Methodologies and Practices for Composite Indicator Development. Ispra, Italy: European Commission, Joint Research Centre.
Shaw, R., Dolan, P., Tsuchiya, A., Williams, A., Smith, P. C., and Burrows, R. (2001). Development of a Questionnaire to Elicit Preferences regarding Health Inequalities, Occasional Paper no. 40. York: University of York, Centre for Health Economics.
Simar, L., and Wilson, P. W. (2002). Estimation and Inference in Two-stage Semi-parametric Models of Production Processes. Louvain: Université Catholique de Louvain, Institut de Statistique.
Smith, P. C. (2002). Developing composite indicators for assessing health system efficiency. In Smith, P. C. (ed.), Measuring Up: Improving the Performance of Health Systems in OECD Countries, 322–46. Paris: Organisation for Economic Co-operation and Development.
Smith, P. C. (2003). Formula funding of public services: an economic analysis. Oxford Review of Economic Policy, 19(2), 301–22.
Smith, P. C., Rice, N., and Carr-Hill, R. (2001). Capitation funding in the public sector. Journal of the Royal Statistical Society, Series A, 164(2), 217–57.
Snelling, I. (2003). Do star ratings really reflect hospital performance?Journal of Health Organization and Management, 17, 210–23.
WHO (2000). The World Health Report 2000: Health Systems: Improving Performance. Geneva: World Health Organization.
Williams, A. (2001). Science or marketing at WHO?Health Economics, 10, 93–100.
Cancel
Confirm
×