Skip to main content
    • Aa
    • Aa

Perspectives on the policy ‘black box’: a comparative case study of orthopaedics services in England

  • Hugh McLeod (a1), Ross Millar (a2), Nick Goodwin (a3) and Martin Powell (a2)

There has been much recent debate on the impact of competition on the English National Health Service (NHS). However, studies have tended to view competition in isolation and are controversial. This study examines the impact of programme theories associated with the health system reforms, which sought to move from a dominant target-led ‘central control’ programme theory, to one based on ‘market forces’, on orthopaedics across six case-study local health economies. It draws on a realistic evaluation approach to open up the policy ‘black box’ across different contexts using a mixed methods approach: analysis of 152 interviews with key informants and analysis of waiting times and admissions. We find that the urban health economies were more successful in reaching the access targets than the rural health economies, although the gap in performance closed over time. Most interviewees were aware of the policies to increase choice and competition, but their role appeared comparatively weak. Local commissioners’ ability to influence demand appeared limited with providers’ incentives dominating service delivery. Looking forward, it is clear that the role of competition in the NHS has to be considered alongside, rather than in isolation from, other policy mechanisms.

Corresponding author
*Correspondence to: Dr Hugh McLeod, Health Economics Unit, University of Birmingham, Public Health Building, Birmingham B15 2TT, UK. Email:
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

P. Allen , S. Turner , W. Bartlett , V. Perotin , G. Matchaya and B. Zamora (2012), ‘Provider diversity in the English NHS: a study of recent developments in four local health economies’, Journal of Health Services Research & Policy, 17(S1): 2330.

G. Bevan and C. Hood (2006), ‘Targets and gaming in health care in England’, Public Administration, 84(3): 517538.

G. Bevan and M. Skellern (2011), ‘Does competition between hospitals improve clinical quality? A review of evidence from two eras of competition in the English NHS’, British Medical Journal, 343: d6470.

Z. Cooper , S. Gibbons , S. Jones and A. McGuire (2011), ‘Does hospital competition save lives? Evidence from the English NHS patient choice reforms’, Economic Journal, 121: F228F260.

S. Farrar , D. Yi , M. Sutton , M. Chalkley , J. Sussex and T. Scott (2009), ‘Has payment by results affected the way that English hospitals provide care?’, British Medical Journal, 339: b3047doi:10.1136/bmj.b3047.

S. Frankel , J. Eachus , N. Pearson , R. Greenwood , P. Chan , T. Peters , J. Donovan , G. Smith and P. Dieppe (1999), ‘Population requirements for primary hip-replacement surgery: a cross-sectional study’, The Lancet, 353: 1300413009.

M. Gaynor , R. Moreno-Serra and C. Propper (2012), ‘Can competition improve outcomes in UK health care? Lessons from the past two decades’, Journal of Health Services Research & Policy, 17(S1): 4954.

I. Greener (2012), ‘Unpacking the evidence on competition and outcomes in the NHS in England’, Journal of Health Services Research & Policy, 17(4): 193194.

P. Hassenteufel , M. Smyrl , W. Genieys and F. Moreno-Fuentes (2010), ‘Programmatic actors and the transformation of European health care states’, Journal of Health Politics, Policy and Law, 35(4): 517538.

D. Hunter (2011), ‘Change of government: one more big bang health care reform in England’s National Health Service’, International Journal of Health Services, 41(1): 159174.

D. Marsh and A. McConnell (2010), ‘Towards a framework for establishing policy success’, Public Administration, 88(2): 564583.

R. Millar , M. Powell and A. Dixon (2012), ‘What was the programme theory of New Labour's Health System Reforms?’, Journal of Health Services Research & Policy, 17(S1): 715.

R. Pawson , T. Greenhalgh , G. Harvey and K. Walshe (2005), ‘Realist review – a new method of systematic review designed for complex policy interventions’, Journal of Health Services Research & Policy, 10(S1): 2134.

A. Pollock , A. Macfarlane , G. Kirkwood , F. Majeed , I. Greener , C. Morelli , S. Boyle , H. Mellett , S. Godden , D. Price and P. Brhlikova (2011), ‘No evidence that patient choice in the NHS saves lives’, The Lancet, 378: 20572060.

C. Propper (2012), ‘Competition, incentives and the English NHS’, Health Economics, 21: 3340.

C. Propper , S. Burgess and D. Gossage (2008), ‘Competition and quality: evidence from the NHS internal market 1991-9’, The Economic Journal, 118: 138170.

J. Smith , J. Dixon , N. Mays , H. McLeod , N. Goodwin , S. McClelland , R. Lewis and S. Wyke (2005), ‘Practice-based commissioning: applying the evidence’, British Medical Journal, 331: 13971399.

A. Street , P. Sivey , A. Mason , M. Miraldo and L. Siciliani (2010), ‘Are English treatment centres treating less complex patients?’, Health Policy, 94: 150157.

F. Frosini , A. Dixon and R. Robertson (2012), ‘Competition in the NHS: a provider perspective’, Journal of Health Services Research & Policy, 17(S1): 1622.

C. Propper , S. Burgess and K. Green (2004), ‘Does competition between hospitals improve the quality of care? Hospital death rates and the NHS internal market’, Journal of Public Economics, 88: 12471272.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Health Economics, Policy and Law
  • ISSN: 1744-1331
  • EISSN: 1744-134X
  • URL: /core/journals/health-economics-policy-and-law
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Altmetric attention score

Full text views

Total number of HTML views: 1
Total number of PDF views: 12 *
Loading metrics...

Abstract views

Total abstract views: 216 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 23rd September 2017. This data will be updated every 24 hours.