Clustering and outcome measures

Despite the name, mental health PbR does not yet pay on the basis of results or outcomes, but by activity. Not all activity is of the same nature or degree, so the authors of mental health PbR have developed a currency to address case mix. Thus, more demanding provision is funded at a higher level than less complex or intense work. This case-mix approach is called clustering. It is the equivalent of healthcare resource groups in other systems.

Mental health clusters are assigned using the Mental Health Clustering Tool (MHCT), a structured rating of behaviour, symptoms, risk, functional status and history. When clinicians assign a cluster to a patient they are allocating a fixed price for that patient’s care for a set period of time called a cluster review period. Any qualified provider of mental health services can bid to offer a service to a patient at that fixed price. Providers that spend less on service provision than the cluster tariff will make a profit, and those spending more will lose money. The system therefore encourages providers to work within the price limit of each cluster, and it is hoped that this will drive down the costs of service provision. Of course, there have to be checks and balances to encourage quality as well as efficiency. In future, various forms of outcome measure will be used to help determine quality.

The administrative burden of clustering

Clinicians may be diverted somewhat from direct patient care by clustering, which is a process equivalent to raising invoices in a retrospective payment system. This diversion may increase as demands for quality measures and outcomes are included. Computerised administrative systems could offer support to minimise loss of productivity, and staff will need to adapt to the new environment. In acute services, PbR is supported by administrative staff called clinical coders. Clinicians record diagnoses and procedures and then the coders transform these into tariff codes. This separation of clinicians from accounting means that they are unlikely to be drawn into gaming the system (see the section on Gaming below), a protection that mental health PbR does not afford. In mental health PbR, the clinicians are also the coders.

Diagnosis and clustering processes are not the same

Clustering will make all professional groups in mental healthcare adopt a new classification system to support the flow of money around the National Health Service (NHS). Doctors in particular need to understand that this new financial classification system differs from diagnostic systems. Clusters borrow heavily from the clinical language of medical diagnosis, but they have very different meanings. When a practitioner makes a clinical judgement that someone has a first-episode psychosis this is because the person reports a syndrome of psychotic symptoms such as hallucinations and delusions, and is experiencing distress and disability. When the same practitioner allocates the same person to a mental health cluster called first-episode psychosis they do so in order to receive payment of £10 606 during that cluster’s review period of 12 months. Clustering is a financial process wrapped up in clinical terms.

The Royal College of Psychiatrists (2014) does not support the current clustering model. The College position statement on mental health payment systems expresses dissatisfaction that diagnosis is a secondary consideration to the clustering system. College members are concerned that ‘the implementation of the current system would risk severe destabilisation, both financially and organisationally’. Perhaps the absence of diagnosis challenges the position of psychiatrists in the system.

Making a diagnosis is a process of using information gained from conversations and examinations to categorise people into groups. It is a fundamental part of the medical model. In psychiatry there is little pathological evidence to inform diagnoses, so the profession has developed diagnostic standards, based on clinical assessments, published as international diagnostic manuals. The system of allocating clusters is a different categorisation process, with 21 clusters instead of several hundred diagnoses. Clustering does not use diagnosis because diagnosis is not well correlated with mental healthcare expenditure – other factors, such as marital status and electoral ward of residence, are better predictors of cost (Reference OyebodeOyebode 2007).

The MHCT relies in large part on a set of scales developed by the Royal College of Psychiatrists’ Research Unit in the 1990s called the Health of the Nation Outcome Scales (HoNOS) (Reference Wing, Curtis and BeevorWing 1996), so it does have clinical credentials, but there is no scheme to translate backwards and forwards between diagnosis and clustering. A person with a diagnosis of first-episode psychosis could be allocated to one of several clusters, such as ‘psychotic crisis’, ‘first-episode psychosis’ or ‘ongoing or recurrent psychosis (high symptom and disability)’. A person with a cluster allocation of ‘psychotic crisis’ may have a clinical diagnosis of schizophrenia, mania, depression or personality disorder. The cluster is a single price that covers all psychiatric comorbidities in a single category. A person with multiple psychiatric diagnoses (e.g. depression, substance misuse and personality disorder) will only receive one mental health cluster.

How to do clustering

The cluster is derived from ratings of scales 2–13 of the HoNOS and five additional historical ratings. The first HoNOS scale (overactive, aggressive, disruptive or agitated behaviour (current)), is not used. Together, these items comprise the MHCT, details of which are laid out in the Mental Health Clustering Booklet (Department of Health 2013a). A flow chart for clustering is shown in Fig. 1. It is generally expected that professionals will use the cluster scoring system described in the Mental Health Clustering Booklet. The booklet is a thick manual that needs to be reproduced in colour to allow practitioners to make complex decisions using a set of definitions, flow charts and tables. It is now supported by a computerised clustering algorithm. The algorithm allows the HoNOS and historical ratings to be converted into a small number of suggested clusters, each with a calculated probability. This can be tried out as an Excel spreadsheet (Department of Health 2013b). The algorithm is a significant practical step forwards for experienced clinicians, who can now complete an initial MHCT and allocate a cluster in less than 10 minutes. Less experienced staff may need more time, including time for supervision.

FIG 1

Flow chart for clustering. HoNOS, Health of the Nation Outcome Scales; MHCB, Mental Health Clustering Booklet; MHCT, Mental Health Clustering Tool.

Clustering can be carried out by an individual practitioner or a team. The team approach could help generate higher-quality cluster assignments since it provides immediate peer supervision.

Once the clinical assessment or review is complete, practitioners will log into their IT system, select the patient record and open the computerised MHCT. They then fill in the ratings in line with their clinical knowledge of the patient. They also decide whether the person being clustered has a non-psychotic, a psychotic or an organic disorder. These three domains are called ‘super classes’. They make a big difference to the final cluster allocation. The Mental Health Clustering Booklet can be used to guide the final cluster allocation, but running the clustering algorithm will be faster and simpler. Both require a decision about how to order the ratings in the clusters. To do this strictly, the practitioner using the booklet must ensure that the essential ratings for each cluster (red ratings) are considered first. The algorithm user must switch on the ‘red rules’. Further information can be found in the Mental Health Clustering Booklet.

The clustering booklet gives explicit descriptions of rating scales that are generally precise and understandable, but staff may misunderstand the ratings for several items because the item title, read independently of the description, may be misleading. Box 1 gives some examples.

The clinician can choose whatever cluster they deem fit, but it is hard to see why anyone would disagree with the clustering algorithm without a good reason, since clustering defines itself, and to diverge from the algorithm could introduce random variation. It is important for doctors and non-medics not to transfer diagnostic assumptions into the clustering process by confusing clinical terms with the cluster names. At the time of writing, the algorithm is only beginning to be implemented on IT systems in some services: 18 months after it was first published in December 2012. Use of the variance cluster (0) when no cluster decision can be made will be discouraged since it is not likely to be well funded.

Cluster review

After a period of time specified within each cluster definition (from 4 to 52 weeks; Table 1), or sooner if clinical status changes significantly, there should be a review of the cluster allocated. The patient’s cluster allocation may stay the same, or step up or step down. A step up represents an increase in a combination of factors, including severity of needs, acuity of symptoms and complexity of care. A step-down cluster should reflect a sustained reduction in severity, acuity, complexity or intensity of care.

TABLE 1

Clusters arranged in order of descending value (unit cost per day)^a

The IT system should remind clinicians when reclustering is necessary so that they can repeat the MHCT. Then they should observe the criteria in the cluster transition protocols in the Mental Health Clustering Booklet. These are not yet available for the computerised algorithm. If criteria for a step-up cluster are met, the patient is reallocated to this cluster. If not, the practitioner should check the local discharge criteria. If these are met, then the patient may be discharged. If the discharge criteria are not met, then, using the new MHCT result, the clinician should consider whether criteria are met for either moving to a step-down cluster or remaining in the current cluster. The chosen cluster should reflect the assessed clinical status of the patient. Patients making a clear sustained recovery should step down to lower clusters and patients getting more unwell should step up to higher clusters that can resource more intensive care packages. This is a very complex process, especially for general adult teams, which need to be familiar with the whole range of clusters. There could be conflicts between the cluster transition protocols, the MHCT result and the clustering algorithm, so it is helpful that the clinician is able to make the final choice of cluster reallocation.

When should clustering take place?

The Mental Health Clustering Booklet (Department of Health 2013a) recommends that clustering be undertaken in each of the following situations:

1. • at the end of the initial assessment (within two contacts, or 2 days for in-patients)

2. • at all planned care programme approach (CPA) or other formal care reviews

3. • at reassessments specified by the cluster review period (e.g. at least every 4 weeks for cluster 14, psychotic crisis)

4. • at any other point where a significant change in planned care is deemed necessary (e.g. unplanned reviews, urgent admissions).

When should clustering not take place?

Reclustering should not automatically take place at service transitions (e.g. discharge from a ward). It should happen only when a cluster reaches the end of its predetermined review period, or a patient’s needs change significantly so that the current cluster is inaccurate and the care package no longer matches those needs. This is particularly important when a patient is getting better. Downgrading a cluster too soon while needs remain high will, in effect, withdraw resources for treatment. Since the clinical imperative will be to continue treatment, the effect will be a loss of income. This is a form of down-coding, or underestimating the cost of care.

In early trials of clustering, if clinicians completed clusters at the end of a hospital admission when a patient was better, rather than at the start when the patient was unwell, they would down-code the whole hospital episode to a ‘common mental health problem’ instead of a more appropriate cluster such as ‘psychotic crisis’. In future, this basic misunderstanding will be disastrous for income. Clinical staff need good training and supportive IT systems to deliver accurate clustering.

Clustering requires a patient focus rather than a service focus, but many trusts are organised and managed along service lines. The National Service Framework and other drivers encouraged services to fragment care into ‘functional models’, which means that patients move from one functionalised service to another with considerable frequency instead of remaining with a consistent care team. Trusts with a service-line focus may decide that clustering needs to take place at every service transition. This could lead to unnecessarily frequent cluster reviews, which will divert time away from direct patient care. This also risks inadvertent premature down-coding if patients make temporary improvements and then relapse. Cluster reviews should reflect sustained changes in each patient’s status and these changes will not always fit neatly with service transitions.

The cost of clustering

Clustering has direct and indirect costs due to demands on clinical time, IT system development and training. The clinical cost will be borne directly by practitioners and indirectly by patients. Further requirements are already planned, including increased data collection for the mental health minimum data-set (MHMDS), additional intervention codes and a suite of outcome measures (Department of Health 2013c), all of which may reduce time for direct patient contact.

Considerable investment may be needed to make IT systems fit for purpose, since providers could stand to lose income if clustering is not carried out reliably. Most clinicians in functionalised services will not be able to keep up with cluster transition reviews without being reminded, because teams do not have continuous relationships with patients. Consequently, IT systems will also need to support care pathways as they are introduced, especially in general mental health services. General teams do high volumes of work covering the full range of mental health PbR clusters, National Institute for Health and Care Excellence (NICE) guidance and care pathways. Care coordinators have large case-loads. It is inconceivable that the clustering work can be done efficiently without very good IT support. IT systems should also be capable of synthesising the data from the clustering process, including clinical outcomes, and delivering reports back to clinical teams. This feedback of outcomes to teams is a potential return on the investment of clinical time in the clustering process and could help clinical teams improve quality.

Guidance on implementing PbR for mental health services recommends that trusts create a PbR lead, a PbR finance lead and a PbR informatics lead, as well as PbR champions in specific areas (Department of Health 2013d). It also recommends that organisations have a number of clinical experts in the use of clusters who cascade their expertise to other staff. Training and supervision in mental health clustering should be led by clinicians, who have experience on the ground of using the system. The Royal College of Psychiatrists and other training bodies offer courses in mental health clustering. The training should be regularly updated to account for developments in mental health PbR and clustering. Training should be aimed at helping clinicians perform clustering efficiently and reliably while retaining their time for patient contact.

OutcomesFootnote ‡

Commissioners are advised to consider not just the cost of provision but quality and outcomes as well (Department of Health 2013c: p.11). Clinicians will need to demonstrate good outcomes to distinguish themselves in the new market of fixed prices. The guidance for mental health PbR and clustering recommends that services collect three main types of outcome: clinician-rated outcome, patient-reported outcome and patient-reported experience.

Clinician-rated outcome measures (CROMs) include the HoNOS element of the MHCT. It is a good measure to start with but it may be affected by gaming, since relatively inconsequential changes in ratings on a single HoNOS item can shift patients into clusters that deliver much higher or lower income. Separate CROMs may be more appropriate in future and there are plenty to choose from.

The second type of outcome is assessed using a patient-reported outcome measure (PROM). Again there are several such measures, but the PbR guidance (Department of Health 2013d) makes specific reference to the Warwick–Edinburgh Mental Well-being Scale (WEMWBS). This is a brief patient-rated questionnaire that gives a single total score. It has been validated in a general population sample involving students (Reference Tennant, Hiller and FishwickTenant 2007) and work is progressing to look at clinical populations (Department of Health 2013c: p. 12). A shorter version of the scale (SWEMWBS) has now replaced the WEMWBS as the recommended PROM for reporting purposes.

The final type of measure is a patient-reported experience measure (PREM). Here the guidance is less developed, but it will probably involve the ‘friends and family’ question (Department of Health 2013c: p. 12) in which patients are asked to rate (on a five-point scale) the likelihood of them recommending the service to their friends and family.

A critical factor for success with outcomes is the use of the IT infrastructure to help prompt, collect and analyse outcomes for teams to reflect upon as well as to report them centrally. Mental health PbR will in effect introduce routine outcome measurement across mental health services in England for the first time.

What is not covered by mental health clustering?

Cluster prices do not include the cost of the initial assessment, rates for which need to be negotiated separately. Comorbid physical health problems treated by mental health services are not currently included within clusters. Local negotiations will need to work out how to pay for this additional care. Mental health PbR guidance suggests that physical comorbidities can be recorded using the MHMDS and this can be used to charge funders (Department of Health 2013c: section 18.5). Many specialist services are currently excluded from mental health clustering and these are listed in Box 2.

Likely challenges with clustering

Mental health PbR is a slowly developing process. To date, practitioners may have had a little training and been asked to get only one cluster recorded on each patient. In future, this will become a constant rolling routine and therefore could divert time from clinical work to finance. Clinical staff need to engage positively with this financial process and its challenges, which have no cultural precedent in the English NHS. Excellent change management skills are needed in NHS organisations to make the introduction successful.

Clustering is based on a medical model and so focuses on deficit: people are seen as broken and in need of fixing. The HoNOS, however, talk of problems and symptoms that need rectifying. The notion of strengths and recovery despite symptoms is not addressed directly by the MHCT and historical problems will cast a long shadow. A study comparing clusters with six scales of the Model of Human Occupation Screening Tool (MOHOST), used in occupational therapy, found that clustering did not represent the same needs groupings as the MOHOST, suggesting a difference between occupational needs and mental health clusters (Reference Lee, Forsyth and MorelyLee 2013). Another study found that nearly half of people with an intellectual disability attending a community team could not be clustered at all (Reference Radhakrishnan, Smith and O'HaraRadhakrishnan 2012). It is likely that the clustering tool will evolve to address such shortcomings.

Some research into outcomes of treatment for psychosis indicates that good long-term outcomes are not necessarily linked to symptom reduction. Medical treatment of psychosis can reduce symptoms in the short term, something that has a financial incentive in mental health PbR. The same incentive could worsen long-term functional outcomes because long-term medical treatment of symptoms may be associated with poorer long-term functional outcomes (Reference Wunderink, Nieboer and WiersmaWunderink 2013).

Clusters may be too ‘high level’ to capture detailed variation in costs of service provision within a cluster. It is likely that providers’ cluster costs will be higher for patients from deprived areas where poor housing, unemployment and substance misuse are more common. Within the same cluster, services may be cheaper to provide in affluent areas where patients have better resources and support networks. This may require a financial adjustment of some sort to encourage providers to offer services to deprived areas. This may make a national tariff scheme difficult to implement.

Sometimes clinical disagreement about MHCT ratings may cause clusters to oscillate. Different clinicians may make very different ratings, so PbR will throw a spotlight on variation in practice. Practitioners and managers should be careful not to have knee-jerk reactions to the data that mental health PbR throws up. Training and supervision can address variation.

The main practical problem of clustering will be that of poor IT support. If the IT system cannot help practitioners do the job of clustering quickly and efficiently, then they may fail to achieve acceptable levels of compliance or quality. The solution is to build very good clustering support into IT systems that are universally used throughout the organisation. In future these systems must also support the use of outcomes and care pathways in combination with clustering.

Gaming

Financial incentives change behaviour. The behaviour that organisations and individuals engage in to maximise income is sometimes called gaming. General practitioner commissioners have complained that trusts in acute physical care game their PbR systems (Reference VizeVize 2013). Gaming can create perverse activity. For example, some trusts facing financial penalties for failing to meet 4-hour waiting time targets in accident and emergency (A & E) departments apparently made patients wait outside in ambulances so as to delay the actual entry to A & E, when the clock starts ticking (Reference Watts and DonnellyWatts 2012).

MCQs

Select the single best option for each question stem

1. 1 Clustering is:

   1. a a clinical process of allocating payments

   2. b a financial process of allocating diagnosis

   3. c a financial process using clinical terms

   4. d a clinical process using financial terms

   5. e an IT system combining diagnosis and payment.

2. 2 Clinicians:

   1. a need to cluster each patient only once

   2. b should pick the cluster with the highest payment

   3. c must recluster every 6 months

   4. d can use diagnoses and clusters interchangeably

   5. e can make the final clustering decision.

3. 3 Outcomes recommended by the Department of Health in relation to mental health payment by results include:

   1. a CORE

   2. b SWEMWBS

   3. c marital status

   4. d physical health

   5. e MOHOST.

4. 4 Down-coding:

   1. a reduces income

   2. b increases income

   3. c improves outcomes

   4. d is a common form of gaming

   5. e cannot happen accidentally.

5. 5 The Mental Health Clustering Tool:

   1. a has no impact on clinical time with patients

   2. b is a method of prospectively allocating payment for services

   3. c uses only symptom scores

   4. d cannot yet be supported by a computer algorithm

   5. e does not address case mix.

MCQ answers

1

c

2

e

3

b

4

a

5

b