Competence or excellence? Invited commentary on... Workplace-based assessments in Wessex and Wales

This commentary discusses the problems with workplace-based assessments and 
questions whether these methods are fit for purpose. It suggests that there is 
a risk that assessment methods that focus on competence may undermine the need 
for trainees to aspire to acquire excellent skills rather than merely be 
competent, which is no more than a rigid adherence to standardised and 
routinised procedures.

This commentary discusses the problems with workplace-based assessments and questions whether these methods are fit for purpose. It suggests that there is a risk that assessment methods that focus on competence may undermine the need for trainees to aspire to acquire excellent skills rather than merely be competent, which is no more than a rigid adherence to standardised and routinised procedures.
Workplace-based assessments (WPBAs) have increased in importance as the limitations of tests of competence such as objective structured clinical examinations have become more obvious. Thus, assessment methods that rely on standardised and objectified tasks in a controlled laboratory-like environment are returning full circle to the assessment of trainees in the real world of patients and the workplace. 1 The concern about the variance introduced by real cases and the emphasis on the desirability of 'standardised patients' has lessened with the use of tools such as the mini-Clinical Evaluation Exercise (mini-CEX) in work-based assessments. 2  world encounters, is accompanied by reliable and worthy results. The genuine fear is that WPBAs may be unreliable, lacking in rigour and not fit for purpose, whatever educational principles say or demonstrate.

Assessors' training
Part of the problem is undue reliance on assessments by assessors inadequately trained in the use of the relevant assessment tools and also having little knowledge of the methods under consideration. This is what the papers by Babu et al 5

Bureaucracy
Furthermore, to the degree that these assessments are required as part of a culture of collecting evidence for a portfolio, there is a sense in which they are part of a bureaucratic process that is gradually becoming decoupled from the primary purpose, which is determining whether an individual doctor is good and safe enough for independent practice. As ever, the risk is that the token will come to be taken as the real thing. Our predilection as human beings to worship idols, or tokens, often surfaces in the most unusual places.

Interpreting the assessments
Finally, and more serious, there is the conflation of formative and summative assessment methods. Tools that are ideal for determining strengths and weaknesses of a trainee that ought to be utilised in guiding training and as diagnostic tools have come to stand as part of the evidence of competence and collected as such. The trainees in both surveys 5,6 recognise these problems and are at best ambivalent about the value of these assessment methods.

Shifting the focus
There is, though, a deeper problem. It can be argued that there is a disproportionate preoccupation with competence rather than expertise or excellence in the current system of training and appraising trainees. Any system that aims for a rigid adherence to conscious deliberation, to standardised and routinised procedures, for that is what competence is, is seeking not to institute proficiency or expertise but something less worthwhile and perhaps even damaging to the profession. There seems little doubt that the aim of these methods is to recognise, identify and sign off competence. There is a need for a greater understanding of the cognitive aspects of expertise, 7 an understanding that will eventually lead to the recognition and acceptance that expertise requires judgement which is context dependent. Experts rely on intuitive appraisals of clinical situations, on automated algorithms that often defy verbal exposition. They tend to revert to laboured and slow analytic modes of thinking only in the face of novel situations. Once the nature of the acquisition of expertise is grasped, the implications for the overall goal of training in medicine will become clearer and it may be that these modern assessment methods aim far too low and thereby stultify motivation.