Skip to main content
×
×
Home

Assessing competence in cognitive-behavioural therapy

Abstract
Background

Postgraduate courses on cognitive-behavioural therapy (CBT) assess various competencies using essays, case studies and audiotapes or videotapes of clinical work

Aims

To evaluate how reliably a well-established postgraduate course assesses CBT competencies

Method

Data were collected on two cohorts of trainees (n=52). Two examiners marked trainees on: (a) two videotapes of clinical practice; (b) two case studies; and (c) three essays

Results

Essay examinations were more reliable than case studies, which in turn were more reliable than videotaped assessments. The reliability of the latter two assessments was considerably lower than that commonly expected of high-stakes examinations. To assess reliably standard CBT competencies, postgraduate courses would need to examine about 5 essays, 12 case studies and 19 videotapes

Conclusions

Reliable assessment of standard competencies is complex and resource intensive. There would need to be a marked increase in the number of samples of clinical work assessed to be able to make reliable judgements about proficiency

    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Assessing competence in cognitive-behavioural therapy
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about sending content to Dropbox.

      Assessing competence in cognitive-behavioural therapy
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about sending content to Google Drive.

      Assessing competence in cognitive-behavioural therapy
      Available formats
      ×
Copyright
Corresponding author
Dr Andrew Keen, Child and Family Mental Health Service, Royal Aberdeen Children's Hospital, Westburn Road, Aberdeen AB25 2ZD. Email: Andrew.Keen@ARH.grampian.scot.nhs.uk
Footnotes
Hide All

Declaration of interest

M.F. is Director of the Diploma in Cognitive Therapy, whose examinations are detailed herein.

Footnotes
References
Hide All
1 Department of Health. National Service Framework for Mental Health: Modern Standards and Service Models. Department of Health, 1999.
2 National Institute of Clinical Excellence. Our Guidance. NICE, 2006.
3 Layard R. The case for psychological treatment centres. BMJ 2006; 332: 1030–2.
4 Department of Health. Organising and Delivering Psychological Therapies. Department of Health, 2006.
5 British Association for Behavioural Cognitive Psychotherapies. Minimum Training Standards for the Practice of CBT. BABCP, 2006.
6 Blackburn IM, James IA, Milne DL, Baker C, Standart S, Garland A, Reichelt FK. The revised cognitive therapy scale (CTS-R): psychometric properties. Behav Cogn Psychother 2001; 29: 431–46.
7 Shavelson RJ, Webb NM, Rowley GL. Generalizability theory. Am Psychol 1989; 44: 922–32.
8 Streiner DL, Norman GR. Health Measurement Scales. Oxford University Press, 2004.
9 Wass V, van der Vleuten C, Shatzer J, Jones R. Assessment of clinical competence. Lancet 2001; 357: 945–9.
10 Downing S. Reliability: on the reproducibility of assessment data. Med Educ 2004; 38: 1006–12.
11 Eva KW. On the generality of specificity. Med Educ 2003; 37: 587–8.
12 van der Vleuten CPM, Swanson DB. Assessment of clinical skills with standardized patients: state of the art. Teach Learn Med 1990; 2: 5876.
13 Vu NV, Barrows HS. Use of standardized patients in clinical assessments: recent developments and measurement findings. Educ Res 1994; 23: 2330.
14 Norman GR. Research in medical education: three decades of progress. BMJ 2002; 324: 1560–2.
15 Miller GE. The assessment of clinical skills/competence/performance. Acad Med 1990, 65 (suppl 9): S637.
16 Brown N, Doshi M. Assessing professional and clinical competence: the way forward. Adv Psychiatr Treat 2006; 12: 81–9.
17 Govaerts MJB, van der Vleuten CPM, Schuwirth LWT, Muijtjens AMM. Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv Health Sci Educ 2007; 12: 239–60.
18 Keen A, Klein S, Alexander DA. Assessing the communication skills of doctors in training: reliability and sources of error. Adv Health Sci Educ 2003; 8: 516.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

The British Journal of Psychiatry
  • ISSN: 0007-1250
  • EISSN: 1472-1465
  • URL: /core/journals/the-british-journal-of-psychiatry
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 4 *
Loading metrics...

Abstract views

Total abstract views: 4 *
Loading metrics...

* Views captured on Cambridge Core between 2nd January 2018 - 21st January 2018. This data will be updated every 24 hours.

Assessing competence in cognitive-behavioural therapy

Submit a response

eLetters

No eLetters have been published for this article.

×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *