Hostname: page-component-8448b6f56d-c47g7 Total loading time: 0 Render date: 2024-04-23T06:27:15.474Z Has data issue: false hasContentIssue false

Observing competence in CBT supervision: a systematic review of the available instruments

Published online by Cambridge University Press:  24 November 2011

Derek L. Milne*
Affiliation:
School of Psychology, Newcastle University, UK
Robert P. Reiser
Affiliation:
Palo Alto University, CA, USA
*
*Author for correspondence: D. L. Milne, Ph.D., School of Psychology, Ridley Building, Newcastle University, Newcastle upon Tyne NE1 7RU, UK (email: d.l.milne@ncl.ac.uk).

Abstract

Government policy, like evaluations of clinical practice, indicates the growing importance of supervision in fostering practitioner development and in improving the fidelity of therapies. However, instruments with which to measure competent supervision are often problematic, thereby hampering these key activities (e.g. they are rare, rely on self-ratings by participants, and psychometric data can be limited). To contribute to progress, this paper reviews the current options for measuring competent clinical supervision by means of direct observation, a favoured approach within cognitive behaviour therapy (CBT). We systematically reviewed 10 existing instruments that were designed to observe and quantify competent supervision, focusing on three broad criteria for sound measurement (i.e. an instrument's Design, Implementation, and Yield: DIY). Suggestions for future research on instruments that can fulfil the functions that are provided distinctively through direct observation are outlined.

Type
Review
Copyright
Copyright © British Association for Behavioural and Cognitive Psychotherapies 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Alliger, GM, Tannenbaum, SI, Bennett, W, Traver, H, Shotland, A (1997). A meta-analysis of the relations among training criteria. Personnel Psychology 50, 341359.CrossRefGoogle Scholar
Anastasi, A, Urbina, S (1997). Psychological Testing. NJ: Prentice-Hall.Google Scholar
APA Presidential Task Force (2006). American Psychological Association Presidential Task Force on evidence-based practice in psychology. American Psychologist 61, 271285.CrossRefGoogle Scholar
Baer, JS, Ball, SA, Campbell, BK, Miele, GM, Schoener, EP, Tracy, K (2006). Training and fidelity monitoring of behavioural interventions in multisite addictions research. Drug and Alcohol Dependence 87, 107118.CrossRefGoogle Scholar
Bambling, M, King, R, Raue, P, Schweitzer, R, Lambert, W (2006). Clinical supervision: its influence on client-rated working alliance and client symptom reduction in the brief treatment of major depression. Psychotherapy Research 16, 317331.CrossRefGoogle Scholar
Barkham, M, Evans, C, Margison, F, McGrath, G, Mellor-Clark, J, Milne, DL, Connell, J (1998). The rationale for developing and implementing core outcome batteries for routine use in service settings and psychotherapy outcome research. Journal of Mental Health 7, 3547.Google Scholar
Barlow, DH, Nock, MK, Hersen, M (2009). Single-Case Experimental Designs: Strategies for Studying Behavior Change. Boston: Allyn & Bacon.Google Scholar
Bellg, AJ, Borrelli, B, Resnick, B, Hecht, J, Minicucci, DS, Ory, M, Ogedegbe, G, Orwig, D, Ernst, D, Czajkowski, S (2004). Enhancing treatment fidelity in health behaviour change studies: Best practises and recommendations from the NIH Behaviour Change Consortium. Health Psychology 23, 443451.CrossRefGoogle Scholar
Bernard, JM, Goodyear, RK (1998). Fundamentals of Clinical Supervision (2nd edn). London: Pearson.Google Scholar
Cherniss, C (1986). Instrument for observing supervisor behaviour in educational programs for mentally retarded children. American Journal of Mental Deficiency 91, 1821Google ScholarPubMed
Clark, HB, Wood, R, Kuehnel, T, Flanagan, S, Mosk, M, Northup, JT (1985). Preliminary validation and training of supervisory interactional skills. Journal of Organizational Behavior Management 7, 95115.CrossRefGoogle Scholar
Copeland, HL, Hewson, MG (2000). Developing and testing an instrument to measure the effectiveness of clinical teaching in an academic medical centre. Academic Medicine 75, 161166CrossRefGoogle Scholar
Department of Health (1993). A vision for the future. London: NHS Executive.Google Scholar
Department of Health (2001). Working together – learning together: a framework for lifelong learning for the NHS. London: Department of Health.Google Scholar
Department of Health (2004). Organising and delivering psychological therapies. London: Department of Health.Google Scholar
Dreyfus, HL, Dreyfus, SE (1986). Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer. Oxford: BlackwellGoogle Scholar
Ducharme, JM, Williams, L, Cummings, A, Murray, P, Spencer, T (2001). General case quasi-pyramidal staff training to promote generalization of teaching skills in supervisory and direct-care staff. Behavior Modification 25, 233254.CrossRefGoogle ScholarPubMed
Ellis, MV, Ladany, N (1997). Inferences concerning supervisees and clients in clinical supervision. An integrative review. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 447507. New York: Wiley.Google Scholar
Ellis, MV, D'Iuso, N, Ladany, N (2008). State of the art in the assessment, measurement, and evaluation of clinical supervision. In: Psychotherapy Supervision: Theory, Research and Practice (ed. Hess, A. K., Hess, K. D. and Hess, T. H.), pp. 473499. Chichester: Wiley.Google Scholar
Epstein, RM, Hundert, EM (2002). Defining and assessing professional competence. Journal of the American Medical Association 287, 226235.CrossRefGoogle ScholarPubMed
Falender, CA, Shafranske, E (2004). Clinical Supervision: A Competency-based Approach. Washington, DC: APA.CrossRefGoogle Scholar
Falender, CA, Shafranske, EP (2008). Casebook for Clinical Supervision: A Competency-Based Approach. Washington, D.C: American Psychological Association.CrossRefGoogle Scholar
Falender, CA, Shafranske, E (2010). Psychotherapy-based supervision models in an emerging competency-based era: a commentary. Psychotherapy Theory, Research, Practice and, Training 47, pp. 4550. Washington, DC: APA.Google Scholar
Fleming, RK, Oliver, JR, Bolton, DM (1996). Training supervisors to train staff: a case study in a human service organization. Journal of Organizational Behavior Management 16, 325.CrossRefGoogle Scholar
Gilbody, S, Bower, P, Fletcher, J, Richards, D, Sutton, AJ (2006). Collaborative care for depression: a meta analysis and review of longer-term outcomes. Archives of Internal Medicine 166, 23142320.CrossRefGoogle ScholarPubMed
Gregoire, TK, Propp, J, Poertner, J (1998). Supervisors’ role in the transfer of training. Administration in Social Work 22, 117.CrossRefGoogle Scholar
Heaven, C, Clegg, J, McGuire, P (2005). Transfer of communication skills training from workshop to work place: the impact of clinical supervision. Patient Education and Counselling 60, 313325.CrossRefGoogle ScholarPubMed
Henggeler, SW, Schoenwald, SK, Liao, JG, Letourneau, EJ, Edwards, DL (2002). Transporting efficacious treatments to field settings: the link between supervisory practices and therapist fidelity in MST programmes. Journal of Clinical Child Psychology 31, 155167.CrossRefGoogle Scholar
Iberg, JR (1991). Applying statistical process control theory to bring together clinical supervision and psychotherapy research. Journal of Consulting and Clinical Psychology 59, 575586.CrossRefGoogle ScholarPubMed
James, IA, Blackburn, IM, Milne, DL, Freeston, M (2005). Supervision training and rating scale for cognitive therapy (stars - CT). Newcastle Cognitive Therapy Centre, England.Google Scholar
Kaslow, NJ, Borden, KA, Collins, FL, Forrest, L, Illfelder-Kaye, J, Nelson, PD (2004). Competencies conference: future directions in education and credentialing in professional psychology. Journal of Clinical Psychology 60, 699712.Google Scholar
Kazdin, AE (1998). Research Design in Clinical Psychology. Boston: Allyn Bacon.Google Scholar
Kenkel, MB, Peterson, R.L. (2010). Competency-Based Education for Professional Psychology. Washington, D.C.: American Psychological Association.CrossRefGoogle Scholar
Komaki, JL, Zlotnick, S, Jensen, M (1986). Development of an operant-based taxonomy and observational index of supervisory behaviour. Journal of Applied Psychology 71, 260269.CrossRefGoogle Scholar
Kraiger, K, Ford, JK, Salas, E (1993). Application of cognitive, skill based and affective theories of learning outcomes to new methods of training evaluation. Journal of Applied Psychology 78, 311328.CrossRefGoogle Scholar
Lambert, NJ, Ogles, BM (1997). The effectiveness of psychotherapy supervision. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 421446. New York: Wiley.Google Scholar
Liese, BS, Beck, JS (1997). Cognitive therapy supervision. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 114133. New York: Wiley.Google Scholar
Lucock, MP, Hall, P, Noble, R (2006). A survey of influences on the practice of psychotherapists and clinical psychologists in training in the UK. Clinical Psychology and Psychotherapy 13, 123130.Google Scholar
Milne, DL (2007). Evaluation of staff development: the essential ‘SCOPPE’. Journal of Mental Health 16, 389400.CrossRefGoogle Scholar
Milne, DL, James, IA (2002). The observed impact of training on competence in clinical supervision. British Journal of Clinical Psychology 41, 5572.CrossRefGoogle ScholarPubMed
Milne, DL, James, IA, Keegan, D, Dudley, M (2002). Teachers PETS: a new observational measure of experiential training interactions. Clinical Psychology and Psychotherapy 9, 187199.CrossRefGoogle Scholar
Milne, DL, Reiser, R, Aylott, H, Dunkerley, C, Fitzpatrick, H, Wharton, S (2010). The systematic review as an empirical approach to improving CBT supervision. International Journal for Cognitive Psychotherapy 3, 278293.Google Scholar
Olk, ME, Friedlander, ML (1992). Trainees experience of role conflict and role ambiguity in supervisor relationships. Journal of Counselling Psychology 39, 389397.CrossRefGoogle Scholar
Parsons, MB, Reid, DH (1995). Training residential supervisors to provide feedback for maintaining staff teaching skills with people who have severe disabilities. Journal of Applied Behaviour Analysis 28, 317322.CrossRefGoogle ScholarPubMed
Petticrew, M, Roberts, H (2006). Systematic Reviews in the Social Sciences: A Practical Guide. Oxford: Blackwell.Google Scholar
Prescott, LE, Nocini, JJ, McKinlay, P, Rennie, JS (2002). Facing the challenges of competency based assessment of post-graduate dental training: longitudinal evaluation of performance (LEP). Medical Education 36, 9297.Google Scholar
Reid, DH, Rotholz, DA, Parsons, MB, Morris, L, Braswell, BA, Green, C, Schell, RM (2003). Training human service supervisors in aspects of PBS: Evaluation of a state-wide, performance based program. Journal of Positive Behavior Interventions 5, 3546.CrossRefGoogle Scholar
Roth, A, Fonagy, P (1996). What Works for Whom? A Critical Review of Psychotherapy Research. New York: Guilford Press.Google Scholar
Roth, AD, Pilling, S (2008). Using an evidence-based methodology to identify the competencies required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders. Behavioural and Cognitive Psychotherapy 36, 129147.CrossRefGoogle Scholar
Schacht, AJ, Howe, HE junior, Berman, JJ (1988). A short form of the Barrett–Lennard relationship inventory for supervisor relationships. Psychological Reports 63, 699706.CrossRefGoogle Scholar
Shanfield, SB, Mohl, PC, Matthews, KL, Hetherly, V (1989). A reliability assessment of the psychotherapy supervisory inventory American Journal of Psychiatry 146, 14471450.Google ScholarPubMed
Shanfield, SB, Mohl, PC, Matthews, KL, Hetherly, V (1992). Quantitative assessment of the behaviour of psychotherapy supervisors. American Journal of Psychiatry 149, 352357.Google Scholar
Sudak, D, Wright, J, Bienenfeld, D, Beck, J (2001). Cognitive behaviour therapy supervision checklist. Philadelphia: Cognitive Therapy Centre.Google Scholar
Vleuten, CPM, Schuwirth, LWT (2005). Assessing professional competence: from methods to programmes. Medical Education 39, 309317.CrossRefGoogle ScholarPubMed
Wampold, BE, David, B, Good, RH (1990). Hypothesis validity of clinical research. Journal of Consulting and Clinical Psychology 58, 360367.CrossRefGoogle ScholarPubMed
Watkins, CE (ed.) (1997). Handbook of Psychotherapy Supervision. New York: Wiley.Google Scholar
Watkins, CE (1998). Psychotherapy supervision in the 21st century. Journal of Psychotherapy Practice & Research 7, 93101.Google ScholarPubMed
White, JHD, Rudolph, BA (2000). A pilot investigation of the reliability and validity of the Group Supervisory Behavior Scale (GSBS). The Clinical Supervisor 19, 161171.CrossRefGoogle Scholar
Submit a response

Comments

No Comments have been published for this article.