Hostname: page-component-76fb5796d-9pm4c Total loading time: 0 Render date: 2024-04-25T10:50:24.525Z Has data issue: false hasContentIssue false
  • English
  • Français

SAGE: preliminary evaluation of an instrument for observing competence in CBT supervision

Published online by Cambridge University Press:  08 December 2011

Derek L. Milne ,
Robert P. Reiser ,
Tom Cliffe  and
Rosamund Raine
Derek L. Milne*
Affiliation:
School of Psychology, Newcastle University, UK
Robert P. Reiser
Affiliation:
Palo Alto University, CA, USA
Tom Cliffe
Affiliation:
School of Psychology, Newcastle University, UK
Rosamund Raine
Affiliation:
School of Psychology, Newcastle University, UK
*
*Author for correspondence: D. L. Milne, Ph.D., School of Psychology, Ridley Building, Newcastle University, Newcastle upon Tyne NE1 7RU, UK (email: d.l.milne@ncl.ac.uk).
Get access Rights & Permissions [Opens in a new window]

Abstract

Clinical supervision plays a recognized role in facilitating practitioner development and in promoting therapeutic fidelity, but instruments that can support such activities by measuring competence in supervision are rare and often psychometrically compromised. As part of a research programme intended to raise the empirical status of supervision, we describe the initial psychometric development of a new instrument for observing competence (Supervision: Adherence and Guidance Evaluation; SAGE). This instrument is suitable for measuring CBT supervision, and can be administered by self-rating or by an independent observer. Preliminary tests of the reliability and validity of SAGE suggest that it is a promising tool for evaluating supervision. In addition, SAGE can be applied readily and has good utility. In these respects, SAGE appears to have some advantages over existing instruments, and may therefore provide a basis for enhancing research and practice in CBT supervision. Suggestions for future research on SAGE are outlined, particularly the need for a generalizability analysis.

Keywords

Clinical supervisioncompetencedirect observationinstrument
Type
Education and supervision
Information
the Cognitive Behaviour Therapist , Volume 4 , Issue 4 , December 2011 , pp. 123 - 138
Copyright
Copyright © British Association for Behavioural and Cognitive Psychotherapies 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Recommended follow-up reading

Falender, CA, Cornish, JAE, Goodyear, R, Hatcher, R, Kaslow, NJ, Leventhal, G, Shafranske, E, Sigmon, ST, Stoltenburg, C, Grous, C (2004). Defining competencies in psychology supervision: a consensus statement. Journal of Clinical Psychology 60, 771–785.CrossRefGoogle ScholarPubMed

References

Ablon, JS, Jones, EE (2002). Validity of controlled clinical trials of psychotherapy: findings from the NIMH treatment of depression collaborative research program. American Journal of Psychiatry 159, 775–793.CrossRefGoogle ScholarPubMed
Anastasi, A, Urbina, S (1997). Psychological Testing. New Jersey: Prentice-Hall.Google Scholar
BABCP (2009). Standards of Conduct, Performance and Ethics in the Practice of Behavioural and Cognitive Psychotherapy. Bury: British Association for Behavioural and Cognitive Psychotherapy.Google Scholar
Bambling, M, King, R, Raue, P, Schweitzer, R, Lambert, W (2006). Clinical supervision: its influence on client-rated working alliance and client symptom reduction in the brief treatment of major depression. Psychotherapy Research 16, 317–331.CrossRefGoogle Scholar
Barkham, M, Evans, C, Margison, F, McGrath, G, Mellor-Clark, J, Milne, DL, Connell, J (1998). The rationale for developing and implementing core outcome batteries for routine use in service settings and psychotherapy outcome research. Journal of Mental Health 7, 35–47.Google Scholar
Barlow, DH, Nock, MK, Hersen, M (2009). Single-Case Experimental Designs: Strategies for Studying Behaviour Change. Boston: Allyn & Bacon.Google Scholar
Bellg, AJ, Borrelli, B, Resnick, B, Hecht, J, Minicucci, DS, Ory, M, Ogedegbe, G, Orwig, D, Ernst, D, Czajkowski, S (2004). Enhancing treatment fidelity in health behaviour change studies: best practises and recommendations from the NIH Behaviour Change Consortium. Health Psychology 23, 443–451.CrossRefGoogle Scholar
Bernard, JM, Goodyear, RK (2004). Fundamentals of Clinical Supervision, 3rd edn. London: Pearson.Google Scholar
Bordin, ES (1983). Supervision in counselling: contemporary models of supervision: a working alliance-based model of supervision. The Counselling Psychologist 11, 35–42.CrossRefGoogle Scholar
BPS (2009). Directory for Applied Psychology Practice Supervisors. Leicester: British Psychological Society.Google Scholar
DoH (2009). New Horizons: Towards a Shared Vision for Mental Health. London: Department of Health.Google Scholar
Dreyfus, HL, Dreyfus, SE (1986). Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer. Oxford: Blackwell.Google Scholar
Efstation, JF, Patton, MJ, Kardish, CM (1990). Measuring the working alliance in counsellor supervision. Journal of Counselling Psychology 37, 322–329.CrossRefGoogle Scholar
Ellis, MV, Ladany, N (1997). Inferences concerning supervisees and clients in clinical supervision: an integrative review. In: Handbook of PsychotherapySupervision (ed. Watkins, C. E.), pp. 447–507. New York: Wiley.Google Scholar
Epstein, RM, Hundert, EM (2006). Defining and assessing professional competence. Journal of American Medical Association 287, 226–235.CrossRefGoogle Scholar
Falender, CA, Shafranske, EP (2004). Clinical Supervision: A Competency-based Approach. Washington, DC: APA.CrossRefGoogle Scholar
Falender, CA, Shafranske, EP (2008). Casebook for Clinical Supervision. Washington DC: American Psychiatric Association.Google Scholar
Falender, CA, Shafranske, EP (2010). Psychotherapy-based supervision models in an emerging competency-based era: a commentary. Psychotherapy: Theory, Research, Practice, Training 47, 45–50.CrossRefGoogle Scholar
Gilbody, S, Bower, P, Fletcher, J, Richards, D, Sutton, AJ (2006). Collaborative care for depression: a meta-analysis and review of longer-term outcomes. Archives of Internal Medicine 166, 2314–2320.CrossRefGoogle ScholarPubMed
Gregorie, TK, Propp, J, Poertner, J (1998). Supervisor's role in the transfer of training. Administration in Social Work 22, 1–17.CrossRefGoogle Scholar
Heaven, C, Clegg, J, McGuire, P (2005). Transfer of communication skills training from workshop to work place: the impact of clinical supervision. Patient Education and Counselling 60, 313–325.CrossRefGoogle ScholarPubMed
Henggeler, SW, Schoenwald, SK, Liao, JG, Letourneau, EJ, Edwards, DL (2002). Transporting efficacious treatments to field settings: the link between supervisory practices and therapist fidelity in MST programmes. Journal of Clinical Child Psychology 31, 155–167.CrossRefGoogle Scholar
Hill, CE, Lambert, MJ (2004). Methodological issues in studying psychotherapy process and outcome. In: Handbook of Psychotherapy and Behaviour Change (ed. Lambert, M. J.), pp. 84–135. New York: Wiley.Google Scholar
Holloway, EL (1984). Outcome evaluation in supervision research. The Counselling Psychologist, 12, 167–174.CrossRefGoogle Scholar
HPC (2010). Draft Standards for Doctoral Programmes in Clinical Psychology. London: Health Professions Council.Google Scholar
Iberg, JR (1991). Applying statistical process control theory to bring together clinical supervision and psychotherapy research. Journal of Consulting and Clinical Psychology 59, 575–586.CrossRefGoogle ScholarPubMed
James, IA, Blackburn, IM, Milne, DL, Freeston, M (2005). Supervision training and rating scale for cognitive therapy (STARS – CT). Newcastle Cognitive Therapy Centre, England.Google Scholar
Kaslow, NJ, Grus, CL, Campbell, LF, Fouad, NA, Hatcher, RL, Rodolfa, ER (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology 3, S27–S45.CrossRefGoogle Scholar
Kazdin, AE (1998). Research Design in Clinical Psychology. Boston: Allyn Bacon.Google Scholar
Kenkel, MB, Peterson, RL (2010). Competency-Based Education for Professional Psychology. Washington, DC: American Psychiatric Association.CrossRefGoogle Scholar
Kolb, DA (1984). Experiential Learning: Experience as the Source of Learning and Development. New Jersey: Prentice-Hall.Google Scholar
Lambert, MJ (1980). Research and the supervisory process. In: Psychotherapy Supervision: Theory, Research and Practice (ed. Hess, A. K.), pp. 423–450. New York: Wiley.Google Scholar
Lambert, NJ, Ogles, BM (1997). The effectiveness of psychotherapy supervision. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 421–446. New York: Wiley.Google Scholar
Landis, JR, Koch, GG (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159–174.CrossRefGoogle ScholarPubMed
Liese, BS, Beck, JS (1997). Cognitive therapy supervision. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 114–133. New York: Wiley.Google Scholar
Lombard, M, Snyder-Duch, J, Bracken, CC (2006). Content analysis in mass communication: assessment and reporting of inter-coder reliability. Human Communication Research 2, 587–604.Google Scholar
Lucock, MP, Hall, P, Noble, R (2006). A survey of influences on the practice of psychotherapists and clinical psychologists in training in the UK. Clinical Psychology and Psychotherapy 13, 123–130.CrossRefGoogle Scholar
Madson, MB, Campbell, TC (2006). Measure of fidelity in motivational enhancement: a systematic review. Journal of Substance Abuse Treatment 31, 67–73.CrossRefGoogle ScholarPubMed
Miller, WR, Rollnick, S (2009). Ten things that motivational interviewing is not. Behavioural and Cognitive Psychotherapy 37, 129–140.CrossRefGoogle ScholarPubMed
Milne, DL (2007). Developing clinical supervision through reasoned analogies with therapy. Clinical Psychology and Psychotherapy 13, 215–222.CrossRefGoogle Scholar
Milne, DL (2008). CBT supervision: from reflexivity to specialisation. Behavioural and Cognitive Psychotherapy 36, 779–786.CrossRefGoogle Scholar
Milne, DL (2009). Evidence-Based Clinical Supervision: Principles and Practice. Chichester: BPS Blackwell.Google Scholar
Milne, DL (2010). Can we enhance the training of clinical supervisors? A national pilot study of an evidence-based approach. Clinical Psychology and Psychotherapy 17, 321–328.CrossRefGoogle ScholarPubMed
Milne, DL, James, IA (2002). The observed impact of training on competence in clinical supervision. British Journal of Clinical Psychology 41, 55–72.CrossRefGoogle ScholarPubMed
Milne, DL, James, IA, Keegan, D, Dudley, M (2002). Teachers PETS: a new observational measure of experiential training interactions. Clinical Psychology and Psychotherapy 9, 187–199.CrossRefGoogle Scholar
Milne, DL, Reiser, R (2011). Observing competence in CBT supervision: a systematic review of the available instruments. The Cognitive Behaviour Therapist. doi:10.1017/S1754470×11000067.CrossRefGoogle Scholar
Milne, DL, Reiser, R, Aylott, H, Dunkerley, C, Fitzpatrick, H, Wharton, S (2010). The systematic review as an empirical approach to improving CBT supervision. International Journal of Cognitive Therapy 3, 278–294.CrossRefGoogle Scholar
Milne, DL, Westerman, C (2001). Evidence-based clinical supervision: rationale and illustration. Clinical Psychology and Psychotherapy 8, 444–445.CrossRefGoogle Scholar
Newman, CF (2010). Competency in conducting CBT: foundational, functional, and supervisory aspects. Psychotherapy Theory, Research, Practice, Training 47, 12–19.CrossRefGoogle ScholarPubMed
Norcross, JC (2001). Purposes, processes and products of the task force on empirically supported therapy relationships. Psychotherapy: Theory/Research/Practice/Training 38, 345–356.CrossRefGoogle Scholar
Norcross, JC (2002) Psychotherapy Relationships That Work: Therapist Contributions and Responsiveness to Patients. Oxford: Oxford University Press.Google Scholar
Oliver, JR, Fleming, RK (2002). Applying within-subject methodology to transfer training research. International Journal of Training and Development 4, 173–180.Google Scholar
Padesky, CA (1996). Developing cognitive therapist competency: teaching and supervision models. In: Frontiers of Cognitive Therapy (ed. Salkovskis, P.), pp. 266–292. New York: Guilford Press.Google Scholar
Parsons, MB, Reid, DH (1995). Training residential supervisors to provide feedback for maintaining staff teaching skills with people who have severe disabilities. Journal of Applied Behavior Analysis 28, 317–322.CrossRefGoogle ScholarPubMed
Proctor, B (1988). A cooperative exercise in accountability. In: Enabling and ensuring (ed. Marken, M. and Payne, M.), pp.21–34. Leicester: Leicester National Youth Bureau and Council for Education and Training in Youth and Community Work.Google Scholar
Roth, AD, Pilling, S (2008). Using an evidence-based methodology to identify the competencies required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders. Behavioural and Cognitive Psychotherapy 36, 129–147.CrossRefGoogle Scholar
Vleuten, CPM, Schuwirth, LWT (2005). Assessing professional competence: from methods to programmes. Medical Education 39, 309–317.CrossRefGoogle ScholarPubMed
Wampold, BE, Davis, B, Good, RH (1990). Hypothesis validity of clinical research. Journal of Consulting and Clinical Psychology, 58, 360–367.CrossRefGoogle ScholarPubMed
Watkins, CE (1997). Handbook of Psychotherapy Supervision. New York: Wiley.Google Scholar
Watkins, CE (1998). Psychotherapy supervision in the 21st century. Journal of Psychotherapy Practice & Research 7, 93–101.Google Scholar
Wheeler, S, Richards, K (2007). The impact of clinical supervision on counsellors and therapists, their practice and their clients. A systematic review of the literature. Counseling and Psychotherapy Research 7, 54–65.CrossRefGoogle Scholar
Zarbock, G, Drews, M, Bodansky, A, Dahme, B (2009). The evaluation of supervision: construction of brief questionnaires for the supervisor and the supervisee. Psychotherapy Research 19, 194–204.CrossRefGoogle ScholarPubMed
Submit a response

Comments

No Comments have been published for this article.