Skip to main content Accessibility help

SAGE: preliminary evaluation of an instrument for observing competence in CBT supervision

  • Derek L. Milne (a1), Robert P. Reiser (a2), Tom Cliffe (a1) and Rosamund Raine (a1)


Clinical supervision plays a recognized role in facilitating practitioner development and in promoting therapeutic fidelity, but instruments that can support such activities by measuring competence in supervision are rare and often psychometrically compromised. As part of a research programme intended to raise the empirical status of supervision, we describe the initial psychometric development of a new instrument for observing competence (Supervision: Adherence and Guidance Evaluation; SAGE). This instrument is suitable for measuring CBT supervision, and can be administered by self-rating or by an independent observer. Preliminary tests of the reliability and validity of SAGE suggest that it is a promising tool for evaluating supervision. In addition, SAGE can be applied readily and has good utility. In these respects, SAGE appears to have some advantages over existing instruments, and may therefore provide a basis for enhancing research and practice in CBT supervision. Suggestions for future research on SAGE are outlined, particularly the need for a generalizability analysis.


Corresponding author

*Author for correspondence: D. L. Milne, Ph.D., School of Psychology, Ridley Building, Newcastle University, Newcastle upon Tyne NE1 7RU, UK (email:


Hide All
Falender, CA, Cornish, JAE, Goodyear, R, Hatcher, R, Kaslow, NJ, Leventhal, G, Shafranske, E, Sigmon, ST, Stoltenburg, C, Grous, C (2004). Defining competencies in psychology supervision: a consensus statement. Journal of Clinical Psychology 60, 771785.
Ablon, JS, Jones, EE (2002). Validity of controlled clinical trials of psychotherapy: findings from the NIMH treatment of depression collaborative research program. American Journal of Psychiatry 159, 775793.
Anastasi, A, Urbina, S (1997). Psychological Testing. New Jersey: Prentice-Hall.
BABCP (2009). Standards of Conduct, Performance and Ethics in the Practice of Behavioural and Cognitive Psychotherapy. Bury: British Association for Behavioural and Cognitive Psychotherapy.
Bambling, M, King, R, Raue, P, Schweitzer, R, Lambert, W (2006). Clinical supervision: its influence on client-rated working alliance and client symptom reduction in the brief treatment of major depression. Psychotherapy Research 16, 317331.
Barkham, M, Evans, C, Margison, F, McGrath, G, Mellor-Clark, J, Milne, DL, Connell, J (1998). The rationale for developing and implementing core outcome batteries for routine use in service settings and psychotherapy outcome research. Journal of Mental Health 7, 3547.
Barlow, DH, Nock, MK, Hersen, M (2009). Single-Case Experimental Designs: Strategies for Studying Behaviour Change. Boston: Allyn & Bacon.
Bellg, AJ, Borrelli, B, Resnick, B, Hecht, J, Minicucci, DS, Ory, M, Ogedegbe, G, Orwig, D, Ernst, D, Czajkowski, S (2004). Enhancing treatment fidelity in health behaviour change studies: best practises and recommendations from the NIH Behaviour Change Consortium. Health Psychology 23, 443451.
Bernard, JM, Goodyear, RK (2004). Fundamentals of Clinical Supervision, 3rd edn. London: Pearson.
Bordin, ES (1983). Supervision in counselling: contemporary models of supervision: a working alliance-based model of supervision. The Counselling Psychologist 11, 3542.
BPS (2009). Directory for Applied Psychology Practice Supervisors. Leicester: British Psychological Society.
DoH (2009). New Horizons: Towards a Shared Vision for Mental Health. London: Department of Health.
Dreyfus, HL, Dreyfus, SE (1986). Mind over Machine: The Power of Human Intuition and Expertise in the Era of the Computer. Oxford: Blackwell.
Efstation, JF, Patton, MJ, Kardish, CM (1990). Measuring the working alliance in counsellor supervision. Journal of Counselling Psychology 37, 322329.
Ellis, MV, Ladany, N (1997). Inferences concerning supervisees and clients in clinical supervision: an integrative review. In: Handbook of PsychotherapySupervision (ed. Watkins, C. E.), pp. 447507. New York: Wiley.
Epstein, RM, Hundert, EM (2006). Defining and assessing professional competence. Journal of American Medical Association 287, 226235.
Falender, CA, Shafranske, EP (2004). Clinical Supervision: A Competency-based Approach. Washington, DC: APA.
Falender, CA, Shafranske, EP (2008). Casebook for Clinical Supervision. Washington DC: American Psychiatric Association.
Falender, CA, Shafranske, EP (2010). Psychotherapy-based supervision models in an emerging competency-based era: a commentary. Psychotherapy: Theory, Research, Practice, Training 47, 4550.
Gilbody, S, Bower, P, Fletcher, J, Richards, D, Sutton, AJ (2006). Collaborative care for depression: a meta-analysis and review of longer-term outcomes. Archives of Internal Medicine 166, 23142320.
Gregorie, TK, Propp, J, Poertner, J (1998). Supervisor's role in the transfer of training. Administration in Social Work 22, 117.
Heaven, C, Clegg, J, McGuire, P (2005). Transfer of communication skills training from workshop to work place: the impact of clinical supervision. Patient Education and Counselling 60, 313325.
Henggeler, SW, Schoenwald, SK, Liao, JG, Letourneau, EJ, Edwards, DL (2002). Transporting efficacious treatments to field settings: the link between supervisory practices and therapist fidelity in MST programmes. Journal of Clinical Child Psychology 31, 155167.
Hill, CE, Lambert, MJ (2004). Methodological issues in studying psychotherapy process and outcome. In: Handbook of Psychotherapy and Behaviour Change (ed. Lambert, M. J.), pp. 84135. New York: Wiley.
Holloway, EL (1984). Outcome evaluation in supervision research. The Counselling Psychologist, 12, 167174.
HPC (2010). Draft Standards for Doctoral Programmes in Clinical Psychology. London: Health Professions Council.
Iberg, JR (1991). Applying statistical process control theory to bring together clinical supervision and psychotherapy research. Journal of Consulting and Clinical Psychology 59, 575586.
James, IA, Blackburn, IM, Milne, DL, Freeston, M (2005). Supervision training and rating scale for cognitive therapy (STARS – CT). Newcastle Cognitive Therapy Centre, England.
Kaslow, NJ, Grus, CL, Campbell, LF, Fouad, NA, Hatcher, RL, Rodolfa, ER (2009). Competency assessment toolkit for professional psychology. Training and Education in Professional Psychology 3, S27–S45.
Kazdin, AE (1998). Research Design in Clinical Psychology. Boston: Allyn Bacon.
Kenkel, MB, Peterson, RL (2010). Competency-Based Education for Professional Psychology. Washington, DC: American Psychiatric Association.
Kolb, DA (1984). Experiential Learning: Experience as the Source of Learning and Development. New Jersey: Prentice-Hall.
Lambert, MJ (1980). Research and the supervisory process. In: Psychotherapy Supervision: Theory, Research and Practice (ed. Hess, A. K.), pp. 423450. New York: Wiley.
Lambert, NJ, Ogles, BM (1997). The effectiveness of psychotherapy supervision. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 421446. New York: Wiley.
Landis, JR, Koch, GG (1977). The measurement of observer agreement for categorical data. Biometrics 33, 159174.
Liese, BS, Beck, JS (1997). Cognitive therapy supervision. In: Handbook of Psychotherapy Supervision (ed. Watkins, C. E.), pp. 114133. New York: Wiley.
Lombard, M, Snyder-Duch, J, Bracken, CC (2006). Content analysis in mass communication: assessment and reporting of inter-coder reliability. Human Communication Research 2, 587604.
Lucock, MP, Hall, P, Noble, R (2006). A survey of influences on the practice of psychotherapists and clinical psychologists in training in the UK. Clinical Psychology and Psychotherapy 13, 123130.
Madson, MB, Campbell, TC (2006). Measure of fidelity in motivational enhancement: a systematic review. Journal of Substance Abuse Treatment 31, 6773.
Miller, WR, Rollnick, S (2009). Ten things that motivational interviewing is not. Behavioural and Cognitive Psychotherapy 37, 129140.
Milne, DL (2007). Developing clinical supervision through reasoned analogies with therapy. Clinical Psychology and Psychotherapy 13, 215222.
Milne, DL (2008). CBT supervision: from reflexivity to specialisation. Behavioural and Cognitive Psychotherapy 36, 779786.
Milne, DL (2009). Evidence-Based Clinical Supervision: Principles and Practice. Chichester: BPS Blackwell.
Milne, DL (2010). Can we enhance the training of clinical supervisors? A national pilot study of an evidence-based approach. Clinical Psychology and Psychotherapy 17, 321328.
Milne, DL, James, IA (2002). The observed impact of training on competence in clinical supervision. British Journal of Clinical Psychology 41, 5572.
Milne, DL, James, IA, Keegan, D, Dudley, M (2002). Teachers PETS: a new observational measure of experiential training interactions. Clinical Psychology and Psychotherapy 9, 187199.
Milne, DL, Reiser, R (2011). Observing competence in CBT supervision: a systematic review of the available instruments. The Cognitive Behaviour Therapist. doi:10.1017/S1754470×11000067.
Milne, DL, Reiser, R, Aylott, H, Dunkerley, C, Fitzpatrick, H, Wharton, S (2010). The systematic review as an empirical approach to improving CBT supervision. International Journal of Cognitive Therapy 3, 278294.
Milne, DL, Westerman, C (2001). Evidence-based clinical supervision: rationale and illustration. Clinical Psychology and Psychotherapy 8, 444445.
Newman, CF (2010). Competency in conducting CBT: foundational, functional, and supervisory aspects. Psychotherapy Theory, Research, Practice, Training 47, 1219.
Norcross, JC (2001). Purposes, processes and products of the task force on empirically supported therapy relationships. Psychotherapy: Theory/Research/Practice/Training 38, 345356.
Norcross, JC (2002) Psychotherapy Relationships That Work: Therapist Contributions and Responsiveness to Patients. Oxford: Oxford University Press.
Oliver, JR, Fleming, RK (2002). Applying within-subject methodology to transfer training research. International Journal of Training and Development 4, 173180.
Padesky, CA (1996). Developing cognitive therapist competency: teaching and supervision models. In: Frontiers of Cognitive Therapy (ed. Salkovskis, P.), pp. 266292. New York: Guilford Press.
Parsons, MB, Reid, DH (1995). Training residential supervisors to provide feedback for maintaining staff teaching skills with people who have severe disabilities. Journal of Applied Behavior Analysis 28, 317322.
Proctor, B (1988). A cooperative exercise in accountability. In: Enabling and ensuring (ed. Marken, M. and Payne, M.), pp.2134. Leicester: Leicester National Youth Bureau and Council for Education and Training in Youth and Community Work.
Roth, AD, Pilling, S (2008). Using an evidence-based methodology to identify the competencies required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders. Behavioural and Cognitive Psychotherapy 36, 129147.
Vleuten, CPM, Schuwirth, LWT (2005). Assessing professional competence: from methods to programmes. Medical Education 39, 309317.
Wampold, BE, Davis, B, Good, RH (1990). Hypothesis validity of clinical research. Journal of Consulting and Clinical Psychology, 58, 360367.
Watkins, CE (1997). Handbook of Psychotherapy Supervision. New York: Wiley.
Watkins, CE (1998). Psychotherapy supervision in the 21st century. Journal of Psychotherapy Practice & Research 7, 93101.
Wheeler, S, Richards, K (2007). The impact of clinical supervision on counsellors and therapists, their practice and their clients. A systematic review of the literature. Counseling and Psychotherapy Research 7, 5465.
Zarbock, G, Drews, M, Bodansky, A, Dahme, B (2009). The evaluation of supervision: construction of brief questionnaires for the supervisor and the supervisee. Psychotherapy Research 19, 194204.


Related content

Powered by UNSILO

SAGE: preliminary evaluation of an instrument for observing competence in CBT supervision

  • Derek L. Milne (a1), Robert P. Reiser (a2), Tom Cliffe (a1) and Rosamund Raine (a1)


Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed.

SAGE: preliminary evaluation of an instrument for observing competence in CBT supervision

  • Derek L. Milne (a1), Robert P. Reiser (a2), Tom Cliffe (a1) and Rosamund Raine (a1)
Submit a response


No Comments have been published for this article.


Reply to: Submit a response

Your details

Conflicting interests

Do you have any conflicting interests? *