Hostname: page-component-546b4f848f-lx7sf Total loading time: 0 Render date: 2023-06-01T06:48:39.730Z Has data issue: false Feature Flags: { "useRatesEcommerce": true } hasContentIssue false

Rate of Agreement Between Clinicians on the Content of a Cognitive Formulation of Delusional Beliefs: The Effect of Qualifications and Experience

Published online by Cambridge University Press:  08 January 2010

Robert Dudley*
Institute of Neuroscience, Newcastle University and Northumberland, Tyne and Wear Mental Health NHS Trust, UK
Isabelle Park
Central Lancashire Psychological Services, UK.
Ian James
Northumberland, Tyne and Wear Mental Health NHS Trust, UK
Guy Dodgson
Northumberland, Tyne and Wear Mental Health NHS Trust, UK
Reprints requests to Robert Dudley, Institute of Neuroscience, Doctorate of Clinical Psychology, Ridley Building, Newcastle University, Newcastle NE1 7RU, UK. E-mail:


Background: A key process in Cognitive Therapy (CT) is the development and sharing of a formulation. How clinicians develop formulations is under-researched, particularly in working with people with psychosis. Aims: This study investigated agreement between clinicians, when conceptualizing an individual's psychotic beliefs. It also explored whether agreement was dependent on qualifications and experience. Method: Eighty-two clinicians watched a video of an individual with delusional beliefs, and were asked to provide formulations using a CT template. These were compared with a “benchmark” formulation provided by three experts. Results: There was good agreement for overt behaviours, emotions, and some aspects of early experience. However, identification of theory driven components such as core beliefs or assumptions was poorer. Greater clinical experience improved the agreement with the benchmark formulation overall, and greater CT specific experience improved formulation of the theory driven items. The more experience a clinician had of working with people with psychosis the lower the rate of agreement with the expert formulation. Conclusions: Formulation of delusional beliefs from a cognitive perspective is dependant on overall experience in cognitive therapy and not knowledge of psychosis, which may hinder performance. The implications for training in CT and psycho-social interventions are considered.

Research Article
Copyright © British Association for Behavioural and Cognitive Psychotherapies 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)


Beck, A. T. (1976). Cognitive Therapy and the Emotional Disorders. New York: International Universities Press.Google Scholar
Beck, J. S. (1995). Cognitive Therapy: basics and beyond. London: Guilford Press.Google Scholar
Bentall, R. P. (2003). Madness Explained. London: Penguin Books Ltd.Google ScholarPubMed
Berry, K. and Haddock, G. (2008). The implementation of the NICE guidelines for schizophrenia: barriers to the implementation of psychological interventions and recommendations for the future. Psychology and Psychotherapy, Theory, Research and Practice, 81, 419436.CrossRefGoogle ScholarPubMed
Bieling, P. J. and Kuyken, W. (2003). Is cognitive case formulation science or science fiction? Clinical Psychology: Science and Practice, 10, 5269.Google Scholar
Borkovec, T. D. and Castonguay, L. G. (2006). What qualifies as research on which to judge effective practice? Effectiveness research. In Norcross, J. C., Beutler, L. E. and Levant, R. F. (Eds.), Evidence-Based Practices in Mental Health: debate and dialogue on the fundamental questions. Washington, DC: American Psychological Association.Google Scholar
Brabban, A. and Turkington, D. (2002). The search for meaning: detecting congruence between life events, underlying schema and psychotic symptoms. InMorrison, A. P. (Ed.), A Casebook of Cognitive Therapy for Psychosis. London: Brunner-Routledge.Google Scholar
Brooker, C. and Brabban, A. (2004). Measured Success: a scoping review of evaluated psychosocial interventions training for work with people with serious mental health problems. Trent WDC: National Institute for Mental Health for England.Google Scholar
Butler, G. (1998). Clinical formulation. Comprehensive Psychology, 6, 123.Google Scholar
Chadwick, P., Birchwood, M. and Trower, P. (1996). Cognitive Therapy for Delusions, Voices and Paranoia. Chichester: Wiley and Sons.Google Scholar
Chadwick, P., Williams, C. and Mackenzie, J. (2003). Impact of case formulation in CBT for psychosis. Behaviour Research and Therapy, 40, 671680.CrossRefGoogle Scholar
Cohen, J. (1988). Statistical Power Analysis for the Behavioural Sciences. New Jersey: Lawrence Erlbaum Associates.Google Scholar
Dudley, R. and Kuyken, W. (2006). Formulation in cognitive therapy: a heuristic framework. InJohnstone, L. and Dallos, R. (Eds.), Formulation in Practice. East Sussex: Routledge.Google Scholar
Dudley, R., Siitarinen, J., James, I. and Dodgson, G. (2009). What do people with psychosis think caused their psychosis? A Q methodology study. Behavioural and Cognitive Psychotherapy, 37, 1124.CrossRefGoogle ScholarPubMed
Eells, T. D., Lombart, K. G., Kendjelic, E. M., Turner, L. C. and Lucas, C. P. (2005). The quality of psychotherapy case formulations: a comparison of expert, experienced, and novice cognitive—behavioral and psychodynamic therapists. Journal of Consulting and Clinical Psychology, 73, 579589.CrossRefGoogle ScholarPubMed
Fowler, D., Garety, P. and Kuipers, E. (1995). Cognitive Behaviour Therapy for People with Psychosis: a clinical handbook. Chichester: Wiley and Sons.Google Scholar
Freeman, D. (2007). Suspicious minds: the psychology of persecutory delusions. Clinical Psychology Review, 27, 425457.CrossRefGoogle ScholarPubMed
Freeman, D., Garety, P. A., Kuipers, E., Fowler, D. and Bebbington, P. E. (2002). A cognitive model of persecutory delusions. British Journal of Clinical Psychology, 41, 331347.CrossRefGoogle ScholarPubMed
Kahneman, D. (2003). A perspective on judgement and choice – mapping bounded rationality. American Psychologist, 58, 173180.CrossRefGoogle ScholarPubMed
Kingdon, D. and Turkington, D. (1994). Cognitive Behavioural Therapy of Schizophrenia. Hillside: Lawrence and Erlbaum Associates.Google ScholarPubMed
Kuyken, W. (2006). Evidence-based case formulation: is the emperor clothed? In Tarrier, N. (Ed.), Case Formulation in Cognitive Behaviour Therapy: the treatment of challenging and complex cases (pp.1235). East Sussex: Routledge.Google Scholar
Kuyken, W., Fothergill, C. D., Musa, M. and Chadwick, P. (2005). The reliability and quality of cognitive case formulation. Behaviour Research and Therapy, 43, 11871201.CrossRefGoogle ScholarPubMed
Kuyken, W., Padesky, C. and Dudley, R. (2008). The science and practice of Case Conceptualization. Behavioral and Cognitive Psychotherapy, 36, Special Issue, 757768.CrossRefGoogle Scholar
Kuyken, W., Padesky, C. and Dudley, R. (2009). Collaborative Case Conceptualization: working effectively with clients in cognitive behavioural therapy. New York: Guilford Press.Google Scholar
Luborsky, L. and Diguer, L. (1998). The reliability of the core conflictual relationship theme method measure: results from eight samples. In Luborsky, L. and Crits-Christoph, P. (Eds.), Understanding Transference: the core conflictual relationship theme method (pp. 97108). New York: Basic Books.CrossRefGoogle Scholar
Morrison, A. P. (1998). A cognitive analysis of the maintenance of auditory hallucinations: are voices to schizophrenia what bodily sensations are to panic? Behavioural and Cognitive Psychotherapy, 26, 289302.Google Scholar
Morrison, A. P., Renton, J. C., Dunn, H., Williams, S. and Bentall, R. P. (2004). Cognitive Therapy for Psychosis: a formulation based approach. New York: Brunner-Routledge.Google Scholar
Mumma, G. H. and Smith, J. L. (2001). Cognitive behavioural interpersonal scenarios: interformulator reliability and convergent validity. Journal of Psychopathology and Behavioural Assessment, 23, 203221.CrossRefGoogle Scholar
National Institute for Clinical Excellence (NICE) (2002). Schizophrenia: core interventions in the treatment and management of schizophrenia in primary and secondary care. London: Author.Google ScholarPubMed
Persons, J. B. and Bertagnolli, A. (1999). Interrater reliability of cognitive-behavioural case formulations of depression: a replication. Cognitive Therapy and Research, 23, 271283.CrossRefGoogle Scholar
Persons, J. B., Mooney, K. A. and Padesky, C. A. (1995). Interrater reliability of cognitive-behavioural case formulations. Cognitive Therapy and Research, 19, 2134.CrossRefGoogle Scholar
Salkovskis, P. M. (1996). The cognitive approach to anxiety: threat beliefs, safety-seeking behaviour, and the special case of health anxiety and obsessions. In Salkovskis, P. M. (Ed.), Frontiers of Cognitive Therapy. New York: The Guilford Press.Google Scholar
SPSS (2007). SPSS for Windows. Release 15.0. Chicago, Illinois: SPSS.Google Scholar
Tabachnick, B. G. and Fiddell, L. S. (1996). Using Multivariate Statistics. New York: Harper Collins.Google Scholar
Tarrier, N. and Calam, R. (2002). New developments in cognitive behavioural case formulation: epidemiological, systemic and social context: an integrated approach. Behavioural and Cognitive Psychotherapy, 30, 311328.CrossRefGoogle Scholar
Trower, P., Birchwood, M. and Meada, A. (2004). Cognitive therapy for command hallucinations: randomized controlled trial. British Journal of Psychiatry, 184, 312320.CrossRefGoogle Scholar
Turkington, D., Dudley, R., Warman, D. M. and Beck, A. T. (2004). Cognitive-behavioural therapy for schizophrenia: a review. Journal of Psychiatric Practice, 10, 516.CrossRefGoogle ScholarPubMed
Turkington, D., Kingdon, D., Turner, T. and the Insight into Schizophrenia Research Group (2002). Effectiveness of a brief cognitive-behavioural therapy intervention in the treatment of schizophrenia. British Journal of Psychiatry, 180, 523527.CrossRefGoogle ScholarPubMed
Wykes, T., Steel, C., Everitt, B. and Tarrier, N. (2008). Cognitive behavior therapy for schizophrenia: effect sizes, clinical models, and methodological rigor. Schizophrenia Bulletin, 34, 523537.CrossRefGoogle ScholarPubMed
Submit a response


No Comments have been published for this article.