Hostname: page-component-76fb5796d-r6qrq Total loading time: 0 Render date: 2024-04-27T22:56:04.535Z Has data issue: false hasContentIssue false

A study of self-perceived change in CBT competence among Norwegian therapists undertaking a 2-year CBT training for working with young people

Published online by Cambridge University Press:  17 November 2023

Kristin D. Martinsen*
Affiliation:
Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo, Norway Regional Center for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
Anne Lise Fredriksen
Affiliation:
Faculty of Health Sciences, Regional Centre for Child and Youth Mental Health and Child Welfare North, UiT, The Arctic University of Norway, Tromsø, Norway
Christian Lunde-Hansen
Affiliation:
Østfold Hospital, Children’s Department, Kalnes, Norway
Kirsten Torbjørnsen
Affiliation:
Regional Center for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
Barbro Fedøy
Affiliation:
Regional Center for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
*
Corresponding author: Kristin D. Martinsen; Email: k.d.martinsen@psykologi.uio.no
Rights & Permissions [Opens in a new window]

Abstract

The rising prevalence of mental illness among youth has underscored the critical need for proficient therapists trained in effective methods for treating prevalent mental disorders. As mental health services grapple with resource constraints, the demand for shorter training programs has increased. This study aimed to investigate whether therapist competence improves continuously over a two-year cognitive behavioural therapy (CBT) training course, whether specific CBT skills show greater improvement than generic skills, and whether self-perceived competence varies based on therapist characteristics. Data were gathered from seven different CBT training courses spanning the years 2013–2021 involving a total of 151 Norwegian therapists. Therapist self-assessed their CBT competence using the Cognitive Therapy and Adherence Scale (CTACS). The collected data were analysed using mixed effects models using the R program. The findings revealed a significant increase in self-reported competence throughout the two-year training period. Notably, skills related to case formulation and CBT techniques displayed the most substantial improvements, indicating a high level of competence attained by the conclusion of training. No significant interactions were identified between time and therapist characteristics. The outcomes of this study support the efficacy of in-depth training through an extended CBT course spanning multiple semesters. The observed progress in CBT skills suggests that investments in therapist training can yield high levels of competence. Furthermore, this investment appears warranted regardless of therapists’ individual characteristics.

Key learning aims

  1. (1) To gain insight into the differential development of generic and CBT specific competence during CBT training.

  2. (2) To reflect on the significance of therapist characteristics in the training process.

  3. (3) To reflect on the possible importance of reaching a high level of CBT competence during CBT training.

Type
Original Research
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of British Association for Behavioural and Cognitive Psychotherapies

Introduction

The escalating global prevalence of mental health disorders among youth, underscored by studies such as those conducted by Polanczyk et al. (Reference Polanczyk, Salum, Sugaya, Caye and Rohde2015) on a global scale and Bang (Reference Bang2018) in the Norwegian youth population, has heightened the urgency of equipping therapists with the proficiency to administer effective treatments for the most common mental disorders. Particularly, anxiety and depression have emerged as critical targets due to their pervasive impact on children and adolescents, as indicated by Barker et al. (Reference Barker, Beresford, Bland and Fraser2019). However, a disparity exists between the high incidence of these disorders and the limited application of evidence-based treatments, as observed in the work of Weisz et al. (Reference Weisz, Krumholz, Santucci, Thomassin and Ng2015) where few young people receive evidence-based treatments. In response, numerous initiatives have been launched to bridge this gap and ensure access to evidence-based interventions.

One such initiative, the Improving Access to Psychological Therapies (IAPT) program was initiated in the UK to enhance services for adults grappling with anxiety and depression, as noted by Wakefield et al. (Reference Wakefield, Kellett, Simmonds-Buckley, Stockton, Bradbury and Delgadillo2021). In 2011, this initiative was extended to encompass the youth population, aiming to augment the workforce and address gaps in the provision of evidence-based interventions, as highlighted by Shafran et al. (Reference Shafran, Fonagy, Pugh and Myles2014). Subsequently, practitioners have been trained in diverse settings, spanning from low-intensity school-based treatments to high-intensity interventions delivered in a hospital setting (Ludlow et al., Reference Ludlow, Hurn and Lansdell2020).

In parallel, the Norwegian government responded to the challenge by implementing a policy shift in 2015, mandating first-line services, staffed by various professions, to offer treatment for mild to moderate anxiety and depression (Nygaard and Kårikstad, Reference Nygaard and Kårikstad2015). Aligned with international and national guidelines, such as those set by the National Institute for Health & Clinical Excellence (NICE) (2019) and the Norwegian Audit Office (2020-2021) this directive highlights the need for evidence-based methods in mental health care. However, unlike the policy, no concerted effort was made to augment training in evidence-based methods.

Cognitive Behavioral Therapy (CBT) stands out as a promising evidence-based approach, as evidenced by numerous studies, including Weisz et al. (Reference Weisz, Kuppens, Ng, Eckshtain, Ugueto, Vaughn-Coaxum, Jensen-Doss, Hawley, Krumholz Marchette, Chu, Weersing and Fordwood2017) and Fordham et al. (Reference Fordham, Sugavanam, Edwards, Hemming, Howick, Copsey, Lee, Kaidesoja, Kirtley, Hopewell, das Nair, Howard, Stallard, Hamer-Hunt, Cooper and Lamb2021). Despite its potential, the integration of CBT and other evidence-based methods faces challenges such as time constraints for professional development. The Norwegian Audit Office (2020–2021) reveals that 70% of therapists report a lack of time for acquiring new therapeutic techniques. Furthermore, service providers grapple with constrained resources, prompting the quest for effective training methods, often leading to the preference for shorter training courses.

Within this intricate landscape, it becomes imperative to investigate whether competence evolution is a continuous process or whether significant changes resulting in high-quality competence in evidence-based methods manifest early or exclusively in the final stages. Moreover, an exploration of whether professionals with diverse backgrounds and characteristics acquire competence at a uniform rate during training adds an essential layer of understanding.

Past research has indicated that therapists advance during extended training courses such as weekly sessions for a year, or 20 hours per week for 30 weeks, exemplified by studies such as those by Barnfield et al. (Reference Barnfield, Mathieson and Beaumont2007), Bennett-Levy and Beedie (Reference Bennett-Levy and Beedie2007) and James et al. (Reference James, Blackburn, Milne and Reichfelt2001). Studies have also unveiled variation across skills and individuals, emphasizing the individualized nature of competence acquisition (Bennett-Levy and Beedie, Reference Bennett-Levy and Beedie2007). Experience and gender-related disparities were also noted by James et al. (Reference James, Blackburn, Milne and Reichfelt2001) in a study including 20 participants as more experienced therapists were reported to be more competent and with males exhibiting a higher rate of improvement compared to females. Furthermore, Clark (Reference Clark2018) underscored the success of the IAPT program in training therapists from diverse professional backgrounds.

While it may be difficult finding a definition and agreed-upon measure for therapist competence (Kazantzis, Reference Kazantzis2003), Perepletchikova and Kazdin (Reference Perepletchikova and Kazdin2005) categorize therapeutic quality into therapist competence and adherence, an approach now commonly embraced. The former denotes the adept execution of interventions, while the latter signifies adherence to therapeutic approaches (Rapley and Loades, Reference Rapley and Loades2018).

In this study, we delve into the trajectory of competence change over a two-year CBT training course, aiming to unravel whether competence evolution is a continuous process or whether significant changes manifest early or exclusively in the final stages. We hypothesize that therapists will self-report an augmented competence in CBT, with improvement persisting throughout the two-year training period. Furthermore, we anticipate that specific CBT skills will undergo more pronounced enhancement compared with generic skills, with variations in self-perceived competence change linked to therapist characteristics, such as age, gender, experience, profession and caseload.

To unravel these intricacies, we gather therapists’ self-perceptions of their competence change during training. The Norwegian Centre for Research Data (61371) approved the study.

In the subsequent sections, we delve into the methods, results, and discussions that elucidate the dynamics of therapist competence acquisition within the context of a comprehensive two-year CBT training program.

Method

Design

This study employed a longitudinal design in a naturalistic setting to assess therapist competence using the Cognitive Therapy and Adherence Scale (CTACS) (see ‘Measures’ section below) at four time-points during the two-year CBT training course. Due to this design, the inclusion of a control group that did not receive training was not possible.

Recruitment and participants

In the period 2013–2021, data were collected four times from each of the seven different cohorts participating in the two-year CBT training course.Footnote 1 Of the 170 participants starting the training course, two declined to participate in the study. Some participants quit before the course was completed (n=17) due to parental leave, job changes and health problems. Hence a total of n=151 therapists in training (hereafter therapists) participated in the study (82.1% women, mean age 41 years). Participants in the CBT training course per cohort were n 1=22, n 2=11, n 3=27, n 4=22, n 5=29, n 6=16 and n 7=24.

To be eligible for the course, individuals must hold at least a bachelor’s degree in youth mental health and a minimum two years of relevant therapeutic work experience with youth prior to admission to the course. Participants are recruited from various professions and services, including first-line services, in- and out-patient clinics, and child welfare services. Educators and child welfare educators comprised the largest group (n=63, 41.7%), while school health nurses/nurses were n=32 (21.2%), doctors and psychologist were n=31 (20.5%), and social workers were n=17 (11.3%). Eight participants were placed in the ‘Other group’ (5.3%), which included professionals working in the school system. Mean experience reported was 12.9 years (ranging from 1 to 30 years) and the majority (n=70, 46.4%) reported having a small CBT caseload (between 1 and 4 cases), n=48 reported a medium CBT caseload (between 5 and 10 cases, 31.7 %), n=26 reported a large CBT caseload (17.2%), while n=7 (4.6%) failed to answer this question.

Course content and process of learning

The two-year CBT course is a comprehensive, well-established training program for CBT with children and adolescents, with consistent content across seven different cohorts. Previous qualitative interviews have indicated high levels of user satisfaction with the training (unpublished data). In-depth training in CBT is considered necessary, as recommended by the Norwegian Association for Cognitive Therapy. The course includes 240 teaching hours and 80 hours of group supervision which involves guided reading, writing short essays and clinical assessments, including group supervision of four patient videos per student led by a CBT supervisor with training in both CBT and CBT-supervision. The training course emphasizes experiential learning including skills training, role-play, and practical exercises along with theoretical lectures.

The specific content of the course is described in Appendix 1 (see Supplementary material). Themes and content are adapted to therapy with children and young people, and with a clear emphasis on the therapists using a developmentally sensitive approach.

Measures

To assess the participants’ self-perception of competence, a Norwegian version of the Cognitive Therapy Adherence and Competence scale (CTACS) with 25 items rated on a scale ranging from 0 (‘poor/low competence’) to 6 (‘excellent/high competence’). The CTACS contains four subscales (Structure, Alliance, Case-formulation, and CBT-techniques) that aggregate into a Total competence score. The 25 items are divided into five sections, see Appendix 2 (Supplementary material). The Norwegian version used in the current study is based on the original full version developed by Barber et al. (Reference Barber, Liese and Abrams2003) but without the description guiding each item; see Appendix 3 (Supplementary material). Self-report is a cost-effective and straightforward method of measuring competence and is commonly used in routine practice settings (Muse and McManus, Reference Muse and McManus2013). CTACS has acceptable levels of inter-rater reliability and criterion validity measuring adherence (α=0.92) and competence (α=0.93) (Barber et al., Reference Barber, Liese and Abrams2003).

The Norwegian translation of the CTACS was conducted by Nordahl et al. (Reference Nordahl, Nysæter and Mikkelsen2006) in agreement with the official authors. The scale is scored on a continuum ranging from 0 (poor) to 6 (excellent). While the scale can measure both adherence and competence, this study only collected competence scores. According to the psychometric evaluation of the Norwegian version of the CTACS by Lervik et al. (Reference Lervik, Knapstad, Hoffart and Smith2021) there is no evidence for divergent validity between the adherence and competence scale. The study reported acceptable internal consistency for the full scale (α=0.91) and acceptable to low internal consistency for the subscales structure (α=0.76), therapeutic relationship (α=0.84), and CBT techniques (α=0.73) and conceptualization (α=0.61).

Internal consistency was calculated for all subscales at the four time-points; see Table 1. Internal consistency ranged from acceptable to excellent (α=0.75–0.92).

Table 1. Internal consistency of the CTACS* subscales

* CTACS, CBT Competence and Adherence scale (Barber et al., Reference Barber, Liese and Abrams2003)

Procedures and data collection

The therapists reported on competence four times (beginning of first (T1) and third (T3) semester, and the end of the second (T2) and fourth (T4) semester during the CBT course after having been explained the purpose of data collection and how to measure overall competence. All participating therapists signed informed consent and provided personal information. The therapists rated their competence based on an assessment of their average CBT competence across a range of cases, and not, as this measure usually is used, in connection with a specific case or session.

Statistical analysis

Mixed effects models give valid inference for missing at random in the dependent variables (CBT competence subscales) (Pinheiro and Bates, Reference Pinheiro and Bates2000). We included random effects for differences within and between participants and fixed effects for categorical time with adjustment for gender, age, profession, caseload, and experience. In addition, a model with interaction between time and the adjustment variables was estimated.

Separate models for the subscales of the dependent variable CTACS (Structure, Alliance, Case-formulation and CBT-techniques) were estimated.

Analysis used R (The R Foundation for Statistical Computing, Vienna, Austria) with the R package nlme (v3.1-152; Pinheiro et al., Reference Pinheiro, Bates, DebRoy and Sarkar2021) for mixed effects models.

Results

The results are shown in Tables 2 and 3, and in Fig. 1.

Table 2. Descriptives CTACS* subscales over four semesters

* CTACS, CBT Competence and Adherence scale (Barber et al., Reference Barber, Liese and Abrams2003). Range: 0 = poor to 6 = excellent.

Table 3. Model based estimates for development of competence on subscales of the CTACS*

* CTACS, CBT Competence and Adherence scale (Barber et al., Reference Barber, Liese and Abrams2003).

Figure 1. Change in competence on subscales of the CTACS over four semesters.

As can be seen in Table 2, Alliance was the subscale rated highest of the four subscales at T1 (mean score of 3.52 (SD=1.95), ending at 4.95 (SD=0.58) at T4. Use of Case-formulation and CBT-techniques were rated lowest of the subscales at T1, Case-formulation starting at 1.11 (SD=1.08), ending at 4.01 (SD=0.71) at T4, while CBT-techniques went from 1.24 (SD=1.22) to 4.07 (SD=0.77). The subscale Structure was rated from 2.35 (SD=0.98) to 4.50 (SD=0.72) from T1 to T4.

There was clear evidence of positive changes in self-reported competence over time for all subscales of the CTACS when adjusted for gender, age, profession, caseload and experience, p<0.001; see Table 2. Hence, as expected the therapists self-reported increase in competence during the course, although the magnitude of these changes varied between the subscales and the time-points. The largest change was for Case-formulation between T1 and T4, with Alliance showing the least change in the same time span.

Examining percentage change based on the mixed effects model without interaction, the largest percentage increase in mean competence from T1 to T2 was use of Case-formulation (129%), while CBT-techniques had an increase of 76%. The subscale Structure changed 51% from T1 to T2 while Alliance had the smallest change (24%) from T1 to T2. Examining the change from T1 to T4 the pattern still held with a change of 235%, 127%, 83% and 40%, respectively.

This percentage change was based on the group of female psychologists/physicians, with few patients (cases), 13 years’ experience, and age 40 as reference; see Fig. 1.

There was no evidence for interactions of time with gender, age, profession, caseload and experience; the lowest p-values for interactions were 0.224 for the subscale Structure, 0.240 for Alliance, 0.174 for Case-formulation and 0.139 for CBT-techniques.

Discussion

In the present study, the findings illuminate the trajectory of therapist competence development over a comprehensive two-year CBT training course. Through the examination of self-reported competence levels across different time-points, we found a steady improvement in competence during the two-year training course. We also found a significant change in competence of all skills from the third until the end of fourth semester, indicating continued learning throughout the whole course, although different patterns emerged in the generic versus the CBT-specific skills. This confirmed our expectations that specific CBT skills would improve more than generic relational skills, which is also expected as the focus in the training was on CBT-specific skills. We found no significant interaction between time and adjustment variables in self-perceived competence based on therapist characteristics, such as gender, experience, profession and caseload. Hence, our expectation was not supported.

The observed significant increase in self-reported competence over the two-year training course aligns with the study’s expectations and is consistent with previous research (Keen and Freeston, Reference Keen and Freeston2008; McManus et al., Reference McManus, Westbrook, Vazquez-Montes, Fennell and Kennerley2010). Notably, the data indicated a significant improvement in competence in all skills from the third semester onwards, suggesting a continuous learning curve throughout the entire training period. This reinforces the concept that the process of acquiring and refining competence extends beyond the initial stages, reflecting ongoing growth and adaptation.

An intriguing pattern emerged in the differentiation of skill-specific competence improvements. The Alliance skill, which started with the highest rating, exhibited the smallest increase in competence. This finding aligns with previous research by Bennett-Levy and Beedie (Reference Bennett-Levy and Beedie2007) underscoring the limited growth observed in interpersonal skills over time. Although Alliance demonstrated the smallest relative improvement, the change remained significant, echoing findings reported by Milne et al. (Reference Milne, Baker, Blackburn, James and Reichelt1999). The high initial rating in Alliance, possibly due to therapists’ previous experience (mean experience of 13 years), could have contributed to the more modest growth. Alliance would therefore most probably be a generic skill they may have learnt earlier in their career, having less room for improvement. Weck et al. (Reference Weck, Grikscheit, Jakob, Höfling and Stangier2015) have emphasized the role of therapeutic alliance as a pre-condition for competent implementation of cognitive behavioural therapy. Similarly, Haug et al. (Reference Haug, Nordgreen, Öst, Tangen, Kvale, Hovland, Heiervang and Havik2016) reported lower alliance rating later in therapy was associated with client drop-out. Our findings with high rating of alliance early in training may therefore be an important factor to prevent young people in therapy from dropping out of CBT treatment.

Conversely, Case-formulation and CBT-techniques displayed the most substantial improvement, validating the study’s hypothesis that specific CBT skills would exhibit greater enhancement compared with generic skills. While Structure reached an acceptable competence level even before the second year of training, CBT-techniques and Case conceptualization first reached this level during the last part of the second year of training. The delayed attainment of high competence levels in Case-formulation and CBT-techniques highlights their complexity and the necessity of mastering these skills to provide adaptable, tailored CBT interventions. Too strict a reliance on structure, may result in a rigid therapist not meeting the needs of the client, and the skills acquired during the latter part of the second year is therefore of utmost importance to provide flexible high quality CBT therapy.

Therefore, although brief CBT training (e.g. a 2-day workshop followed by 1 year of telephone consultations) has been reported to improve competence with lasting effects (Simons et al., Reference Simons, Padesky, Montemarano, Lewis, Murakami, Lamb, DeVinney, Reid, Smith and Beck2010), the current study highlights the importance of providing longer training courses to achieve high competency levels. The training programs of the Norwegian Association of Cognitive Therapy emphasize that to successfully complete a CBT course, competence in the different skills should reach a score of 3 or above on at least 50% of the CTACS subscales (Norsk forening for kognitiv terapi, 2013). While more generic skills such as Structure and Alliance reached this level after 1 year, the competence continued to increase to level 4 and 5 in the second year of training and for CBT-specific skills the second year was important to reach such a level. In order to maximize the benefits and value of investing in therapists learning an evidence-based method, it is essential for organizations to recognize the significance of in-depth training where participants can reach a level of competence in CBT-specific skills that indicate mastery during the training period.

Contrary to initial expectations and existing literature, the study’s findings did not indicate any interaction between change in self-perceived competence and therapist characteristics. In contrast to studies that suggested differences in profession, gender, age and caseload might influence competence development (James et al., Reference James, Blackburn, Milne and Reichfelt2001; Liness et al., Reference Liness, Beale, Lea, Byrne, Hirsch and Clark2019; McManus et al., Reference McManus, Westbrook, Vazquez-Montes, Fennell and Kennerley2010), this study’s results suggest a different narrative.

According to Tyler et al. (Reference Tyler, Gannon and Olver2021) there has been little research on the impact of profession on the training and quality of therapy. They did, however, conclude that treatment with trained psychologists was more effective due to their competence and subject-specific knowledge (Tyler et al., Reference Tyler, Gannon and Olver2021). Our results may, on the other hand, support that there is no obstacle mixing professions in a CBT training course as there was no significant difference in competence gains based on professional background. This may furthermore have important implications for the recruitment of CBT therapists. If different professions acquire CBT skills at the same rate it may be possible to make this required competence available for more youths, an important target for health authorities. It also appears that neither gender nor age influences the development of CBT competence, which is contrary to previous studies (James et al., Reference James, Blackburn, Milne and Reichfelt2001). However, it is important to exercise caution when generalizing the finding of James et al. (Reference James, Blackburn, Milne and Reichfelt2001) due to their small sample size including only nine males.

Furthermore, experience, age and caseload were not significantly related to change in CBT-competence in the current study. The lack of significant relationship between age and competence was in accordance with the results published by James et al. (Reference James, Blackburn, Milne and Reichfelt2001), but contrary to McManus et al. (Reference McManus, Westbrook, Vazquez-Montes, Fennell and Kennerley2010) who found that older trainees performed worse. Furthermore, the absence of a significant relationship between caseload and competence contradicted the study’s initial expectations. The assumption that practising skills with actual patients would foster better competence development was challenged. Group activities, supervision, sharing clinical experience through video recordings of sessions. and role-playing during the training might have provided many opportunities for skill practice, compensating for the absence of direct patient encounters. The therapists were also motivated to learn, joining a two-year training course which may explain that both older and younger therapists improved. It could also be possible that the use of self-report may have influenced the results with inexperienced therapists over-rating their performance, and experienced therapists under-rating their performance. A study showed that whilst there was a significant correlation between self-ratings and expert-ratings of competence, therapists significantly over-rated their competence relative to the expert rater, and with the less competent therapists over-rating their competence to a greater degree than therapists who met criteria for competence (Brosan et al., Reference Brosan, Reynolds and Moore2008).

Strengths and limitations

The study’s strengths lie in its relatively large sample size, systematic data collection, and consistent evaluation procedure at multiple time-points. These factors provide support to the therapists being able to evaluate their own change in competence. Additionally, the CBT course maintained a stable content and structure throughout the years of data collection, ensuring therapists had equal opportunities to enhance their competence.

Although the use of self-report measures is a limitation in this study, it is supported by research suggesting that it encourages individuals to reflect on their experiences (Bennett-Levy and Beedie, Reference Bennett-Levy and Beedie2007; Wampold et al., Reference Wampold, Flückiger, Del Re, Yulish, Frost, Pace, Goldberg, Miller, Baardseth and Laska2017). However, the literature also highlights that individuals tend to rate their own competence higher than a third-party observer (Dunning et al., Reference Dunning, Heath and Suls2004). As the current study relies solely on self-evaluation, this bias must be acknowledged. Nonetheless, as the focus of the study is on changes over time, this general bias is unlikely to significantly impact the results.

One additional limitation of this study is the lack of power calculation prior to data collection. Performing a power calculation prior to data collection is best practice, as calculating power after data collection is not recommended (Lydersen, Reference Lydersen2019). On the other hand, the use of sound statistical methods to analyse the data is a strength of the study,

Nevertheless, the study’s naturalistic design without a control group restricts the ability to definitively attribute changes to training alone. Furthermore, caution should be exercised when applying these findings to other settings or training programs due to the study’s limited generalizability to the specific training course that was studied.

Conclusion

In conclusion, this study provides valuable insights into the development of therapist competence within the context of a comprehensive two-year CBT training course. The observed continuous competence enhancement highlights the significance of prolonged training for achieving high levels of proficiency. The differentiation in skill-specific improvements underscores the importance of mastering complex CBT-specific methods. Therapist characteristics such as gender, age, profession and caseload did not significantly impact competence gains, indicating the feasibility and effectiveness of cross-profession training. Ultimately, these findings contribute to the ongoing efforts to equip therapists with the skills necessary to effectively address the rising mental health challenges among youth.

Future research should explore the notion of competence from a variety of perspectives such as coding video sessions of therapy or assessing client outcome, in addition to therapist self-report. Conducting long-term follow-up to investigate whether the training produces lasting improvements in competence would also be valuable.

Key practice points

  1. (1) Therapist training over 2 years appears to be enough for therapists to achieve high levels of competence in both generic and CBT-specific skills.

  2. (2) We found no clear evidence for differences in competencies gains based on profession suggesting that therapists from different professions could be trained to implement high quality CBT.

  3. (3) As we observed continued improvements in the second year of training, particularly in CBT-specific skills, extending training to two years may be beneficial. These results could be useful knowledge for decision makers in services when deciding on training for their employees in CBT.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S1754470X23000296

Data availability statement

The dataset will be made available on request to the corresponding author.

Acknowledgements

We would like to thank the therapists for consenting to sharing their development of competence during the two-year training course, the Regional Center for Child and Adolescent Mental Health, Eastern and Southern Norway for providing the course and the Norwegian Association for Cognitive Therapy (NFKT) for support to write this article.

Author contributions

Kristin Martinsen: Conceptualization (lead), Data curation (equal), Formal analysis (lead), Funding acquisition (equal), Investigation (lead), Methodology (lead), Project administration (lead), Resources (equal), Software (lead), Supervision (equal), Validation (lead), Visualization (lead), Writing – original draft (lead), Writing – review & editing (lead); Anne Lise Fredriksen: Conceptualization (equal), Data curation (supporting), Formal analysis (supporting), Funding acquisition (equal), Investigation (equal), Methodology (supporting), Project administration (supporting), Resources (equal), Software (supporting), Supervision (equal), Validation (supporting), Visualization (equal), Writing – original draft (equal), Writing – review & editing (supporting); Kirsten Torbjørnsen: Conceptualization (supporting), Data curation (supporting), Formal analysis (supporting), Funding acquisition (supporting), Investigation (supporting), Methodology (supporting), Project administration (supporting), Resources (supporting), Software (supporting), Supervision (equal), Validation (supporting), Visualization (supporting), Writing – original draft (supporting), Writing – review & editing (supporting); Christian Lunde-Hansen: Conceptualization (supporting), Data curation (supporting), Formal analysis (supporting), Funding acquisition (supporting), Investigation (supporting), Methodology (supporting), Project administration (supporting), Resources (supporting), Software (supporting), Supervision (equal), Validation (supporting), Visualization (supporting), Writing – original draft (equal), Writing – review & editing (equal); Barbro Fedøy: Conceptualization (equal), Data curation (equal), Formal analysis (supporting), Funding acquisition (supporting), Investigation (equal), Methodology (equal), Project administration (equal), Resources (supporting), Software (supporting), Supervision (equal), Validation (supporting), Visualization (supporting), Writing – original draft (equal), Writing – review & editing (equal).

Financial support

No grant supported this paper. The Norwegian Association for Cognitive Therapy provided limited financial support for the writing process.

Competing interests

The authors declare no competing interests.

Ethical standards

All authors have abided by the Ethical Principles of Psychologists and Code of Conduct as set out by APA. No ethical approval was needed, but the study was approved by the SIKT, The Norwegian Agency for Shared Services in Education and Research, ref. no. 230601. The participants included in this publication provided informed consent. The research has conformed to the Declaration of Helsinki of 1975, revised in 2008.

Footnotes

1 Courses at the at the Centre for Child and Adolescent Mental Health (RBUP), Eastern and Southern Norway.

References

Further reading

Liness, S., Beale, S., Lea, S., Byrne, S., Hirsch, C. R., & Clark, D. M. (2019). Multi-professional IAPT CBT training: clinical competence and patient outcomes. Behavioural and Cognitive Psychotherapy, 47, 672685. https://doi.org/10.1017/s1352465819000201 CrossRefGoogle ScholarPubMed

References

Bang, L. (2018). Quality of Life and Mental Health Among Children and Adolescents in Norway. Institute of Public Health. Retrieved from: https://www.fhi.no/en/op/hin/mental-health/mental-health-children-adolescents/ Google Scholar
Barber, J. P., Liese, B. S., & Abrams, M. J. (2003). Development of the Cognitive Therapy Adherence and Competence scale. Psychotherapy Research, 13, 205221. https://doi.org/10.1093/ptr/kpg019 CrossRefGoogle Scholar
Barker, M. M., Beresford, B., Bland, M., & Fraser, L. K. (2019). Prevalence and incidence of anxiety and depression among children, adolescents, and young adults with life-limiting conditions: a systematic review and meta-analysis. JAMA Pediatrics, 173, 835844. https://doi.org/10.1001/jamapediatrics.2019.1712 CrossRefGoogle Scholar
Barnfield, T. V., Mathieson, F. M., & Beaumont, G. R. (2007). Assessing the development of competence during postgraduate cognitive-behavioral therapy training. Journal of Cognitive Psychotherapy, 2, 140147. https://doi.org/10.1891/088983907780851586 CrossRefGoogle Scholar
Bennett-Levy, J., & Beedie, A. (2007). The ups and downs of cognitive therapy training: what happens to trainees’ perception of their competence during a cognitive therapy training course? Behavioural and Cognitive Psychotherapy, 35, 6175.CrossRefGoogle Scholar
Brosan, L., Reynolds, S., & Moore, R. G. (2008). Self-evaluation of cognitive therapy performance: do therapists know how competent they are? Behavioural and Cognitive Psychotherapy, 36, 581587. https://doi.org/10.1017/S1352465808004438 CrossRefGoogle Scholar
Clark, D. M. (2018). Realizing the mass public benefit of evidence-based psychological therapies: the IAPT program. Annual Review of Clinical Psychology, 14, 159183. https://doi.org/10.1146/annurev-clinpsy-050817-084833 CrossRefGoogle ScholarPubMed
Dunning, D., Heath, C., & Suls, J. M. (2004). Flawed self-assessment:implications for health, education, and the workplace. Psychological Science in the Public Interest, 5, 69106. https://doi.org/10.1111/j.1529-1006.2004.00018.x CrossRefGoogle ScholarPubMed
Fordham, B., Sugavanam, T., Edwards, K., Hemming, K., Howick, J., Copsey, B., Lee, H., Kaidesoja, M., Kirtley, S., Hopewell, S., das Nair, R., Howard, R., Stallard, P., Hamer-Hunt, J., Cooper, Z., & Lamb, S. E. (2021). Cognitive-behavioural therapy for a variety of conditions: an overview of systematic reviews and panoramic meta-analysis. Health Technology Assessment, 25, 1378. https://doi.org/10.3310/hta25090 CrossRefGoogle ScholarPubMed
Haug, T., Nordgreen, T., Öst, L. G., Tangen, T., Kvale, G., Hovland, O. J., Heiervang, E. R., & Havik, O. E. (2016). Working alliance and competence as predictors of outcome in cognitive behavioral therapy for social anxiety and panic disorder in adults. Behaviour Research and Therapy, 77, 4051. https://doi.org/10.1016/j.brat.2015.12.004 CrossRefGoogle ScholarPubMed
James, I. A., Blackburn, I. M., Milne, D. L., & Reichfelt, F. K. (2001). Moderators of trainee therapists’ competence in cognitive therapy. British Journal of Clinical Psychology, 40, 131141. https://doi.org/10.1348/014466501163580 CrossRefGoogle ScholarPubMed
Kazantzis, N. (2003). Therapist competence in cognitive-behavioural therapies: review of the contemporary empirical evidence. Behaviour Change, 20, 112.10.1375/bech.20.1.1.24845CrossRefGoogle Scholar
Keen, A. J. A., & Freeston, M. H. (2008). Assessing competence in cognitive-behavioural therapy. British Journal of Psychiatry, 193, 6064. https://doi.org/10.1192/bjp.bp.107.038588 CrossRefGoogle ScholarPubMed
Lervik, L. V., Knapstad, M., Hoffart, A., & Smith, O. R. (2021). Psychometric properties of the Norwegian version of the Cognitive Therapy Adherence and Competence Scale (CTACS) and its associations with outcomes following treatment in IAPT Norway. Frontiers in Psychology, 12, 639225.10.3389/fpsyg.2021.639225CrossRefGoogle ScholarPubMed
Liness, S., Beale, S., Lea, S., Byrne, S., Hirsch, C. R., & Clark, D. M. (2019). Multi-professional IAPT CBT training: clinical competence and patient outcomes. Behavioural and Cognitive Psychotherapy, 47, 672685. https://doi.org/10.1017/s1352465819000201 CrossRefGoogle ScholarPubMed
Ludlow, C., Hurn, R., & Lansdell, S. (2020). A current review of the Children and Young People’s Improving Access to Psychological Therapies (CYP IAPT) program: perspectives on developing an accessible workforce. Adolescent Health, Medicine and Therapeutics, 11, 2128. https://doi.org/10.2147/AHMT.S196492 CrossRefGoogle Scholar
Lydersen, S. (2019). Statistical power: before, but not after! Tidsskr Nor Laegeforen, 139. https://doi.org/10.4045/tidsskr.18.0847 [Statistisk styrke – før, men ikke etter!]CrossRefGoogle Scholar
McManus, F., Westbrook, D., Vazquez-Montes, M., Fennell, M., & Kennerley, H. (2010). An evaluation of the effectiveness of Diploma-level training in cognitive behaviour therapy. Behaviour Research and Therapy, 48, 11231132. https://doi.org/10.1016/j.brat.2010.08.002 CrossRefGoogle ScholarPubMed
Milne, D. L., Baker, C., Blackburn, I.-M., James, I., & Reichelt, K. (1999). Effectiveness of cognitive therapy training. Journal of Behavior Therapy and Experimental Psychiatry, 30, 8192. https://doi.org/10.1016/S0005-7916(99)00011-7 CrossRefGoogle ScholarPubMed
Muse, K., & McManus, F. (2013). A systematic review of methods for assessing competence in cognitive-behavioural therapy. Clinical Psychology Review, 33, 484499. https://doi.org/10.1016/j.cpr.2013.01.010 CrossRefGoogle ScholarPubMed
National Institute for Health & Clinical Excellence (NICE) (2019). Final appraisal determination: conduct disorder in children-parent training/education programmes. http://www.nice.org.uk/nicemedia/pdf/Parent_training_FAD.pdf Google Scholar
Nordahl, H. M., Nysæter, T. E., & Mikkelsen, B. (2006). Cognitive Therapy Adherence and Competence Scale. Tidsskrift for Kognitiv Terapi. Nr 3. s 1429.Google Scholar
Norsk forening for kognitiv terapi (2013). Din utvikling som kognitiv terapeut: Basert på kognitive therapy adherence and competence scale (CTACS) [Measurement instrument]. https://www.kognitiv.no/wp-content/uploads/2015/08/Din-utvikling-som-kognitiv-terapeut.pdf Google Scholar
Norwegian Audit Office (2020–2021). The National Audit Office Research on Mental Health Services. Retrieved from: https://www.riksrevisjonen.no/rapporter-mappe/no-2020-2021/undersokelse-av-psykiske-helsetjenester/ Google Scholar
Nygaard, E., & Kårikstad, V. (2015). Psykisk helsevern for barn og unge: prioriteringsveileder. Norwegian Health Directorate.Google Scholar
Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365383. https://doi.org/10.1093/clipsy.bpi045 Google Scholar
Pinheiro, J. C., & Bates, D. M. (2000). Statistics and comuting mixed-effects models in S and S-PLUS. Springer.10.1007/978-1-4419-0318-1CrossRefGoogle Scholar
Pinheiro, J., Bates, D., DebRoy, S., Sarkar, D., & R Core Team (2021). nlme: Linear and Nonlinear Mixed Effects Models. https://CRAN.R-project.org/package=nlme.Google Scholar
Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., & Rohde, L. A. (2015). Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents [Literature Review; Systematic Review; Meta Analysis]. Journal of Child Psychology and Psychiatry, 56, 345365. https://doi.org/10.1111/jcpp.12381 CrossRefGoogle ScholarPubMed
Rapley, H. A., & Loades, M. E. (2018). A systematic review exploring therapist competence, adherence, and therapy outcomes in individual CBT for children and young people. Psychotherapy Research, 110. https://doi.org/10.1080/10503307.2018.1464681 Google ScholarPubMed
Shafran, R., Fonagy, P., Pugh, K., & Myles, P. (2014). Transformation of mental health services for children and young people in England. In Dissemination and Implementation of Evidence-Based Practices in Child and Adolescent Mental Health (pp. 158178). Oxford University Press.Google Scholar
Simons, A. D., Padesky, C. A., Montemarano, J., Lewis, C. C., Murakami, J., Lamb, K., DeVinney, S., Reid, M., Smith, D. A., & Beck, A. T. (2010). Training and dissemination of cognitive behavior therapy for depression in adults: a preliminary examination of therapist competence and client outcomes. Journal of Consulting and Clinical Psychology, 78, 751756. https://doi.org/10.1037/a0020569 CrossRefGoogle ScholarPubMed
Tyler, N., Gannon, T. A., & Olver, M. E. (2021). Does treatment for sexual offending work? Current Psychiatry Reports, 23, 51. https://doi.org/10.1007/s11920-021-01259-3 CrossRefGoogle ScholarPubMed
Wakefield, S., Kellett, S., Simmonds-Buckley, M., Stockton, D., Bradbury, A., & Delgadillo, J. (2021). Improving Access to Psychological Therapies (IAPT) in the United Kingdom: a systematic review and meta-analysis of 10-years of practice-based evidence. British Journal of Clinical Psychology, 60, e12259. https://doi.org/10.1111/bjc.12259 CrossRefGoogle ScholarPubMed
Wampold, B. E., Flückiger, C., Del Re, A., Yulish, N. E., Frost, N. D., Pace, B. T., Goldberg, S. B., Miller, S. D., Baardseth, T. P., & Laska, K. M. (2017). In pursuit of truth: a critical examination of meta-analyses of cognitive behavior therapy. Psychotherapy Research, 27, 1432.10.1080/10503307.2016.1249433CrossRefGoogle ScholarPubMed
Weck, F., Grikscheit, F., Jakob, M., Höfling, V., & Stangier, U. (2015). Treatment failure in cognitive-behavioural therapy: therapeutic alliance as a precondition for an adherent and competent implementation of techniques. British Journal of Clinical Psychology, 54, 91108. https://doi.org/10.1111/bjc.12063 CrossRefGoogle ScholarPubMed
Weisz, J. R., Krumholz, L. S., Santucci, L., Thomassin, K., & Ng, M. Y. (2015). Shrinking the gap between research and practice: tailoring and testing youth psychotherapies in clinical care contexts. Annual Review of Clinical Psychology, 11, 139163. https://doi.org/10.1146/annurev-clinpsy-032814-112820 CrossRefGoogle ScholarPubMed
Weisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., Jensen-Doss, A., Hawley, K. M., Krumholz Marchette, L. S., Chu, B. C., Weersing, V., & Fordwood, S. R. (2017). What five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice [meta analysis]. American Psychologist, 72, 79117. https://doi.org/10.1037/a0040360 CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Internal consistency of the CTACS* subscales

Figure 1

Table 2. Descriptives CTACS* subscales over four semesters

Figure 2

Table 3. Model based estimates for development of competence on subscales of the CTACS*

Figure 3

Figure 1. Change in competence on subscales of the CTACS over four semesters.

Supplementary material: File

Martinsen et al. supplementary material

Martinsen et al. supplementary material

Download Martinsen et al. supplementary material(File)
File 28.2 KB
Submit a response

Comments

No Comments have been published for this article.