Clinical practice guidlines for psychiatric disorders
Clinical practice guidelines provide recommendations for optimising patient treatment, and are based on a systematic review of evidence and an assessment of the advantages and disadvantages of alternative care options and standard tools for clinical decision-making. Various guidelines for the clinical practice of psychiatric disorders have been published,1–Reference Schmidt, Schultze-Lutter, Schimmelmann, Maric, Salokangas and Riecher-Rössler8 and in many countries, psychiatrists commonly make clinical decisions based on clinical practice guidelines. In Japan, clinical practice guidelines for psychiatric disorders were only published 9 years ago, and Japanese psychiatrists usually make clinical decisions based on their own experience or knowledge and not based on clinical practice guidelines. As a result, pharmacotherapy for psychiatric disorders in Japan has been different from that recommended in clinical practice guidelines in other countries.Reference Huang, Yang, Mojtabai, Lin, He and Chong9–Reference Uchida, Suzuki, Mamo, Mulsant, Tsunoda and Takeuchi14 To change this situation, the Japanese Society of Neuropsychopharmacology published the ‘Guideline for Pharmacological Therapy of Schizophrenia’ (clinical practice guideline for schizophrenia) in 2015,15 and the Japanese Society of Mood Disorders published the ‘Treatment Guideline: Major Depressive Disorder’ in 2012,16 which was revised to the ‘Treatment Guideline II: Major Depressive Disorder’ (clinical practice guideline for major depressive disorder) in 2016.17
Dissemination of clinical practice guidelines in Japan
Although the clinical practice guidelines of schizophrenia and major depressive disorder have been published, pharmacotherapy for these disorders has not undergone sufficient transformation in Japan.Reference Huang, Yang, Mojtabai, Lin, He and Chong9,Reference Yang, Chen, Najoan, Kallivayalil, Viboonma and Jamaluddin10 For example, our project previously showed that for patients with schizophrenia, 57.1% were prescribed antipsychotic monotherapy, 15.5% were prescribed antipsychotic monotherapy without any other psychotropics and 31.7% received no prescription of anxiolytics or hypnotics. In addition, at 84 institutions before doctors participated in the educational programmes, 58.6% of patients with depression undergoing in-patient treatment were prescribed antidepressant monotherapy and 25.1% received no prescription of anxiolytics or hypnotics.Reference Iida, Iga, Hasegawa, Yasuda, Yamamoto and Miura18,Reference Ichihashi, Hori, Hasegawa, Yasuda, Yamamoto and Tsuboi19 To improve these statistics, dissemination of and education on the guidelines for Japanese psychiatrists was needed. Thus, we launched the Effectiveness of Guidelines for Dissemination and Education in Psychiatric Treatment (EGUIDE) project in 2016. The purpose of the EGUIDE project is to disseminate the guidelines by conducting educational programmes on the clinical practice guidelines for schizophrenia and major depressive disorder for psychiatrists, and to standardise medical practices in accordance with the clinical practice guidelines. We have already reported on the educational method and the effectiveness of the EGUIDE project in improving knowledge of the clinical practice guidelines in psychiatrists.Reference Takaesu, Watanabe, Numata, Iwata, Kudo and Oishi20 Additionally, the effectiveness of the educational programmes was investigated by evaluating psychiatrists’ clinical behaviours in accordance with the clinical practice guidelines.
The aim of this research is to assess the efficacy of the EGUIDE project in changing clinical behaviours in accordance with the clinical practice guidelines in psychiatrists before and 1 and 2 years after they attend the programmes.
Method
Design and participants
The EGUIDE project recruited psychiatrists from >100 medical institutions in Japan, who volunteered to participate in study during October 2016 and March 2019. All participants signed informed written consent forms. This study was approved by the ethics committee at the National Center of Neurology and Psychiatry (approval number A2017-105) and each of the participating universities, hospitals and clinics. The procedures were carried out in accordance with the Helsinki Declaration. The study protocol was registered in the University Hospital Medical Information Network registry (identifier UMIN000022645). The participants attended a 1-day educational programme on schizophrenia and depression based on the clinical practice guideline for schizophrenia (published by the Japanese Society of Neuropsychopharmacology) and the clinical practice guideline for major depressive disorder (published by the Japanese Society of Mood Disorders). We conducted lectures on the guidelines and discussions using two clinical cases to describe the guidelines and how to apply them in practice. The participants received emails including URLs for self-administered web questionnaires. Using the questionnaires, they retrospectively rated their clinical behaviours in accordance with the clinical practice guidelines in the 6 months before the programme they attended, and they again rated themselves each year thereafter, for 2 years. The effectiveness of each programme was assessed based on changes in the scores of the self-administered questionnaires before and after the programmes.
Assessment measures
To assess participants’ clinical behaviours with respect to general use of the clinical guidelines, a self-administered questionnaire was created consisting of six items rated on a five-point Likert scale (Supplementary Table 1 available at https://doi.org/10.1192/bjo.2022.44). Participants assessed their clinical behaviours in accordance with the clinical practice guidelines for schizophrenia and major depressive disorder by creating self-administered questionnaires, each consisting of 14 items rated on a five-point Likert scale (Supplementary Tables 2 and 3). The evaluations of clinical behaviours were divided into the following six stages, according to the degree of achievement: not achieved (0–20% achieved), slightly achieved (21–40% achieved), approximately half achieved (41–60% achieved), moderately achieved (61–80% achieved), almost achieved (81–100% achieved) and no opportunity.
Statistical analysis
As the representative value for each of the five achievement levels, an intermediate value was used: 10 for ‘not achieved’, 30 for ‘slightly achieved’, 50 for ‘about half achieved’, 70 for ‘moderately achieved’ and 90 for ‘almost achieved’. Therefore, there were five scores, and the scores ranged from 10 to 90. We excluded ‘no opportunity’ from the analysis. We used the Kolmogorov–Smirnov test to evaluate data normality in the scores for the clinical behaviours. We assessed the homoscedasticity of variance with Levine's test. Data were analysed by Kruskal–Wallis test with statistical significance, because the Kolmogorov–Smirnov test did not show normal distribution or homoscedasticity. To compare the changes in the scores for the clinical behaviours between before and 1 and 2 years after attending the programme, the Bonferroni correction was applied for multiple testing when the Kruskal–Wallis test was statistically significant. A significance threshold of 0.05 was applied for multiple testing. The data were initially imputed in Microsoft Excel for Mac (Microsoft Corp, 2010), and then analysed with SPSS version 24.0 for Mac (IBM SPSS Inc, 2016).
Results
Demographics of the participants
A total of 607 psychiatrists from 134 medical institutions participated in educational programmes on the clinical guidelines for treatment of schizophrenia and depression during the 3 years of the EGUIDE project recruitment (October 2016 to March 2019). All of the participants attended a 1-day educational programme on schizophrenia and depression based on the clinical practice guidelines. Of these, 594 participants joined the email-based survey, 425 responded to the web questionnaires at baseline, 270 responded at 1 year and 140 responded at 2 years. Some participants have dropped out during each follow-up period. The numbers of participants who answered web questionnaires, excluding those who dropped out and those who reported ‘no opportunity’ for general use of the clinical guidelines at baseline and after the programmes, are shown in Supplementary Tables 4–6. They were aged 26–70 years, with an average age of 34.4 ± 7.6 years; 369 (72.5%) were male. Years of professional experience ranged from 1 to 35 years, with an average of 5.7 ± 6.7 years. A total of 463 belonged to university hospitals, 20 belonged to psychiatric hospitals, 25 belonged to general hospitals and one belonged to a clinic when attending the programme.
Changes in the scores for clinical behaviours in accordance with the pre- and post-programme
A comparison of all clinical behaviour scores in accordance with the guidelines at baseline and after the clinical practice guideline programmes is shown in Fig. 1. All of the mean scores had increased significantly at 1 year after attending the programme. Furthermore, the clinical behaviours of participants were still significantly higher at 2 years compared with the baseline, with the exception of ‘Choosing treatment with modified electroconvulsive therapy for patients with treatment-resistant schizophrenia’.
Comparison of clinical behaviour scores for the use of clinical guidelines at baseline and after the ‘Guideline for Pharmacological Therapy of Schizophrenia’ and ‘Treatment Guideline II: Major Depressive Disorder’ programmes. The x- and y-axes indicate the score for each question at baseline and the score for each question after programme participation, respectively. Details of each score are shown in Tables 1–3. Blue circles indicate clinical behaviour scores that increased significantly 1 year after attending the ‘Guideline for Pharmacological Therapy of Schizophrenia’ programme, compared with before the course (S1–S14). Blue triangles indicate clinical behaviour scores that increased significantly 2 years after attending the ‘Guideline for Pharmacological Therapy of Schizophrenia’ programme, compared with before the course (S1–S7, S9–S14). Green circles indicate clinical behaviour scores that increased significantly 1 year after attending the ‘Treatment Guideline II: Major Depressive Disorder’ programme, compared with before the course (D1–D14). Green triangles indicate clinical behaviour scores that increased significantly 2 years after attending the ‘Treatment Guideline II: Major Depressive Disorder’ programme, compared with before the course (D1–D14). Red circles indicate clinical behaviour scores that increased significantly 1 year after attending the ‘Guideline for Pharmacological Therapy of Schizophrenia’ and ‘Treatment Guideline II: Major Depressive Disorder’ programmes, compared with before the course (G1–G6). Red triangles indicate clinical behaviour scores that increased significantly 2 years after attending the ‘Guideline for Pharmacological Therapy of Schizophrenia’ and ‘Treatment Guideline II: Major Depressive Disorder’ programmes, compared with before the course (G1–G6). Solid blue triangles indicate clinical behaviour scores that were not significantly elevated 2 years after attending the ‘Guidelines for the Pharmacotherapy of Schizophrenia’ programme compared with before the programme (S8).
The mean and statistical results of the clinical behaviours in accordance with the general use of the guidelines for before and 2 years after programme participation are shown in Table 1, and the data of multiple comparisons are shown in Supplementary Table 7. In all subclasses of clinical behaviours consistent with the general use of the clinical guidelines, the mean scores increased significantly after attending the programme. Furthermore, the clinical behaviours of participants were maintained for 2 years, as the mean score was not significantly different between 1 and 2 years after the programme. One year after attending the programme, a large and significant change was observed in ‘Using treatment guidelines when deciding on the treatment policy in discussions with patients and family’ (Z = 12.75, P = 3.2 × 10−37, r = 0.50). Additionally, moderate and significant changes were seen in ‘Trying to treat patients in accordance with guidelines if their previous treatments are not in accordance with guidelines’ (Z = 12.81, P = 1.4 × 10−37, r = 0.50), ‘Recommending pharmacotherapy for schizophrenia to fellow doctors in accordance with the guideline’ (Z = 9.94, P = 2.9 × 10−23, r = 0.39) and ‘Recommending treatment for depression to fellow doctors in accordance with the guideline’ (Z = 9.83, P = 8.7 × 10−23, r = 0.39).
Comparison of clinical behaviour scores for the general use of clinical guidelines at baseline and after the programmes
The complete questions are noted in Supplementary Table 1. An intermediate value was used as the representative value for each of the five achievement levels: 0–20, 21–40, 41–60, 61–80 and 81–100. The scores ranged from 10 to 90.
a. The Kruskal–Wallis test was used for the statistical analysis as the Kolmogorov–Smirnov test did not indicate normal distribution of clinical behaviour scores at baseline or 1 or 2 years after the programme. The significance level was set at <0.05.
b. The mean scores of clinical behaviours increased significantly 1 year after attending the programme compared with baseline.
c. The mean scores of clinical behaviours increased significantly 2 years after attending the programme compared with baseline.
Table 2 shows the changes in clinical behaviour scores before and after attending the educational programme for the clinical practice guideline for schizophrenia. Supplementary Table 8 shows the multiple comparison of clinical behaviour scores at baseline and 1 and 2 years after the programmes. The mean scores of all of the subclasses increased significantly after the programme. The clinical behaviours of participants, except ‘Choosing treatment with modified electroconvulsive therapy for patients with treatment-resistant schizophrenia’, were maintained for 2 years. A moderate and significant change was observed in ‘Choosing antipsychotic monotherapy but not a combination of antipsychotics’ (Z = 8.04, P = 9.0 × 10−16, r = 0.31) 1 year after attending the programme.
Comparison of clinical behaviour scores at baseline and after the ‘Guideline for Pharmacological Therapy of Schizophrenia’ programme
The complete questions are noted in Supplementary Table 2. An intermediate value was used as the representative value for each of the five achievement levels: 0–20, 21–40, 41–60, 61–80 and 81–100. The scores ranged from 10 to 90.
a. The Kruskal–Wallis test was used for the statistical analysis as the Kolmogorov–Smirnov test did not indicate normal distribution of clinical behaviour scores at baseline or 1 or 2 years after the programme. The significance level was set at <0.05.
b. The mean scores of clinical behaviours increased significantly 1 year after attending the programme compared with baseline.
c. The mean scores of clinical behaviours increased significantly 2 years after attending the programme compared with baseline.
The following are notable points about several general clinical behaviours whose results differed from those previously reported in other countries. The mean score of ‘Choosing antipsychotic monotherapy but not a combination of antipsychotics’ increased after the programme, and a significant change was observed (H = 75.74, P = 3.5 × 10−17): the score was approximately 60 after the programme (46.4 at baseline, 60.5 at 1 year after the programme and 58.9 at 2 years after the programme). In addition, the mean score for ‘Refraining from using psychotropic drugs other than antipsychotics’ also increased significantly after the programme (H = 68.10, P = 1.6 × 10−15), but the score was still <50 after the programme (31.7 at baseline, 44.1 at 1 year after the programme and 46.2 at 2 years after the programme). Although the score increased throughout the programme for ‘For recovery from cognitive impairment in schizophrenia, refraining from using benzodiazepines’ (H = 46.84, P = 6.7 × 10−11), the score at 2 years after the programme was 50.9.
Table 3 shows the mean values and the statistical results of the clinical behaviours before and after the programme for the clinical practice guideline for major depressive disorder. The multiple comparisons of the clinical behaviour scores at baseline and 1 and 2 years after the programme are shown in Supplementary Table 9. In all subclasses, the mean scores increased significantly after attending the programme, and the clinical behaviours were maintained for 2 years. One year after attending programme, moderate changes were observed in ‘Diagnosing depression, including the classification of the severity, based on the DSM-5’ (Z = 9.66, P = 4.6 × 10−22, r = 0.37), ‘In diagnosis, assessing information from any person other than the patient and functional impairments before the onset’ (Z = 8.27, P = 1.4 × 10−16, r = 0.32), ‘When the treatment does not work well, reassessing the diagnosis, pharmacotherapy and environmental management’ (Z = 8.65, P = 5.2 × 10−18, r = 0.33), ‘For mild depression, adding cognitive–behavioural therapy and new-generation antidepressants to fundamental intervention if necessary’ (Z = 9.23, P = 2.7 × 10−10, r = 0.36) and ‘For sleep disorders, providing sleep hygiene instructions before pharmacotherapy’ (Z = 8.72, P = 2.7 × 10−18, r = 0.34).
Comparison of clinical behaviour scores at baseline and after the ‘Treatment Guideline II: Major Depressive Disorder’ programme
The complete questions are noted in Supplementary Table 3. An intermediate value was used as the representative value for each of the five achievement levels: 0–20, 21–40, 41–60, 61–80 and 81–100. The scores ranged from 10 to 90.
a. The Kruskal–Wallis test was used for the statistical analysis as the Kolmogorov–Smirnov test did not indicate normal distribution of the clinical behaviour scores at baseline or 1 or 2 years after the programme. The significance level was set at <0.05.
b. The mean scores of clinical behaviours increased significantly 1 year after attending the programme compared with baseline.
c. The mean scores of clinical behaviours increased significantly 2 years after attending the programme compared with baseline.
The following are notable points about several general clinical behaviours whose results differed from those previously reported in other countries. The score for the clinical behaviour ‘Refraining from using long-term administration of anxiolytics’ increased significantly throughout the programme (H = 81.05, P = 2.5 × 10−18), but it was as low as approximately 50 after attending the programme (36.4 at baseline, 50.2 at 1 year after the programme and 54.3 at 2 years after the programme). Although a significant change was also observed in ‘Refraining from using long-term administration of hypnotics’ (H = 87.01, P = 1.2 × 10−19), the score was <50 after the programme (30.9 at baseline, 44.4 at 1 year after the programme and 48.9 at 2 years after the programme).
Discussion
This is the first study to investigate the effectiveness of the educational programme in the improvement of psychiatrists’ clinical behaviours in accordance with the clinical practice guidelines.
A total of 607 psychiatrists from 134 medical institutions participated in educational programmes on the clinical guidelines for treatment of schizophrenia and depression during the 3 years of the EGUIDE project recruitment, and all clinical behaviours in accordance with clinical practice guidelines improved after attending the EGUIDE programme and were maintained for at least 2 years. These results suggest that our educational programmes could help to improve psychiatrists’ clinical behaviours in accordance with the guidelines. To the best of our knowledge, no study has shown that educational programmes for clinical practice guideline have led to sustained improvements in clinical behaviour over years.
Previous studies have indicated that there could be a large gap between the development of evidence-based guidelines and their implementation in clinical settings,Reference Iida, Iga, Hasegawa, Yasuda, Yamamoto and Miura18,Reference Ichihashi, Hori, Hasegawa, Yasuda, Yamamoto and Tsuboi19,Reference Park, Jang, Xiang, Kanba, Kato and Chong21–Reference Hashimoto, Yasui-Furukori, Hasegawa, Ishikawa, Numata and Hori23 and that a combination of several guideline dissemination and implementation strategies aimed at healthcare professionals has failed to reduce antipsychotic polypharmacy for schizophrenia out-patients.Reference Bighelli, Ostuzzi, Girlanda, Cipriani, Becker and Koesters24 The pathway from evidence to guidelines is highly developed, but the development of guideline implementation strategies has been insufficient and examined in only a few studies.Reference Yoong, Hall, Stacey, Grady, Sutherland and Wyse22,Reference Cabana, Rand, Powe, Wu, Wilson and Abboud25–Reference Herzog, Wagner, Ruckes, Tadic, Roll and Härter27 Although the barriers to improving guideline adherence have not yet been generalised, some reports suggest that low awareness and dissemination of guidelines, as well as inadequate supply systems, could affect their implementation.Reference Yoong, Hall, Stacey, Grady, Sutherland and Wyse22,Reference Yang, Han, Yoon, Pae, Kim and Park26 In this regard, the EGUIDE project has set up a supply system and provides the opportunity to learn about and become proficient in the guidelines.
The number of psychiatrists in Japan is almost 16 000, and approximately 1000 psychiatrists have already participated in the education programmes in the past 5 years. In 2020, only 6.3% of psychiatrists had completed these programmes, but the EGUIDE project estimates that 2000 psychiatrists will finish the programmes in the next 5 years. If >10% of psychiatrists in Japan achieve improvements in clinical behaviour in accordance with the clinical practice guidelines, treatment for schizophrenia and depression could change, which could lead to an improvement in quality of life for patients in Japan.
To better disseminate the clinical practice guidelines, the education programmes of the EGUIDE project need further improvement, and we seek to improve the delivery method annually. We revised the lecture materials associated with items for which knowledge was considered insufficient, and reported results suggesting that the revision of the lecture materials may have improved the degree of understanding of the clinical practice guidelines.Reference Numata, Nakataki, Hasegawa, Takaesu, Takeshima and Onitsuka28
This study has several limitations that should be taken into account when interpreting the results. First, because this study was performed in a single-arm design without a control group, it was difficult to assess the precise effectiveness of the programme despite it being a before-and-after comparison study. Second, since the questionnaires used to evaluate clinical behaviours in accordance with clinical practice guidelines were not validated, and we used a subjective method of assessment, it was unclear whether the questionnaire could adequately assess whether clinical behaviours were in accordance with clinical practice guidelines. Third, because of the lack of background information on the participants, we presumed that there might be many potential confounding factors related to the improvement of clinical behaviours. Fourth, although an annual web questionnaire survey works well as a reminder for past participants to recall the content of the educational programmes and make them aware of whether clinical behaviours are in accordance with clinical practice guidelines, this evaluation is subjective. To assess the precise effect of the education programme, it is necessary to assess changes in quality indicators, such as the prescriptions issued by participants. The results for the improvement of clinical knowledge of the clinical practice guidelines have already been published,Reference Takaesu, Watanabe, Numata, Iwata, Kudo and Oishi20 and in-patient prescribing behaviour will be the object of another paper.
Despite these limitations, the educational programme of the EGUIDE project is considered to be an effective means of guideline dissemination and education. Further dissemination of clinical practice guidelines for schizophrenia and major depression in a variety of clinical settings is needed.
In conclusion, the EGUIDE project, as a dissemination and education programme for the clinical practice guidelines for schizophrenia and major depressive disorder, has the potential to contribute to improvement in clinical behaviours of psychiatrists in accordance with the guidelines.
Further research is needed to clarify the effectiveness of the EGUIDE project for the improvement of quality indicators in clinical situations.
Funding
This work was supported by the Japan Agency for Medical Research and Development (AMED) under grant numbers JP18dk0307060, JP19dk0307083 and JP20dk0307081; the Health and Labor Sciences research grants (H29-Seishin-Ippan-001, 19GC1201); the Japanese Society of Neuropsychopharmacology and the Japanese Society of Mood Disorders. K.W., N.S., R.H., T.T. and H.H. were funded by AMED (grant number JP18dk0307060). H.H., K. Inada, S.N. and H. Yamada were funded by AMED (grant numbers JP19dk0307083 and JP20dk0307081). H.H., K. Inada, Y.T. and Y.Y. were funded by the Health and Labor Sciences research grants (grant number 19GC1201). The funders had no involvement in the study design, data collection and analysis, decision to publish or preparation of the manuscript.
Acknowledgements
We thank all of the participants who contributed to this study.
Data availability
The data are not for public use due to privacy and ethical restrictions (informed consent has not been obtained for the public availability of raw data).
Author contributions
H. Yamada and M. Motoyama were critically involved in collecting and analysing the data, and wrote the first draft of the manuscript. K. Inada and K.W. were critically involved in the design of the study and contributed to the interpretation of the data and writing of the manuscript. N. Hasegawa, K.M., J.M., K. Ohi, N.Y-F., N.S., T.T., K. Ichihashi, N. Hashimoto, Y.T., J.I., H.H., K.F., K. Ogasawara and H.I. were involved in analysing the data and contributed to the interpretation of the data and the writing of the manuscript. S.N., M.T., T. Nagasawa, C.K., K.A., T.I., T.O., H.K., A.H., M.F., T. Nakamura, K.N., R.F., S.Y., H. Yamagata, E.K., A.M., S.O., M. Makinodan, M.K., T.K., Y.Y., M.U. and T.S. were involved in and contributed to the participant recruitment process and data collection, and the data interpretation. R.H. supervised the entire project, and was critically involved in data collection, design, analysis and interpretation of the data. All authors approved the final version of the manuscript and agree to be accountable for all aspects of this work.
Supplementary material
Supplementary material is available online at http://doi.org/10.1192/bjo.2022.44.
Declaration of interest
None.
Open access
eLetters
No eLetters have been published for this article.