Skip to main content
×
×
Home

A National Quality Improvement Collaborative for the clinical use of outcome measurement in specialised mental healthcare: Results from a parallel group design and a nested cluster randomised controlled trial

  • Margot J. Metz (a1), Marjolein A. Veerbeek (a2), Gerdien C. Franx (a2), Christina M. van der Feltz-Cornelis (a3), Edwin de Beurs (a4) and Aartjan T. F. Beekman (a5)...
Abstract
Background

Although the importance and advantages of measurement-based care in mental healthcare are well established, implementation in daily practice is complex and far from optimal.

Aims

To accelerate the implementation of outcome measurement in routine clinical practice, a government-sponsored National Quality Improvement Collaborative was initiated in Dutch-specialised mental healthcare.

Method

To investigate the effects of this initiative, we combined a matched-pair parallel group design (21 teams) with a cluster randomised controlled trial (RCT) (6 teams). At the beginning and end, the primary outcome ‘actual use and perceived clinical utility of outcome measurement’ was assessed.

Results

In both designs, intervention teams demonstrated a significant higher level of implementation of outcome measurement than control teams. Overall effects were large (parallel group d=0.99; RCT d=1.25).

Conclusions

The National Collaborative successfully improved the use of outcome measurement in routine clinical practice.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      A National Quality Improvement Collaborative for the clinical use of outcome measurement in specialised mental healthcare: Results from a parallel group design and a nested cluster randomised controlled trial
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      A National Quality Improvement Collaborative for the clinical use of outcome measurement in specialised mental healthcare: Results from a parallel group design and a nested cluster randomised controlled trial
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      A National Quality Improvement Collaborative for the clinical use of outcome measurement in specialised mental healthcare: Results from a parallel group design and a nested cluster randomised controlled trial
      Available formats
      ×
Copyright
This is an open access article distributed under the terms of the Creative Commons Non-Commercial, No Derivatives (CC BY-NC-ND) license.
Corresponding author
Correspondence: Margot J. Metz, GGz Breburg, Postbus 770, 5000 AT Tilburg, The Netherlands. Email: mmetz@trimbos.nl
Footnotes
Hide All

Declaration of interest

None.

Footnotes
References
Hide All
1 Fortney, JC, Unützer, J, Wren, G, Pyne, JM, Smith, GR, Schoenbaum, M, et al. A tipping point for measurement based care. Psychiatr Serv 2016; 68: 110.
2 Trivedi, MH, Rush, AJ, Wisniewski, SR, Nierenberg, AA, Warden, D, Ritz, L, et al. Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. Am J Psychiatry 2006; 163: 2840.
3 Guo, T, Xiang, YT, Xiao, L, Hu, CQ, Chiu, HFK, Ungvari, GS, et al. Measurement-based care versus standard care for major depression: a randomized controlled trial with blind raters. Am J Psychiatry 2015; 172: 1004–13.
4 Knaup, C, Koesters, M, Schoefer, D, Becker, T, Puschner, B. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br J Psychiatry 2009; 195: 1522.
5 Carlier, IVE, Meuldijk, D, van Vliet, IM, van Fenema, EM, van der Wee, NJA, Zitman, FG. Routine outcome monitoring and feedback on physical or mental health status: evidence and theory. J Eval Clin Pract 2012; 18: 104–10.
6 Davidson, K, Perry, A, Bell, L. Would continuous feedback of patient's clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychol Psychother 2015; 88: 2137.
7 Valenstein, M, Adler, DA, Berlant, J, Dixon, LB, Dulit, RA, Goldman, B, et al. Implementing standardized assessments in clinical care: now's the time. Psychiatr Serv 2009; 60: 1372–5.
8 Eisen, SV, Dickey, B, Sederer, LI. A self-report symptom and problem rating scale to increase inpatients' involvement in treatment. Psychiatr Serv 2000; 51: 349–53.
9 van der Feltz-Cornelis, CM, Andrea, H, Kessels, E, Duivenvoorden, H, Biemans, H, Metz, M. Does routine outcome monitoring have a promising future? An investigation into the use of shared decision-making combined with ROM for patients with a combination of physical and psychiatric symptoms [in Dutch]. Tijdschr Psychiatr 2014; 56: 375–84.
10 Van Der Wees, PJ, Nijhuis-van der Sanden, MWG, Ayanian, JZ, Black, N, Westert, GP, Schneider, EC. Integrating the use of patient-reported outcomes for both clinical practice and performance measurement: views of experts from 3 countries. Milbank Q 2014; 92: 754–75.
11 Delespaul, PEG. Routine outcome measurement in the Netherlands – a focus on benchmarking. Int Rev Psychiatry 2015; 27: 320–8.
12 Boswell, JF, Kraus, DR, Miller, SD, Lambert, MJ. Implementing routine outcome monitoring in clinical practice: benefits, challenges and solutions. Psychother Res 2015; 1: 619.
13 de Jong, K, van Sluis, P, Nugter, MA, Heiser, WJ, Spinhoven, P. Understanding the differential impact of outcome monitoring: therapist variables that moderate feedback effects in a randomised clinical trial. Psychother Res 2012; 22: 464–74.
14 de Jong, K, Timman, R, Hakkaart-van Royen, L, Vermeulen, P, Kooiman, K, Passchier, J, et al. The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: a randomised controlled trial. Psychother Res 2014; 24: 629–39.
15 de Jong, K. Challenges in the implementation of measurement feedback systems. Adm Policy Ment Health 2016; 43: 467–70.
16 Duncan, EAS, Murray, J. The barriers and facilitators to routine outcome measurement by allied health professionals in practice: a systematic review. BMC Health ServRes 2012; 12: 96.
17 Schouten, LMT, Hulscher, ME, van Everdingen, JJ, Huijsman, R, Grol, RP. Evidence for the impact of Quality Improvement Collaboratives: systematic review. BMJ 2008; 336: 1491–5.
18 Franx, GC. Quality Improvement in Mental Health care: The Transfer of Knowledge into Practice. Scientific Institute for Quality of Healthcare and Netherlands Institute of Mental Health and Addiction, 2012.
19 Øvreveit, J, Bate, P, Cleary, P, Cretin, S, Gustafson, D, McInnes, K, et al. Quality collaboratives: lessons from research. Qual Saf Health Care 2002; 11: 345–51.
20 Metz, MJ, Franx, GC, Veerbeek, MA, de Beurs, E, Van der Feltz-Cornelis, CM, Beekman, AT. Shared decision making in mental health care using routine outcome monitoring as a source of information: a cluster randomised controlled trial. BMC Psychiatry 2015; 15: 313–23.
21 de Beurs, E, den Hollander-Gijsman, ME, van Rood, YR, van der Wee, NJ, Giltay, EJ, van van Noorden, MS, et al. Routine outcome monitoring in the Netherlands: practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clin Psychol Psychother 2011; 18: 112.
22 Berwick, DM. Developing and testing changes in delivery of care. Ann Intern Med 1998; 15: 651–7.
23 van Splunteren, P, van Everdingen, J, Janssen, S, Minkman, M, Rouppe van de Voort, M, Schouten, L, et al. Breaking Through with Results: Improvement of Patient Care using the Breakthrough Method [in Dutch]. Koninklijke van Gorcum, 2003.
24 Nuijen, J, Wijngaarden, B, Veerbeek, M, Franx, G, Meeuwissen, J, Bon van-Martens, M. Implementatie van ROM in de dagelijkse zorgpraktijk. Resultaten van enquêtes onder behandelaren van GGZ instellingen en vrijgevestigde behandelaren. Trimbos-institute, 2014.
25 Vet de, HCW, Terwee, CB, Mokkink, LB, Knol, DL. Measurement in Medicine: A Practical Guide:65-95. Cambridge University Press, 2015.
26 Lipsey, MW, Wilson, DB. The efficacy of psychological, educational and behavioural treatment: confirmation from meta-analysis. Am Psychol 1993; 48: 1181–209.
27 Lipsey, MW. Design Sensitivity: Statistical Power for Experimental Research: 137. Sage, 1990.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

BJPsych Open
  • ISSN: -
  • EISSN: 2056-4724
  • URL: /core/journals/bjpsych-open
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Metrics

Altmetric attention score

Full text views

Total number of HTML views: 0
Total number of PDF views: 25 *
Loading metrics...

Abstract views

Total abstract views: 73 *
Loading metrics...

* Views captured on Cambridge Core between 2nd January 2018 - 21st June 2018. This data will be updated every 24 hours.

A National Quality Improvement Collaborative for the clinical use of outcome measurement in specialised mental healthcare: Results from a parallel group design and a nested cluster randomised controlled trial

  • Margot J. Metz (a1), Marjolein A. Veerbeek (a2), Gerdien C. Franx (a2), Christina M. van der Feltz-Cornelis (a3), Edwin de Beurs (a4) and Aartjan T. F. Beekman (a5)...
Submit a response

eLetters

No eLetters have been published for this article.

×

Reply to: Submit a response


Your details


Conflicting interests

Do you have any conflicting interests? *