Skip to main content
×
Home
    • Aa
    • Aa

Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale

  • B. A. Kohrt (a1) (a2) (a3), M. K. Ramaiya (a3) (a4), S. Rai (a1) (a3), A. Bhardwaj (a3) and M. J. D Jordans (a5) (a6)...
Abstract
Background.

Task-sharing is the involvement of non-specialist providers to deliver mental health services. A challenge for task-sharing programs is to achieve and maintain clinical competence of non-specialists, including primary care workers, paraprofessionals, and lay providers. We developed a tool for non-specialist peer ratings of common factors clinical competency to evaluate and optimize competence during training and supervision in global mental health task-sharing initiatives.

Methods.

The 18-item EN hancing A ssessment of C ommon T herapeutic factors (ENACT) tool was pilot-tested with non-specialists participating in mental health Gap Action Programme trainings in Nepal. Qualitative process evaluation was used to document development of the peer rating scoring system. Qualitative data included interviews with trainers and raters as well as transcripts of pre- and post-training observed structured clinical evaluations.

Results.

Five challenges for non-specialist peer ratings were identified through the process evaluation: (1) balance of training and supervision objectives with research objectives; (2) burden for peer raters due to number of scale items, number of response options, and use of behavioral counts; (3) capturing hierarchy of clinical skills; (4) objective v. subjective aspects of rating; and (5) social desirability when rating peers.

Conclusion.

The process culminated in five recommendations based on the key findings for the development of scales to be used by non-specialists for peer ratings in low-resource settings. Further research is needed to determine the ability of ENACT to capture the relationship of clinical competence with client outcomes and to explore the relevance of these recommendations for non-specialist peer ratings in high-resource settings.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Dropbox account. Find out more about sending content to Dropbox.

      Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your Google Drive account. Find out more about sending content to Google Drive.

      Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale
      Available formats
      ×
Copyright
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Corresponding author
* Address for correspondence: B. A. Kohrt, MD, PhD., Duke Global Health Institute, 213 Trent Hall, 310 Trent Drive, Durham, NC 27708, USA. (Email: brandon.kohrt@duke.edu)
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

M Abas , F Baingana , J Broadhead , E Iacoponi , J Vanderpyl (2003). Common mental disorders and primary health care: current practice in low-income countries. Harvard Review of Psychiatry 11, 166173.

M Biernat , M Manis , TE Nelson (1991). Stereotypes and standards of judgment. Journal of Personality and Social Psychology 60, 485.

IM Blackburn , IA James , DL Milne , C Baker , S Standart , A Garland , FK Reichelt (2001). The revised cognitive therapy scale (CTS-R): psychometric properties. Behavioural and Cognitive Psychotherapy 29, 431446.

D Chibanda , P Mesu , L Kajawu , F Cowan , R Araya , M Abas (2011). Problem-solving therapy for depression and common mental disorders in Zimbabwe: piloting a task-shifting primary mental health care intervention in a population with a high prevalence of people living with HIV. BMC Public Health 11, 828.

JD Corrigan , LD Schmidt (1983). Development and validation of revisions in the counselor rating form. Journal of Counseling Psychology 30, 6475.

CG Fairburn , Z Cooper (2011). Therapist competence, therapy quality, and therapist training. Behaviour Research and Therapy 49, 373378.

J Fuller , D Perkins , S Parker , L Holdsworth , B Kelly , R Roberts , L Fragar (2011). Building effective service linkages in primary mental health care: a narrative review part 2. BMC Health Services Research 11, 66.

SL Garfield (1973). Basic ingredients or common factors in psychotherapy? Journal of Consulting and Clinical Psychology 41, 912.

SJ Heine , DR Lehman , K Peng , J Greenholtz (2002). What's wrong with cross-cultural comparisons of subjective Likert scales?: The reference-group effect. Journal of Personality and Social Psychology 82, 903918.

CE Hill , J Gormally (1977). Effects of reflection, restatement, probe, and nonverbal behaviors on client affect. Journal of Counseling Psychology 24, 9297.

MF Hoyt , CR Marmar , MJ Horowitz , WF Alvarez (1981). The therapist action scale and the patient action scale – instruments for the assessment of activities during dynamic psychotherapy. Psychotherapy-Theory Research and Practice 18, 109116.

R Jenkins , C Othieno , S Okeyo , D Kaseje , J Aruwa , H Oyugi , F Kauye (2013). Short structured general mental health in service training programme in Kenya improves patient health and social outcomes but not detection of mental health problems-a pragmatic cluster randomised controlled trial. International Journal of Mental Health Systems 7, 25.

M Jordans , N Luitel , M Tomlinson , I Komproe (2013). Setting priorities for mental health care in Nepal: a formative study. BMC Psychiatry 13, 332.

R Kakuma , H Minas , N van Ginneken , MR Dal Poz , K Desiraju , JE Morris , RM Scheffler (2011). Human resources for mental health care: current situation and strategies for action. The Lancet 378, 16541663.

BA Kohrt , I Harper (2008). Navigating diagnoses: understanding mind-body relations, mental health, and stigma in Nepal. Culture, Medicine & Psychiatry 32, 462491.

BA Kohrt , MJ Jordans , WA Tol , NP Luitel , SM Maharjan , N Upadhaya (2011). Validation of cross-cultural child mental health and psychosocial research instruments: adapting the depression self-rating scale and child PTSD symptom scale in Nepal. BMC Psychiatry 11, e127.

BA Kohrt , MJD Jordans , S Rai , P Shrestha , NP Luitel , M Ramaiya , V Patel (2015). Therapist competence in Global Mental Health: Development of the Enhancing Assessment of Common Therapeutic Factors (ENACT) rating scale. Behaviour Research and Therapy 69, 1121.

TD Lafromboise , HLK Coleman , A Hernandez (1991). Development and factor structure of the cross-cultural counseling inventory revised. Professional Psychology-Research and Practice 22, 380388.

J Lipsitz , K Kobak , A Feiger , D Sikich , G Moroz , A Engelhard (2004). The rater applied performance scale: development and reliability. Psychiatry Research 127, 147155.

FR Margison , G McGrath , M Barkham , JM Clark , K Audin , J Connell , C Evans (2000). Measurement and psychotherapy: evidence-based practice and practice-based evidence. The British Journal of Psychiatry 177, 123130.

EC Montgomery , ME Kunik , N Wilson , MA Stanley , B Weiss (2010). Can paraprofessionals deliver cognitive-behavioral therapy to treat anxiety and depressive symptoms? Bulletin of the Menninger Clinic 74, 4562.

LK Murray , W Tol , M Jordans , G Sabir , AM Amin , P Bolton , G Thornicroft (2014 a). Dissemination and implementation of evidence based, mental health interventions in post conflict, low resource settings. Intervention 12, 94112.

LKP Murray , SMSWMPH Skavenski , JP Bass , HP Wilcox , PMMPH Bolton , MP Imasiku , JMPH Mayeya (2014 b). Implementing evidence-based mental health care in low-resource settings: a focus on safety planning procedures. Journal of Cognitive Psychotherapy 28, 168185.

SS O'Malley , CS Suh , HH Strupp (1983). The Vanderbilt psychotherapy process scale: a report on the scale development and a process-outcome study. Journal of Consulting and Clinical Psychology 51, 581586.

V Patel (2012). Global mental health: from science to action. Harvard Review of Psychiatry 20, 612.

V Patel , B Weobong , A Nadkarni , H Weiss , A Anand , S Naik , B Kirkwood (2014). The effectiveness and cost-effectiveness of lay counsellor-delivered psychological treatments for harmful and dependent drinking and moderate to severe depression in primary care in India: PREMIUM study protocol for randomized controlled trials. Trials 15, 101.

WN Robiner (2006). The mental health professions: workforce supply and demand, issues, and challenges. Clinical Psychology Review 26, 600625.

L Schindler , E Hohenberger-Sieber , K Hahlweg (1989). Observing client—therapist interaction in behaviour therapy: development and first application of an observational system. British Journal of Clinical Psychology 28, 213226.

DR Singla , B Weobong , A Nadkarni , N Chowdhary , S Shinde , A Anand , H Weiss (2014). Improving the scalability of psychological treatments in developing countries: an evaluation of lay therapist led therapy quality in Goa, India. Behaviour Research and Therapy 60, 5359.

WA Tol , V Patel , M Tomlinson , F Baingana , A Galappatti , D Silove , C Panter-Brick (2012). Relevance or excellence? Setting research priorities for mental health and psychosocial support in humanitarian settings. Harvard Review of Psychiatry 20, 2536.

J Unützer , M Schoenbaum , BG Druss , WJ Katon (2006). Transforming mental health care at the interface with general medicine: report for the Presidents Commission. Psychiatric Services 57, 3747.

PS Wang , O Demler , M Olfson , HA Pincus , KB Wells , RC Kessler (2006). Changing profiles of service sectors used for mental health care in the United States. American Journal of Psychiatry 163, 11871198.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Global Mental Health
  • ISSN: -
  • EISSN: 2054-4251
  • URL: /core/journals/global-mental-health
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords:

Type Description Title
WORD
Supplementary Materials

Kohrt supplementary material
Kohrt supplementary material 1

 Word (25 KB)
25 KB

Metrics

Full text views

Total number of HTML views: 10
Total number of PDF views: 113 *
Loading metrics...

Abstract views

Total abstract views: 122 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 21st July 2017. This data will be updated every 24 hours.