Hostname: page-component-8448b6f56d-mp689 Total loading time: 0 Render date: 2024-04-24T18:43:37.272Z Has data issue: false hasContentIssue false

Does mhGAP training of primary health care providers improve the identification of child- and adolescent mental, neurological or substance use disorders? Results from a randomized controlled trial in Uganda

Published online by Cambridge University Press:  10 September 2018

A. Akol*
Affiliation:
Centre for International Health, University of Bergen, Bergen, Norway
F. Makumbi
Affiliation:
School of Public Health, Makerere University College of Health Sciences, Kampala, Uganda
J. N. Babirye
Affiliation:
School of Public Health, Makerere University College of Health Sciences, Kampala, Uganda
J. S. Nalugya
Affiliation:
Department of Psychiatry, Mulago Hospital Kampala, Kampala, Uganda
S. Nshemereirwe
Affiliation:
Butabika National Mental Referral Hospital, Kampala, Uganda
I. M. S. Engebretsen
Affiliation:
Centre for International Health, University of Bergen, Bergen, Norway
*
*Address for correspondence: Angela Akol, Centre for International Health, University of Bergen, Bergen, Norway. (Email: angela.akol@uib.no)
Rights & Permissions [Opens in a new window]

Abstract

Background.

Integrating child and adolescent mental health (CAMH) into primary health care (PHC) using the WHO mental health gap action program (mhGAP) is recommended for closing a mental health treatment gap in low- and middle-income countries, but PHC providers have limited ability to detect CAMH disorders. We aimed to evaluate the effect of PHC provider mhGAP training on CAMH disorder identification in Eastern Uganda.

Methods.

Thirty-six PHC clinics participated in a randomized controlled trial which compared the proportion of intervention (n = 18) to control (n = 18) clinics with a non-epilepsy CAMH diagnosis over 3 consecutive months following mhGAP-oriented CAMH training. Fisher's exact test and logistic regression based on intention to treat principles were applied. (clinicaltrials.gov registration NCT02552056).

Results.

Nearly two thirds (63.8%, 23/36) of all clinics identified and recorded at least one non-epilepsy CAMH diagnosis from 40 692 clinic visits of patients aged 1–18 recorded over 4 months. The proportion of clinics with a non-epilepsy CAMH diagnosis prior to training was 27.7% (10/36, similar between study arms). Training did not significantly improve intervention clinics’ non-epilepsy CAMH diagnosis (13/18, 72.2%) relative to the control (7/18, 38.9%) arm, p = 0.092. The odds of identifying and recording a non-epilepsy CAMH diagnosis were 2.5 times higher in the intervention than control arms at the end of 3 months of follow-up [adj.OR 2.48; 95% CI (1.31–4.68); p = 0.005].

Conclusion.

In this setting, mhGAP CAMH training of PHC providers increases PHC clinics’ identification and reporting of non-epilepsy CAMH cases but this increase did not reach statistical significance.

Type
Original Research Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s) 2018

Introduction

One in five children globally (Belfer, Reference Belfer2008) and one in seven in sub-Saharan Africa (Cortina et al. Reference Cortina, Sodha, Fazel and Ramchandani2012) suffers a mental, neurological or substance use (MNS) disorder, but the coverage of child and adolescent mental health (CAMH) services in most low- and middle-income countries (LMIC) is poor (Patel et al. Reference Patel, Flisher, Hetrick and McGorry2007, Reference Patel, Flisher, Nikapota and Malhotra2008). Global discussions in the last decade have recommended task-shifting to integrate mental health services into PHC as a means of improving CAMH service access (Eaton et al. Reference Eaton, McCay, Semrau, Chatterjee, Baingana, Araya, Ntulo, Thornicroft and Saxena2011; Kieling et al. Reference Kieling, Baker-Henningham, Belfer, Conti, Ertem, Omigbodun, Rohde, Srinath, Ulkuer and Rahman2011; World Health Organization, 2003; 2008a; b; World Health Organization et al. 2008).

Task shifting is a strategy designed to improve the efficiency of available human resources for health through redistribution of selected roles from highly qualified to lower-trained personnel, freeing up the highly qualified staff to pursue more specialized roles (World Health Organization, 2007). Task-shifting has increasingly been applied to various healthcare systems over the last decade, with demonstrated dividends for population health and cost-saving (Seidman & Atun, Reference Seidman and Atun2017). In Uganda, task-shifting strategies in which tasks are typically transferred from medical doctors to nurses, or nurses to community health workers are conspicuous in HIV/AIDS care (Kalibala et al. Reference Kalibala, Okal, Zieman, Jani, Vu, Ssali, Birungi, Okoboi, Wangisi and Nabiryo2016), maternal and child health (Nabudere et al. Reference Nabudere, Asiimwe and Mijumbi2011), family planning (Janowitz et al. Reference Janowitz, Stanback and Boyer2012) and have been explored for non-communicable disease management (Katende & Donnelly, Reference Katende and Donnelly2016). Task-shifting has also been shown to improve reach and effectiveness of mental health services in low-resource settings with scarce human resources (Hoeft et al. Reference Hoeft, Fortney, Patel and Unützer2018).

Available literature from Uganda suggests that task-shifting in mental health systems is a necessary, feasible and acceptable strategy (Mendenhall et al. Reference Mendenhall, De Silva, Hanlon, Petersen, Shidhaye, Jordans, Luitel, Ssebunnya, Fekadu and Patel2014; Mugisha et al. Reference Mugisha, Abdulmalik, Hanlon, Petersen, Lund, Upadhaya, Ahuja, Shidhaye, Mntambo and Alem2017) which has been applied successfully in scaling up child mental health services in schools (Huang et al. Reference Huang, Nakigudde and Brotman2015). However, the ability of PHC providers to detect and manage CAMH conditions is lacking (Patel et al. Reference Patel, Flisher, Hetrick and McGorry2007). Consequently, mental health services are not integrated into PHC services in spite of several available opportunities (Ovuga et al. Reference Ovuga, Boardman and Wasserman2007; Kigozi & Ssebunnya, Reference Kigozi and Ssebunnya2009; Lund et al. Reference Lund, Tomlinson and Patel2016) and the mental health needs of children and adolescents in Uganda largely go unmet (Ministry of Health Uganda, 2017).

Whereas the burden of CAMH disorders in Uganda has not been accurately estimated, mental health professionals agree that mental ill-health is an increasing problem, exacerbated by poor access to mental health services (Akol et al. Reference Akol, Engebretsen, Skylstad, Nalugya, Ndeezi and Tumwine2015). Currently, mental health services are provided in a centralized framework at national and regional hospitals, contrary to WHO recommendations for mental health care in low-income countries to be provided at PHC clinics and in communities (World Health Organization, 2001, 2008a; Kigozi et al. Reference Kigozi, Ssebunnya, Kizza, Cooper and Ndyanabangi2010; Akol et al. Reference Akol, Engebretsen, Skylstad, Nalugya, Ndeezi and Tumwine2015). Health system research aimed at increasing the availability of and access to mental health care for children and adolescents in settings like Uganda is an important public health priority (Patel et al. Reference Patel, Flisher, Hetrick and McGorry2007; Tomlinson et al. Reference Tomlinson, Rudan, Saxena, Swartz, Tsai and Patel2009).

WHO's mental health gap action program (mhGAP) and its attendant intervention guide (IG) were developed through rigorous, evidence-based methodologies, to aid integration of selected, priority MNS disorders, including developmental and behavioral disorders in children and adolescents, into PHC services in LMIC. The IG provides algorithms for simplified clinical assessment, diagnosis, management, follow-up and referral were indicated as well as a trainer's guide to facilitate standardized implementation (World Health Organization, 2010). Based on evidence and extensive feedback from mhGAP-IG practitioners, the WHO in 2016 launched a second version of the mhGAP-IG with revised modules for Child and Adolescent Mental and Behavioural Disorders (World Health Organization, 2017). Several countries in sub-Saharan Africa are implementing mhGAP; a 2017 systematic review of studies reporting mhGAP implementation concluded that the program has been beneficial to mental health care in LMIC.

Stiffman and colleagues’ Gateway Provider Model (Fig. 1) addresses mental health service access and articulates the importance of decision-makers who influence health system trajectories into care. In the context of children and adolescents, these decision makers are called Gateway Providers, and their knowledge of and attitudes to CAMH influence access to care (Stiffman et al. Reference Stiffman, Pescosolido and Cabassa2004). In rural Uganda, PHC providers are an important category of gateway provider (Kigozi & Ssebunnya, Reference Kigozi and Ssebunnya2009a) whose role in increasing access to CAMH services in Uganda is unknown. Further, scanty literature exists on the effectiveness of integrating CAMH into PHC through mhGAP-IG implementation in LMIC. This study aimed to evaluate the effect of a PHC provider mhGAP-IG-oriented CAMH training on identification of MNS disorders among children and adolescents in Eastern Uganda.

Fig. 1. The Gateway Provider Model of youth access to mental health services, from Stiffman et al. (Reference Stiffman, Pescosolido and Cabassa2004).

Methods

Study area

The study was conducted in Mbale and Sironko districts in Eastern Uganda, selected because both were mhGAP naïve; and Mbale was the site for previous CAMH work in the ‘SeeTheChild—Mental Child Health in Uganda’ (SeeTheChild) study (Center for International Health), which included Sironko district in its catchment area. We concluded that there was no mhGAP exposure in the districts prior to our study based on our knowledge of the area, and on confirmation with the district health authorities.

The two districts possess all levels of health service, including rural health posts and a psychiatric unit at the regional referral hospital in Mbale town. They are mostly rural, characterized by a steep mountainous terrain that presents a physical barrier to psychiatric and other health services. Pathways to mental health care typically include traditional healers (Abbo, Reference Abbo2011; Akol et al. Reference Akol, Engebretsen, Skylstad, Nalugya, Ndeezi and Tumwine2015), and psychiatric referral facilities where they exist (Kisa et al. Reference Kisa, Baingana, Kajungu, Mangen, Angdembe, Gwaikolo and Cooper2016).

The study included Level-3 health clinics (HC III) because they are the lowest level at which comprehensive PHC services are provided. In addition, the presence of at least four staff at the HC III enabled two staff members to attend CAMH training without disabling service delivery. In 2014, Mbale district had 25 public HC-III compared with 12 in Sironko. At these HC III, PHC services are provided by clinical officers, nurses and midwives. Clinical officers have 3 years of pre-service training compared with nurses and midwives who hold a certificate following 1–2 years of pre-service training. Exposure to MNS disorders during pre-service training varies for these cadres; clinical officers’ training typically has more content on MNS disorders than a nurse or midwife training (Collins et al. Reference Collins, Musisi, Frehywot and Patel2015).

Study design

This was a randomized controlled study that compared the clinic-level outcomes of CAMH training on CAMH case identification and recording compared with non-CAMH trained sites. A list of all eligible clinics in Mbale and Sironko districts was obtained from the district health offices and randomly assigned to intervention and control by an independent collaborator who was separate from the research team, using computer-generated random numbers. In randomizing, first, the clinic list was sorted alphabetically to eliminate clinic sorting by district before a random sequence number was generated using the command ‘randomize’ in stata v.12 (StataCorp Texas, USA 2011). This method resulted in 18 clinics being allocated each to the intervention and control arms.

Inclusion and exclusion criteria

Clinics were included if they were HC IIIs owned and managed under the government health system in the two districts; and excluded if they had a psychiatric nurse or clinical officer on staff or had been exposed to the mhGAP-IG prior to the study. None of the clinics met the exclusion criteria.

Sample size calculation

The sample size determination was done using the formula by Fleiss for sample size in cohorts and trials (Fleiss et al. Reference Fleiss, Levin and Paik2013). The following assumptions were made: estimated CAMH diagnosis rate of −0.5% (based on district records), a 50% detection rate in exposed clinics, a power of 90%, the type-I rate of 5% with a two-sided confidence interval. Applying these assumptions gives us an estimated number of 18 clinics required in each arm.

Procedures for intervention

Control arm

Treatment as usual, characterized by routine PHC services to children and adolescents

Intervention package

  1. 1. Training PHC workers (midwives, nurses and/or clinical officers) on how to screen and refer for priority CAMH conditions, based on the WHO mhGAP-IG v1.

  2. 2. Provision of reference training materials (handouts from the training slides) on patient screening using the mhGAP-IG v1.

Training: Two PHC workers from each intervention clinics were trained for 5 days to screen children and adolescents for CAMH conditions, based on the mhGAP-IG curriculum version 1.0 (World Health Organization, 2010). Most of the PHC workers were nurses or midwives and just over 40% had been in service for less than 5 years. The aim of the training was to equip the PHC workers with knowledge and skills in assessment, identification and treatment or referral of children and adolescents with mental health problems so as to contribute to early referral of children into care. An account of the PHC workers, training and outcomes is published separately (Akol et al. Reference Akol, Nalugya, Nshemereirwe, Babirye and Engebretsen2017).

Blinding

PHC workers could not be blinded to the intervention. However, we did not independently check patients’ awareness of the training. Data entry personnel and the two research assistants (RAs) who were responsible for capturing clinic records were blinded to clinic allocation.

Data collection

The principal investigator and two RAs (clinicians resident in the districts, familiar with the district health system) captured service delivery records containing information on patient age, sex, residence and diagnosis from clinic registers, using electronic tablets. Data were collected for the month preceding the intervention (baseline) and for each of 3 months subsequent to the intervention (follow-up months 1, 2 and 3). For each patient, clinic registers include a provision for a first and second diagnosis to enable recording of co-morbidities. Both first and second diagnoses were captured.

Data processing

Records were then entered into Epidata V3.1 (The EpiData Association, Odense, Denmark) by a team of trained and experienced data entrants. Epidata files were exported to STATA v13 (statacorpIC) for cleaning and analyses.

Explanatory and outcome variables were treated as follows: first, only patients aged 1–18 years were selected, and patient age was re-categorized into 1–4, 5–9,10–14 and 15–18 age groups. Second, all diagnoses were reclassified and re-coded into WHO's International Statistical Classification of Diseases and Related Health Problems, version 10 (ICD-10) categories (World Health Organization, 2004). In doing this, all possible diagnoses in the clinic register fitting under an ICD-10 category were replaced with the ICD-10 category name using appropriate commands in stata. Thus, the ICD-10 category ‘Mental and Behavioral’ replaced all mental health diagnoses. Mental and Behavioral disorders were further classified according to the fifth edition of the Diagnostic and Statistical Manual of Mental disorders, (DSM V) (American Psychiatric Association, 2013) and the frequencies analyzed by study arm and month of study.

Outcome measures

The primary outcome was the proportion of clinics in the intervention relative to the control arm that diagnosed and recorded at least one non-epilepsy CAMH case over the 3-month follow-up period while the secondary outcome was the likelihood of patients receiving a non-epilepsy CAMH diagnosis in the intervention compared with the control arms. Epilepsy was excluded based on available information showing that epilepsy is already being diagnosed and managed in PHC settings (Kigozi et al. Reference Kigozi, Ssebunnya, Kizza, Cooper and Ndyanabangi2010; Lund et al. Reference Lund, Tomlinson and Patel2016).

Statistical methods

We used Intention to Treat principles. The unit of analysis was a health facility, and the primary outcome was a facility reporting at least a diagnosed non-epilepsy CAMH case, coded as 1:yes or else 0:no if no such case was reported. We compared the primary out between study arms using Fisher's exact test (Fisher, Reference Fisher1922). The choice of analysis approach was decided based on the number of expected observations in the table cells that were five or less in either or both study arms. Statistical significance was determined at p < 0.05.

The secondary outcome was ‘patients diagnosed with non-epilepsy CAMH’. All patients diagnosed with non-epilepsy CAMH were coded as 1 = yes or 0 = no if no such diagnosis was made. The odds of a non-epilepsy CAMH diagnosis were compared between intervention and control arm to obtain the odds ratio (OR) as the measure of association. The ORs were obtained via a logistic regression model with corresponding 95% confidence intervals (CI). In the multivariable logistic regression model, factors such as age and sex were included. All models accounted for clustering of observations at the clinic level to obtain robust standard errors of the estimates. Stata version 14 was used for all the analyses.

Role of the funding sources

The study sponsors had no role in study design or management; data collection or handling; interpretation of findings or writing of the paper. AA, IMSE and JNB had full access to all study data and are responsible for the decision to submit for publication.

Results

Figure 2 shows the trial profile, including all clinics and patients aged 1–18 whose data was analyzed.

Fig. 2. CONSORT flow diagram.

Forty-two percent of clinics in Mbale (n = 11) and 46.2% in Sironko (n = 7) were allocated to the intervention arm. Clinics were equally distributed by the district in the intervention and control arms, but the number of patient visits was significantly different (p < 0.001) in intervention and control clinics (Table 1).

Table 1. Characteristics of clinics by study arm

Participants were equally distributed across study arms for age group and sex (Table 2). Clinics in the intervention arm received 44.5% of all patients seen across the 4 months. Equal proportions of patients were seen at intervention and control clinics in all months, except in November, when increased numbers of patients were recorded in both intervention and non-intervention clinics. Sixty percent of patients in both arms were female and the mean age of patients across study arms was 9 years.

Table 2. Background characteristics of patients 1–18 years by study arm

Disease profile

Respiratory conditions were the most prevalent across the follow-up months (40.5%); followed by infectious and parasitic infections (39.6%). Mental and behavioral conditions represented 0.1% (n = 64) of all diagnoses recorded. Except for mental and behavioral conditions, all other disease categories were equally distributed between the two arms (data not shown).

Types of CAMH cases diagnosed

Twenty-three clinics overall (63.8%) recorded a CAMH diagnosis; 14 (77.8%) of these were in the intervention arm. Over the 3 months’ follow-up period the number of CAMH-diagnoses at intervention clinics ranged from 0 to 7, with half (n = 18) of the diagnoses in the intervention arm being recorded by three clinics. On the other hand, in control clinics, CAMH diagnoses ranged from 0 to 5 in number with one clinic providing 36% of diagnosed patients (data not shown).

Table 3 presents the CAMH diagnoses. The most prevalent disorders were somatic symptom disorders (31.3%, n = 20), accounting for two-thirds of all CAMH diagnoses recorded in the baseline month, 44.4% (8/18) of all CAMH disorders identified in the control and 26% (12/46) in the intervention arms.

Table 3. CAMH profile by month and study arm

int, intervention arm.

a 64 diagnoses were recorded from 63 unique patients.

Primary outcome

A total of 20 out of 36 clinics made and recorded at least one CAMH diagnosis over the 3-month follow-up period. The proportion of clinics with a CAMH diagnosis tended to be higher in the intervention (13/18, 72.2%) relative to the control (7/18, 38.9%) arm but this difference was not statistically significant (p = 0.092) (Table 4).

Table 4. Percent of clinics with CAMH diagnosis by study arm

Secondary outcome

Over the 3-month follow-up period, the adjusted odds of a patient being diagnosed with a CAMH case were 3.4 times higher in the intervention relative to the control arm, and this effect was statistically significant [aOR = 3.38; 95% CI (1.34–8.52), p = 0.010]. The effect of the intervention on patient diagnosis was highest in the first follow-up month [aOR 4.16; 95% CI (0.73–23.72), p > 0.05] and decreased sequentially for the second [aOR 3.82, 95% CI (1.16–12.60), p = 0.027)]and third [aOR 2.56, 95% CI (0.80–8.21), p > 0.05] follow-up months. The odds of a CAMH diagnosis in the third follow-up month were the same as the odds of a CAMH diagnosis in the baseline month (Table 5).

Table 5. Logistic regression of a CAMH diagnosis between study arms (controlling for age and sex, and accounting for clustering effects at clinic level)

a Accounting for clustering effects at the clinic level.

** p < 0.05.

At baseline, the odds of diagnosing a patient with a non-epilepsy CAMH condition were higher in the intervention than in the control arm, but this was not statistically significant; this finding may suggest some level of residual imbalance in the assigned study arms. Therefore, the final model was adjusted for baseline identification of CAMH at the facility level. This model confirmed that clinics in the intervention arm had 3.4 times higher odds of diagnosing CAMH in the intervention relative to control arm clinics, [aOR 3.38; 95% CI (1.34–8.52); p = 0.010].

Discussion

This study examined the effect of CAMH training on non-epilepsy CAMH case identification among PHC providers in Eastern Uganda. We found no significant difference in the proportion of intervention and control clinics diagnosing non-epilepsy CAMH. However, the odds of a patient being diagnosed with non-epilepsy CAMH were significantly higher in the intervention than control clinics.

To our knowledge, this study is one of the first on CAMH integration into PHC in Uganda, and one of the first to report clinic-level impacts of PHC worker CAMH training. Available studies on mental health training for PHC providers are oriented to adult-psychiatry and most report provider-level effects (Liu et al. Reference Liu, Jack, Piette, Mangezi, Machando, Rwafa, Goldenberg and Abas2016). Our study found that mhGAP CAMH training of PHC workers did not significantly affect clinic-level non-epilepsy CAMH diagnoses. Similarly, a cluster randomized trial in Kenya revealed that non-specialist health worker (NSHW) mental health training improved patient outcomes but did not enhance the detection of mental health problems in primary health care (Jenkins et al. Reference Jenkins, Othieno, Okeyo, Kaseje, Aruwa, Oyugi, Bassett and Kauye2013b).

We attribute the lack of impact to three factors: first, the CAMH diagnoses made over the 3-month follow-up period (51 in both intervention and control arms) were likely too few to generate a visible effect. The scantiness of diagnoses might be a result of a low prevalence of non-epilepsy CAMH illness in this community, estimates of which are not available. Another likely reason is a poor help-seeking behavior to the public health system for non-epileptic CAMH conditions. However, we were unable to find evidence of this in the CAMH literature in settings similar to Uganda's. Third, half the diagnoses in the intervention clinics came from three clinics; and over a third in the control clinics were provided by one facility. This suggests unique motivational factors affecting providers in those facilities, skewing the diagnoses towards a few clinics. Such system-level factors like patient load, health worker numbers and their skills-mix, as well as clinic management have been identified as factors that influence health system performance (Murray & Frenk, Reference Murray and Frenk2000; Rowe et al. Reference Rowe, de Savigny, Lanata and Victora2005; Jerene et al. Reference Jerene, Biru, Teklu, Rehman, Ruff and Wissow2017). However, we did not investigate these factors in our study.

Nevertheless, we found significantly higher CAMH diagnoses in intervention than in control clinics. Previous studies evaluating task-shifting for mental health in similar contexts have also reported positive results. Gureje et al. found analogous results in their 2015 study in Nigeria (Gureje et al. Reference Gureje, Abdulmalik, Kola, Musa, Yasamy and Adebayo2015) and a 2013 Cochrane review found that the use of NSHW resulted in positive treatment outcomes compared with usual services for depression, anxiety, post-traumatic stress and alcohol use disorders in seven LMIC (Van Ginneken et al. Reference Van Ginneken, Tharyan, Lewin, Rao, Meera, Pian, Chandrashekar and Patel2013). This review was oriented to adult psychiatry and like our study, focused on NSHW training, though it assessed the utility of NSHW for improved treatment outcomes, rather than for enhanced detection of mental health conditions.

Except for the second follow-up month, we did not find any beneficial effect when data were examined on a month-on-month basis. Rather, the benefit was detectable after the 3-month follow-up period. The most plausible explanation for this is that the incidence and prevalence of CAMH cases in the two districts were too low to result in a perceptible difference at a single month, particularly since our intervention did not include community mobilization to encourage CAMH clinic attendance. Thus, over the 3-month follow-up period, only 64 CAMH cases were identified among 63 patients, corresponding to a clinic-prevalence rate of 0.1%. A study in neighboring Kenya was able to enroll 166 CAMH patients over an equivalent 12-week period (Kamau et al. Reference Kamau, Omigbodun, Bella-Awusah and Adedokun2017) but this study was conducted at a tertiary hospital in an urban setting. A possible explanation for the significant result in the second follow-up month is the comparatively higher under-19 patient visits in that month compared with the other follow-up months (51.6%, n = 11867).

We found that the effect of the intervention on non-epilepsy CAMH was strongest in the first follow-up month, reducing progressively until the third follow-up month when the effect size was equivalent to that in the baseline month. This finding strongly suggests that the knowledge and skills acquired during training diminish over time, requiring regular ‘refresher’ trainings. This suggestion is backed by similar findings elsewhere with PHC providers in sub-Saharan Africa (Gureje et al. Reference Gureje, Abdulmalik, Kola, Musa, Yasamy and Adebayo2015; Tilahun et al. Reference Tilahun, Hanlon, Araya, Davey, Hoekstra and Fekadu2017). In addition to declining health worker knowledge and skills, other health system weaknesses may account for a reduced effect on diagnoses over time. Jenkins et al. (Reference Jenkins, Othieno, Okeyo, Aruwa, Kingora and Jenkins2013a, Reference Jenkins, Othieno, Okeyo, Kaseje, Aruwa, Oyugi, Bassett and Kauyeb) report that inadequate information systems, district-level supervision and medicines supply may frustrate mental health integration into PHC (Jenkins et al. Reference Jenkins, Othieno, Okeyo, Aruwa, Kingora and Jenkins2013a). These factors are present in Uganda's health system and may have played a role in declining performance (Kigozi et al. Reference Kigozi, Ssebunnya, Kizza, Cooper and Ndyanabangi2010; Akol et al. Reference Akol, Engebretsen, Skylstad, Nalugya, Ndeezi and Tumwine2015).

CAMH case profile

We found a low CAMH morbidity rate with a high prevalence of somatic-symptom and anxiety disorders. The CAMH disorder profile we found is similar to that seen in a recent study in urban Kenya which found that alcohol and substance use disorders were the most prevalent, followed by depression and anxiety-related disorders (Kamau et al. Reference Kamau, Omigbodun, Bella-Awusah and Adedokun2017). Alcohol use disorders were not identified in our study but somatic symptom disorders were commonly diagnosed in the baseline month and by clinics in the control arm, suggesting that the ability of PHC workers to identify them is independent of CAMH training. This proposition is supported by recent opinions suggesting that the DSM-V somatic symptom diagnostic criteria are so inclusive that they increase the risk of healthy patients being classified as mentally ill (Frances, Reference Frances2013). This over-diagnosis is a possibility we can neither rule out nor confirm in our study since we did not validate the PHC providers’ diagnoses.

Strengths and limitations

The following limitations should be considered in the interpretation of our study findings. First, we recognize the reliance on routinely collected health information from clinic-based registers, which have known limitations with completeness and correctness of entries (World Health Organization, 2011). We excluded several records from the study for incomplete or incorrect reporting of either age or diagnosis or both. Thus, though we cannot quantify the excluded records, we believe that the prevalence of CAMH disorders may be under-estimated in this study.

Second, our estimated sample size was based on a 0–1% detection rate in the unexposed, based on CAMH-diagnosis records in the District Health Information System (DHIS). An estimate closer to the rate we found in the un-exposed clinics would have yielded a larger sample size. Thus, using estimates from DHIS led to a small sample size, effectively under-powering the study. This might explain the lack of statistical significance in the primary outcome despite the higher percent (72.2%) of the intervention compared with control (38.9%) clinics with a CAMH diagnosis. Third, during data collection, we encountered several instances in which trained staff were absent from the clinics for extended periods. Such absenteeism was foreseen; hence the training of two PHC providers per clinic. Thus, much as all intervention clinics retained at least one trained staff for the duration of the study, we cannot exclude the likelihood that not all patients received CAMH screening, with consequent under-detection of CAMH cases.

Fourth, we did not consider clinic characteristics such as staff numbers per clinic and health worker cadre and work experience in analysis. Lack of data on these potential confounders may limit our ability to make more clear conclusions about the effect of the intervention on diagnosing of non- epilepsy CAMH. Finally, although the intervention and control arms shared several similarities, they were dissimilar in the number of patient visits during the follow-up period. This bias was addressed by adjusting for the clinic variable in the multivariable analyses. On the other hand, we note some strengths of this study. The robust study design we applied enables us to draw conclusions about the utility of PHC provider CAMH training on the studied clinic-level CAMH outcomes. Additionally, we addressed the potentially confounding effect of clinics’ baseline ability to identify CAMH cases by adjusting for this factor in the multivariable logistic regression.

Conclusions

In this setting, mhGAP CAMH training of PHC providers increases PHC clinics’ identification and reporting of non-epilepsy CAMH cases but this increase is not statistically significant. However, training significantly improves the likelihood of a non-epilepsy CAMH diagnosis.

This study utilized a random selection of all public HC III in two districts which are similar in health system characteristics to other rural Ugandan districts; therefore, the results from this study are generalizable to other HC III in Uganda and other similarl rural settings in sub-Saharan Africa. Our findings suggest that much as CAMH training of PHC providers in Uganda would not result in improved clinic-level competence to diagnose CAMH conditions, it would lead to increased identification of CAMH disorders. Further task-sharing studies integrating CAMH into a larger sample of PHC clinics are suggested, including a community mobilization component in the intervention to improve CAMH clinic attendance.

Acknowledgements

Funded by the Norwegian Research Council RCN #220887 ’SeeTheChild – Mental Child Health in Uganda’ study and the Norwegian state loan fund.

Contributors

AA led study conceptualization and design, managed the study, conducted statistical analysis, and led article writing. FM led statistical analysis, data interpretation, and contributed to the final version. JN and SN led training and clinical procedures and reviewed the final report. JNB and IMSE contributed to protocol design and review of data and final report. IMSE also conceived the parent SeeTheChild study.

Declaration of interest

We declare no conflicts of interest.

Ethical standards

Ethics review and approval was provided by Makerere University's School of Public Health Higher Degrees Research Ethics Committee (HDREC) and the Uganda National Council for Science and Technology (UNCST). Written informed consent was obtained from all PHC providers. Permission for the study was obtained from the Ugandan Ministry of Health and from the two district health offices. The study was registered in ClinicalTrials.gov (number NCT02552056).

References

Abbo, C (2011). Profiles and outcome of traditional healing practices for severe mental illnesses in two districts of Eastern Uganda. Global Health Action 4, 7117.Google Scholar
Akol, A, Engebretsen, IMS, Skylstad, V, Nalugya, J, Ndeezi, G, Tumwine, J (2015). Health managers’ views on the status of national and decentralized health systems for child and adolescent mental health in Uganda: a qualitative study. Child and Adolescent Psychiatry and Mental Health, 9, 1.Google Scholar
Akol, A, Nalugya, J, Nshemereirwe, S, Babirye, JN, Engebretsen, IMS (2017). Does child and adolescent mental health in-service training result in equivalent knowledge gain among cadres of non-specialist health workers in Uganda? A pre-test post-test study. International Journal of Mental Health Systems 11, 50.Google Scholar
American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). Washington, DC: American Psychiatric Pub.Google Scholar
Belfer, ML (2008). Child and adolescent mental disorders: the magnitude of the problem across the globe. Journal of Child Psychology and Psychiatry 49, 226236.Google Scholar
Center for International Health (2014) Available online: http://www.uib.no/node/83170 [Accessed September 6 2017].Google Scholar
Collins, PY, Musisi, S, Frehywot, S, Patel, V (2015). The core competencies for mental, neurological, and substance use disorder care in sub-Saharan Africa. Global Health Action 8, p. 26682.Google Scholar
Cortina, MA, Sodha, A, Fazel, M, Ramchandani, PG (2012). Prevalence of child mental health problems in sub-Saharan Africa: a systematic review. Archives of Pediatrics & Adolescent Medicine 166, 276281.Google Scholar
Eaton, J, McCay, L, Semrau, M, Chatterjee, S, Baingana, F, Araya, R, Ntulo, C, Thornicroft, G, Saxena, S (2011). Scale up of services for mental health in low-income and middle-income countries. The Lancet 378, 15921603.Google Scholar
Fisher, RA (1922). On the interpretation of χ2 from contingency tables, and the calculation of P. Journal of the Royal Statistical Society 85, 8794.Google Scholar
Fleiss, JL, Levin, B, Paik, MC (2013). Statistical Methods for Rates and Proportions. New York: John Wiley & Sons.Google Scholar
Frances, A (2013). The new somatic symptom disorder in DSM-5 risks mislabeling many people as mentally ill. BMJ 346, f1580.Google Scholar
Gureje, O, Abdulmalik, J, Kola, L, Musa, E, Yasamy, MT, Adebayo, K (2015). Integrating mental health into primary care in Nigeria: report of a demonstration project using the mental health gap action programme intervention guide. BMC Health Services Research 15, 242.Google Scholar
Hoeft, TJ, Fortney, JC, Patel, V, Unützer, J (2018). Task-sharing approaches to improve mental health care in rural and other Low-resource settings: a systematic review. The Journal of Rural Health 34, 4862.Google Scholar
Huang, K-Y, Nakigudde, J, Brotman, LM (2015). Use of task-shifting to scale-up child mental health services in low-resource Ugandan schools: role of contextual factors on program implementation. Implementation Science 10(S1), A23.Google Scholar
Janowitz, B, Stanback, J, Boyer, B (2012). Task sharing in family planning. Studies in Family Planning 43, 5762.Google Scholar
Jenkins, R, Othieno, C, Okeyo, S, Aruwa, J, Kingora, J, Jenkins, B (2013 a). Health system challenges to integration of mental health delivery in primary care in Kenya-perspectives of primary care health workers. BMC Health Services Research 13, 368.Google Scholar
Jenkins, R, Othieno, C, Okeyo, S, Kaseje, D, Aruwa, J, Oyugi, H, Bassett, P, Kauye, F (2013 b). Short structured general mental health in service training programme in Kenya improves patient health and social outcomes but not detection of mental health problems – a pragmatic cluster randomised controlled trial. International Journal of Mental Health Systems 7, 25.Google Scholar
Jerene, D, Biru, M, Teklu, A, Rehman, T, Ruff, A, Wissow, L (2017). Factors promoting and inhibiting sustained impact of a mental health task-shifting program for HIV providers in Ethiopia. Global Mental Health 4, e24.Google Scholar
Kalibala, S, Okal, J, Zieman, B, Jani, N, Vu, L, Ssali, L, Birungi, J, Okoboi, S, Wangisi, J, Nabiryo, C (2016). Retrospective review of task-shifting community-based programs supporting ARV treatment and retention in Uganda. Available online: https://www.popcouncil.org/uploads/pdfs/2016HIV_UgandaTaskShifting.pdf [Accessed September 8 2017].Google Scholar
Kamau, JW, Omigbodun, OO, Bella-Awusah, T, Adedokun, B (2017). Who seeks child and adolescent mental health care in Kenya? A descriptive clinic profile at a tertiary referral facility. Child and Adolescent Psychiatry and Mental Health 11, 14.Google Scholar
Katende, G, Donnelly, M (2016). Shining a light on task-shifting policy: exploring opportunities for adaptability in non-communicable disease management programmes in Uganda. Sultan Qaboos University Medical Journal 16, e161.Google Scholar
Kieling, C, Baker-Henningham, H, Belfer, M, Conti, G, Ertem, I, Omigbodun, O, Rohde, LA, Srinath, S, Ulkuer, N, Rahman, A (2011). Child and adolescent mental health worldwide: evidence for action. Lancet 378, 15151525.Google Scholar
Kigozi, F, Ssebunnya, J, Kizza, D, Cooper, S, Ndyanabangi, S (2010). An overview of Uganda's mental health care system: results from an assessment using the world health organization's assessment instrument for mental health systems (WHO-AIMS). International Journal of Mental Health Systems 4, 1.Google Scholar
Kigozi, FN, Ssebunnya, J (2009). Integration of mental health into primary health care in Uganda: opportunities and challenges. Mental Health in Family Medicine 6, 3742.Google Scholar
Kisa, R, Baingana, F, Kajungu, R, Mangen, PO, Angdembe, M, Gwaikolo, W, Cooper, J (2016). Pathways and access to mental health care services by persons living with severe mental disorders and epilepsy in Uganda, Liberia and Nepal: a qualitative study. BMC Psychiatry 16, 305.Google Scholar
Liu, G, Jack, H, Piette, A, Mangezi, W, Machando, D, Rwafa, C, Goldenberg, M, Abas, M (2016). Mental health training for health workers in Africa: a systematic review. The Lancet Psychiatry 3, 6576.Google Scholar
Lund, C, Tomlinson, M, Patel, V (2016). Integration of mental health into primary care in low- and middle-income countries: the PRIME mental healthcare plans. The British Journal of Psychiatry 208(Suppl 56), s1s3.Google Scholar
Mendenhall, E, De Silva, MJ, Hanlon, C, Petersen, I, Shidhaye, R, Jordans, M, Luitel, N, Ssebunnya, J, Fekadu, A, Patel, V (2014). Acceptability and feasibility of using non-specialist health workers to deliver mental health care: stakeholder perceptions from the PRIME district sites in Ethiopia, India, Nepal, South Africa, and Uganda. Social Science & Medicine 118, 3342.Google Scholar
Ministry of Health Uganda (2017). Child and Adolescent Mental Health Policy Guidelines. Kampala, Uganda.Google Scholar
Mugisha, J, Abdulmalik, J, Hanlon, C, Petersen, I, Lund, C, Upadhaya, N, Ahuja, S, Shidhaye, R, Mntambo, N, Alem, A (2017). Health systems context (s) for integrating mental health into primary health care in six Emerald countries: a situation analysis. International Journal of Mental Health Systems 11, 7.Google Scholar
Murray, CJ, Frenk, J (2000). A framework for assessing the performance of health systems. Bulletin of the World Health Organization 78, 717731.Google Scholar
Nabudere, H, Asiimwe, D, Mijumbi, R (2011). Task shifting in maternal and child health care: an evidence brief for Uganda. International Journal of Technology Assessment in Health Care 27, 173179.Google Scholar
Ovuga, E, Boardman, JED, Wasserman, D (2007). Integrating mental health into primary health care: local initiatives from Uganda. World Psychiatry 6, 6061.Google Scholar
Patel, V, Flisher, AJ, Hetrick, S, McGorry, P (2007). Mental health of young people: a global public-health challenge. The Lancet 369, 13021313.Google Scholar
Patel, V, Flisher, AJ, Nikapota, A, Malhotra, S (2008). Promoting child and adolescent mental health in low and middle income countries. Journal of Child Psychology and Psychiatry 49, 313334.Google Scholar
Rowe, AK, de Savigny, D, Lanata, CF, Victora, CG (2005). How can we achieve and maintain high-quality performance of health workers in low-resource settings? The Lancet 366, 10261035.Google Scholar
Seidman, G, Atun, R (2017). Does task shifting yield cost savings and improve efficiency for health systems? A systematic review of evidence from low-income and middle-income countries. Human Resources for Health 15, 29.Google Scholar
Stiffman, AR, Pescosolido, B, Cabassa, LJ (2004). Building a model to understand youth service access: the gateway provider model. Mental Health Services Research 6, 189198.Google Scholar
Tilahun, D, Hanlon, C, Araya, M, Davey, B, Hoekstra, RA, Fekadu, A (2017). Training needs and perspectives of community health workers in relation to integrating child mental health care into primary health care in a rural setting in sub-Saharan Africa: a mixed methods study. International Journal of Mental Health Systems 11, 15.Google Scholar
Tomlinson, M, Rudan, I, Saxena, S, Swartz, L, Tsai, AC, Patel, V (2009). Setting priorities for global mental health research. Bulletin of the World Health Organization 87, 438446.Google Scholar
Van Ginneken, N, Tharyan, P, Lewin, S, Rao, GN, Meera, SM, Pian, J, Chandrashekar, S, Patel, V (2013). Non-specialist health worker interventions for the care of mental, neurological and substance-abuse disorders in low- and middle-income countries. Cochrane Database of Systematic Reviews, 11.Google Scholar
World Health Organization (2001). The World Health Report 2001: Mental Health: New Understanding, New Hope. Geneva: World Health Organisation.Google Scholar
World Health Organization (2003). Caring for Children and Adolescents with Mental Disorders: Setting WHO Directions. Geneva: World Health Organization.Google Scholar
World Health Organization (2004). Declaration of Alma-Ata. Geneva: World Health Organization, Regional Office for Europe.Google Scholar
World Health Organization (2010). International Statistical Classification of Diseases and Related Health Problems. Geneva: World Health Organisation Available online: www.who.int/classifications/icd/ICD10Volume2_en_2010.pdf [Accessed September 2017].Google Scholar
World Health Organization (2007). Task Shifting: Rational Redistribution of Tasks Among Health Workforce Teams: Global Recommendations and Guidelines. Geneva: World Health Organization. Available online: http://www.who.int/iris/handle/10665/43821 [Accessed June 2018].Google Scholar
World Health Organization (2008 a). Integrating Mental Health into Primary Care: A Global Perspective. Geneva: World Health Organization.Google Scholar
World Health Organization (2008 b). The World Health Report 2008: Primary Health Care Now More Than Ever. Geneva: World Health Organization.Google Scholar
World Health Organization (2010). mhGAP Intervention Guide. Geneva: World Health Organization.Google Scholar
World Health Organization (2011). Assessment of Health Facility Data Quality. Geneva: World Health Organization.Google Scholar
World Health Organization (2017). mhGAP Training Manuals for the mhGAP Intervention Guide for Mental, Neurological and Substance Use Disorders in Non-Specialized Health Settings-Version 2.0 (for Field Testing). Geneva: World Health Organization.Google Scholar
World Health Organization, World Organization of National Colleges, Academies & Academic Associations of General Practitioners/Family Physicians (2008). Integrating Mental Health Into Primary Care: A Global Perspective. Geneva: World Health Organization.Google Scholar
Figure 0

Fig. 1. The Gateway Provider Model of youth access to mental health services, from Stiffman et al. (2004).

Figure 1

Fig. 2. CONSORT flow diagram.

Figure 2

Table 1. Characteristics of clinics by study arm

Figure 3

Table 2. Background characteristics of patients 1–18 years by study arm

Figure 4

Table 3. CAMH profile by month and study arm

Figure 5

Table 4. Percent of clinics with CAMH diagnosis by study arm

Figure 6

Table 5. Logistic regression of a CAMH diagnosis between study arms (controlling for age and sex, and accounting for clustering effects at clinic level)