Limitation 1: False positive rates of self-report tools

Self-report screening tools are commonly used as the reference standard when determining whether or not a primary healthcare worker has accurately diagnosed a mental health condition (Fekadu et al., Reference Fekadu, Demissie, Birhane, medhin, Bitew, Hailemariam, Minaye, Habtamu, Milkias, Petersen, Patel, Cleare, Mayston, Thornicroft, Alem, Hanlon and Prince2022; Habtamu et al., Reference Habtamu, Birhane, Demissie and Fekadu2023; Rathod et al., Reference Rathod, De Silva, Ssebunnya, Breuer, Murhar, Luitel, Medhin, Kigozi, Shidhaye, Fekadu, Jordans, Patel, Tomlinson and Lund2016). For example, when judging if a primary healthcare worker accurately diagnosed depression, the score on the Patient Health Questionnaire-9 (PHQ-9; Kroenke et al., Reference Kroenke, Spitzer and Williams2001) has become a de facto standard (Fekadu et al., Reference Fekadu, Demissie, Birhane, medhin, Bitew, Hailemariam, Minaye, Habtamu, Milkias, Petersen, Patel, Cleare, Mayston, Thornicroft, Alem, Hanlon and Prince2022; Habtamu et al., Reference Habtamu, Birhane, Demissie and Fekadu2023). The percentage detection rate is calculated as the number of patients who receive a diagnosis of depression by a healthcare worker compared to the number of patients above a locally validated cut-off on the self-report screening tool. A patient with a high PHQ-9 score who does not receive a depression diagnosis by a primary healthcare worker is considered a missed diagnosis.

This strategy is problematic because self-report tools are not synonymous with a clinical diagnosis. Instead, the gold standard for clinical diagnosis is a semi-structured clinician-administered interview, using tools such as the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders (SCID; First et al., Reference First, Williams, Karg and Spitzer2015) or the Scheduled for Affective Disorders and Schizophrenia for School Aged Children (Kiddie-SADS; Kaufman et al., Reference Kaufman, Birmaher, Axelson, Perepletchikova, Brent and Ryan2016). When self-report tools are compared against these structured clinical interviews, the self-report tools typically have high rates of false positives: they identify many people who do not have the clinical condition, i.e., low specificity (Levis et al., Reference Levis, Benedetti, Ioannidis, Sun, Negeri, He, Wu, Krishnan, Bhandari, Neupane, Imran, Rice, Riehm, Saadat, Azar, Boruff, Cuijpers, Gilbody, Kloda, Mcmillan, Patten, Shrier, Ziegelstein, Alamri, Amtmann, Ayalon, Baradaran, Beraldi, Bernstein, Bhana, Bombardier, Carter, Chagas, Chibanda, Clover, Conwell, Diez-quevedo, Fann, Fischer, Gholizadeh, Gibson, Green, Greeno, Hall, Haroz, Ismail, Jetté, Khamseh, kwan, Lara, Liu, Loureiro, Löwe, Marrie, Marsh, Mcguire, Muramatsu, Navarrete, Osório, Petersen, Picardi, Pugh, Quinn, Rooney, Shinn, Sidebottom, Spangenberg, Tan, Taylor-rowan, Turner, Weert, Vöhringer, Wagner, White, Winkley and Thombs2020). This is by design because most self-report tools were created to improve screening and referral in health services, and they were not intended to provide a diagnosis (Zimmerman and Holst, Reference Zimmerman and Holst2018). Administration of self-report tools typically prioritizes sensitivity – capturing the greatest number of individuals who potentially have a condition, even if that has the tradeoff of high rates of false positives.

In the recent review of depression detection rates in LMIC, most studies used a PHQ-9 cut-off of 5 or 10 to estimate who should have received a clinical diagnosis of depression (Fekadu et al., Reference Fekadu, Demissie, Birhane, medhin, Bitew, Hailemariam, Minaye, Habtamu, Milkias, Petersen, Patel, Cleare, Mayston, Thornicroft, Alem, Hanlon and Prince2022). The DEPRESS-D research consortium has conducted large individual participant meta-analyses of the PHQ-9 versus structured clinical interviews (Levis et al., Reference Levis, Benedetti, Ioannidis, Sun, Negeri, He, Wu, Krishnan, Bhandari, Neupane, Imran, Rice, Riehm, Saadat, Azar, Boruff, Cuijpers, Gilbody, Kloda, Mcmillan, Patten, Shrier, Ziegelstein, Alamri, Amtmann, Ayalon, Baradaran, Beraldi, Bernstein, Bhana, Bombardier, Carter, Chagas, Chibanda, Clover, Conwell, Diez-quevedo, Fann, Fischer, Gholizadeh, Gibson, Green, Greeno, Hall, Haroz, Ismail, Jetté, Khamseh, kwan, Lara, Liu, Loureiro, Löwe, Marrie, Marsh, Mcguire, Muramatsu, Navarrete, Osório, Petersen, Picardi, Pugh, Quinn, Rooney, Shinn, Sidebottom, Spangenberg, Tan, Taylor-rowan, Turner, Weert, Vöhringer, Wagner, White, Winkley and Thombs2020). They demonstrated that the commonly used cut-off of ≥ 10, results in two-fold inflation of the actual prevalence (12% prevalence based on the SCID compared to 24% on the PHQ-9 ≥ 10): half of the patients above the cut-off do not have clinical condition when evaluated with structured clinical interviews (Levis et al., Reference Levis, Benedetti, Ioannidis, Sun, Negeri, He, Wu, Krishnan, Bhandari, Neupane, Imran, Rice, Riehm, Saadat, Azar, Boruff, Cuijpers, Gilbody, Kloda, Mcmillan, Patten, Shrier, Ziegelstein, Alamri, Amtmann, Ayalon, Baradaran, Beraldi, Bernstein, Bhana, Bombardier, Carter, Chagas, Chibanda, Clover, Conwell, Diez-quevedo, Fann, Fischer, Gholizadeh, Gibson, Green, Greeno, Hall, Haroz, Ismail, Jetté, Khamseh, kwan, Lara, Liu, Loureiro, Löwe, Marrie, Marsh, Mcguire, Muramatsu, Navarrete, Osório, Petersen, Picardi, Pugh, Quinn, Rooney, Shinn, Sidebottom, Spangenberg, Tan, Taylor-rowan, Turner, Weert, Vöhringer, Wagner, White, Winkley and Thombs2020). Therefore, using self-report tools creates a misleading target – often an overestimate – of the number of expected diagnoses (Aragonès et al., Reference Aragonès, Piñol and Labad2006; Zimmerman and Holst, Reference Zimmerman and Holst2018). The DEPRESS-D group summarizes this problem:

In the context of evaluating diagnostic accuracy, this translates into the PHQ-9 and similar tools overestimating the number of expected diagnoses in primary care. This incorrectly inflates the true difference between the rate of healthcare diagnoses and the target number of diagnoses to be made. In other words, it can make the gap in detection by healthcare workers appear worse than it actually is.

Limitation 2: False negative rates of self-report tools

Self-report tools are also not 100% sensitive. Some patients with clinical depression will score below cut-offs – a false negative. A competent primary healthcare worker would be expected to make some diagnoses of depression below the cut-off and to not diagnose every patient above the cut-off. When only examining diagnoses of depression among patients scoring above a PHQ-9 cut-off, this misses those clinical cases with depression scoring below the cut-off. This group of screener-negative depression cases is lost in both the numerator and denominator of percent detection. The PHQ-9 and other self-report tools used in isolation are, therefore, unable to provide a true estimate of percent detection by healthcare workers.

Limitation 3: Use of tools that are not validated for local populations

A recent review of diagnostic error in mental health points out that “validated psychological tests … can lead to inaccurate diagnostic impressions if they are interpreted without sufficient context or not followed with an appropriate diagnostic interview” (Bradford et al., Reference Bradford, Meyer, Khan, Giardina and Singh2024). This leads to another problem with the predominance of self-report tools: the issue of local validation. In global mental health, self-report tools require translation and appropriate cultural adaptation, followed by validation to establish the local estimates for sensitivity and specificity (Kohrt and Kaiser, Reference Kohrt and Kaiser2021; Kohrt and Patel, Reference Kohrt, Patel, Das-munshi, Ford, Hotopf, Prince and Stewart2020; Van Ommeren, Reference Van Ommeren2003; Van Ommeren et al., Reference Van Ommeren, Sharma, Thapa, Makaju, Prasain, Bhattaria and De Jong1999). Without local validation, the rates of false positives and false negatives of the self-report tool cannot be accurately determined. This further exacerbates error in estimating targets for clinician diagnoses.

Limitation 4: Focusing on a single mental health condition

Another limitation is that studies of diagnostic accuracy rarely evaluate multiple mental health conditions. Using a tool such as the PHQ-9 does not allow for distinguishing among conditions that may be misdiagnosed as depression. PHQ-9 scores are likely to be high among patients with generalized anxiety, posttraumatic stress, a substance use condition, or negative symptoms of psychosis. Physical health conditions including anaemia, other nutrient deficiencies, hypothyroidism, and infectious diseases may also have high PHQ-9 scores (Bode et al., Reference Bode, Ivens, Bschor, Schwarzer, Henssler and Baethge2021; Califf et al., Reference Califf, Wong, Doraiswamy, Hong, Miller and Mega2022). The PHQ-9 basically functions like a thermometer suggesting that a fever is present, but the tool used in isolation cannot distinguish which condition is causing the fever. Conflating every high PHQ-9 score with a clinical diagnosis of depression is like assuming every fever is malaria. Consequently, evaluating healthcare workers’ ability to identify depression requires clinical assessment of multiple mental health conditions. Figure 1 illustrates the high number of false positives using the PHQ-9 and heterogeneity underlying a categorical classification depression based on a commonly used PHQ-9 cut-off score.

Figure 1.

Heterogeneity of the patient population under the categorization of above versus below cut-off on a self-report mental health screening tool in comparison to a gold standard diagnosis using the SCID. Abbreviations: PHQ-9, patient health questionnaire-9; SCID, structured clinical interview for the diagnostic and statistical manual of mental disorders.

There are self-report tools with multiple conditions, such as the Diagnostic and Statistical Manual of Mental Disorders (DSM)-5 Level 1 Cross-Cutting Symptom Measure (DSM-XC), which addresses 13 mental health domains (American Psychiatric Association, 2013). However, this tool has not been validated in most settings. In data from Brazil, the domain subscales suffer from many of the problems of single condition tools, for example even lower specificity than the PHQ-9 (DSM-XC specificity: major depressive disorder = 59%, generalized anxiety disorder = 54%, alcohol use disorder = 55%), leading to high rates of false positives (Gonçalves Pacheco et al., Reference Gonçalves Pacheco, Kieling, Manfro, Menezes, Gonçalves, Oliveira, Wehrmeister, Rohde and Hoffmann2024). The domains are also sensitive across multiple conditions, e.g., the depression domain has a sensitivity of 95% for major depressive disorder and 80% for generalized anxiety disorder (Gonçalves Pacheco et al., Reference Gonçalves Pacheco, Kieling, Manfro, Menezes, Gonçalves, Oliveira, Wehrmeister, Rohde and Hoffmann2024). Considering these findings, the DSM-XC is unable to meet the objective of distinguishing among conditions as a benchmark for diagnostic accuracy.

Strategy 1. Statistical techniques to adjust estimates from self-report tools

Self-report tools have the advantage of being brief and not requiring clinical experts for administration. However, adjustments are required to address the limitations described above. Self-report tools need to be validated in the population of interest using structured clinical interviews to determine the psychometric properties (Kohrt and Kaiser, Reference Kohrt and Kaiser2021; Kohrt and Patel, Reference Kohrt, Patel, Das-munshi, Ford, Hotopf, Prince and Stewart2020). Based on the validation, sensitivity and specificity can also be evaluated at different cut-offs with the target population. The DEPRESS-D group reports that selecting PHQ-9 cut-offs higher than 10 can be associated with more accurate prevalence rates by minimizing false positives (Levis et al., Reference Levis, Benedetti, Ioannidis, Sun, Negeri, He, Wu, Krishnan, Bhandari, Neupane, Imran, Rice, Riehm, Saadat, Azar, Boruff, Cuijpers, Gilbody, Kloda, Mcmillan, Patten, Shrier, Ziegelstein, Alamri, Amtmann, Ayalon, Baradaran, Beraldi, Bernstein, Bhana, Bombardier, Carter, Chagas, Chibanda, Clover, Conwell, Diez-quevedo, Fann, Fischer, Gholizadeh, Gibson, Green, Greeno, Hall, Haroz, Ismail, Jetté, Khamseh, kwan, Lara, Liu, Loureiro, Löwe, Marrie, Marsh, Mcguire, Muramatsu, Navarrete, Osório, Petersen, Picardi, Pugh, Quinn, Rooney, Shinn, Sidebottom, Spangenberg, Tan, Taylor-rowan, Turner, Weert, Vöhringer, Wagner, White, Winkley and Thombs2020, Reference Levis, Benedetti and Thombs2019). Tools such as the PHQ-9 also have diagnostic algorithms to estimate DSM diagnoses (Levis et al., Reference Levis, Benedetti, Ioannidis, Sun, Negeri, He, Wu, Krishnan, Bhandari, Neupane, Imran, Rice, Riehm, Saadat, Azar, Boruff, Cuijpers, Gilbody, Kloda, Mcmillan, Patten, Shrier, Ziegelstein, Alamri, Amtmann, Ayalon, Baradaran, Beraldi, Bernstein, Bhana, Bombardier, Carter, Chagas, Chibanda, Clover, Conwell, Diez-quevedo, Fann, Fischer, Gholizadeh, Gibson, Green, Greeno, Hall, Haroz, Ismail, Jetté, Khamseh, kwan, Lara, Liu, Loureiro, Löwe, Marrie, Marsh, Mcguire, Muramatsu, Navarrete, Osório, Petersen, Picardi, Pugh, Quinn, Rooney, Shinn, Sidebottom, Spangenberg, Tan, Taylor-rowan, Turner, Weert, Vöhringer, Wagner, White, Winkley and Thombs2020). In a sample of 1,900 primary care patients in Nepal, a PHQ-9 cut-off of ≥10 yielded a prevalence rate of 14.5% compared to 5.6% when using the DSM algorithm for PHQ-9 scoring (Luitel et al., Reference Luitel, Lamichhane, Pokhrel, Upadhyay, Taylor Salisbury, Akerke, Gautam, Jordans, Thornicroft and Kohrt2024a). Although overall prevalence rates may be closer to the true population prevalence when using scoring algorithms for DSM equivalence, the classification accuracy of DSM algorithm scoring does not appear to be better than the PHQ-9 sum scores (He et al., Reference He, Levis, Riehm, Saadat, Levis, Azar, Rice, Krishnan, wu, sun, Imran, Boruff, Cuijpers, Gilbody, Ioannidis, Kloda, Mcmillan, Patten, Shrier, Ziegelstein, Akena, Arroll, Ayalon, Baradaran, Baron, Beraldi, Bombardier, Butterworth, Carter, Chagas, Chan, Cholera, Clover, Conwell, Ginkel, Janneke, Fann, Fischer, Fung, Gelaye, Goodyear-Smith, Greeno, Hall, Harrison, Härter, Hegerl, Hides, Hobfoll, Hudson, Hyphantis, Inagaki, Ismail, Jetté, Khamseh, Kiely, Kwan, Lamers, Liu, Lotrakul, Loureiro, Löwe, Marsh, Mcguire, Mohd-sidik, Munhoz, Muramatsu, Osório, Patel, Pence, Persoons, Picardi, Reuter, Rooney, Da Silva Dos Santos, Shaaban, Sidebottom, Simning, Stafford, Sung, Tan, Turner, Weert, Henk, White, Whooley, Winkley, Yamada, Thombs and Benedetti2019; Levis et al., Reference Levis, Benedetti, Ioannidis, Sun, Negeri, He, Wu, Krishnan, Bhandari, Neupane, Imran, Rice, Riehm, Saadat, Azar, Boruff, Cuijpers, Gilbody, Kloda, Mcmillan, Patten, Shrier, Ziegelstein, Alamri, Amtmann, Ayalon, Baradaran, Beraldi, Bernstein, Bhana, Bombardier, Carter, Chagas, Chibanda, Clover, Conwell, Diez-quevedo, Fann, Fischer, Gholizadeh, Gibson, Green, Greeno, Hall, Haroz, Ismail, Jetté, Khamseh, kwan, Lara, Liu, Loureiro, Löwe, Marrie, Marsh, Mcguire, Muramatsu, Navarrete, Osório, Petersen, Picardi, Pugh, Quinn, Rooney, Shinn, Sidebottom, Spangenberg, Tan, Taylor-rowan, Turner, Weert, Vöhringer, Wagner, White, Winkley and Thombs2020).

After a scoring strategy and cut-off are selected, the sensitivity and specificity can be used to calculate the ‘true prevalence rate’ (TPR). This is done by estimating the number of false positives above the cut-off and false negatives below the cut-off, then adjusting the prevalence. This approach is well known in epidemiology (Hennekens et al., Reference Hennekens, Buring and Mayrent1987), and it has been used in infectious disease research to generate more accurate estimates (Bentley et al., Reference Bentley, Catanzaro and Ganiats2012). However, it has rarely been used with mental health data (Carvajal-Velez et al., Reference Carvajal-Velez, Ahs, Lundin, Van Den Broek, Simmons, Wade, Chorpita, Requejo and Kohrt2023; Luitel et al., Reference Luitel, Rimal, Eleftheriou, Rose-Clarke, Nayaju, Gautam, Pant, Devkota, Rana and Chaudhary2024b; Marlow et al., Reference Marlow, Skeen, Grieve, Carvajal-Velez, Åhs, Kohrt, Requejo, Stewart, Henry, Goldstone, Kara and Tomlinson2023; Tele et al., Reference Tele, Carvajal-Velez, Nyongesa, Ahs, Mwaniga, Kathono, Yator, Njuguna, Kanyanya, Amin, Kohrt, Wambua and Kumar2023). Unfortunately, this approach does not work when disease prevalence is low and the tool has a low specificity. In these instances, the number of expected false positives can lead to estimated TPR that is negative. Therefore, newer strategies using Bayesian statistics can provide more accurate estimates in the setting of low prevalence (Diggle, Reference Diggle2011), and some strategies can be used when sensitivity and specificity are not known for the local setting (Lewis and Torgerson, Reference Lewis and Torgerson2012). It is important to note that all of these statistical adjustments will contribute to a more accurate estimated target rate for the overall prevalence in a primary care population, but, without further clinical information, it does not improve the diagnostic categorization of an individual patient.

Strategy 2. Integrating structured clinical interviews

Self-report tools can be a useful starting point to evaluate detection, but additional methods are needed to make judgements of accurate diagnosis. Structured clinical interviews are semi-structured guides utilized by mental health clinicians such as psychiatrists and clinical psychologists. The SCID (First et al., Reference First, Williams, Karg and Spitzer2015) and K-SADS (Kaufman et al., Reference Kaufman, Birmaher, Axelson, Perepletchikova, Brent and Ryan2016) are commonly used in clinical research to ensure inclusion and exclusion criteria for a new medication or other treatment. They can be used to determine accuracy of diagnosis for specific patients. These tools have branching logic that enable assessment across the diagnostic spectrum, as well as identification of co-occurring conditions, i.e., psychiatric comorbidity. Structured clinical interviews include sections to evaluate when conditions are likely secondary to substance use or another medical condition. Mental health experts using structured clinical interviews can also use their own clinical judgement when the algorithms may not capture nuanced clinical presentation, as well as adjust diagnostic judgements based on cultural context as it relates to clinical relevance of symptoms and functioning (Sajida Abdul and Panos, Reference Sajida Abdul and Panos2008). Structured clinical interviews are time intensive. Clinicians also need training on using the guides, including establishing inter-rater reliability because of the subjectivity and semi-structured nature of the guide (De La Peña et al., Reference De La Peña, Villavicencio, palacio, Félix, Larraguibel, Viola, Ortiz, Rosetti, Abadi, Montiel, Mayer, Fernández, Jaimes, Feria, Sosa, Rodríguez, Zavaleta, Uribe, Galicia, Botero, Estrada, Berber, Pi-davanzo, Aldunate, Gómez, Campodónico, Tripicchio, Gath, Hernández, Palacios and Ulloa2018; Kolaitis et al., Reference Kolaitis, Korpa, Kolvin and Tsiantis2003).

Given the resources required for structured clinical interviews, a feasible approach may be to use a two-stage strategy in which self-report tools are used for a large study sample and structured clinical interviews are conducted with select subsamples after collection of self-report data (Kauye et al., Reference Kauye, Jenkins and Rahman2014). This approach has been recommended in other fields of medicine, especially when evaluating populations with a low prevalence of the target health conditions (Obuchowski and Zhou, Reference Obuchowski and Zhou2002). In this approach, in the first stage, self-report tools could be administered to a large representative sample of primary care patients. Then in the second stage, a smaller subsample selected for structured clinical interviews would include a mix of individuals who received mental health diagnoses from primary healthcare workers and those who did not receive a diagnosis but who scored above validated cut-offs on the self-report tools administered in the first tier. This would generate diagnostic accuracy estimates mitigating the high rates of false positives in self-report measures. The structured clinical interview administered to a subsample of individuals who did not receive a diagnosis from a healthcare worker and were below the cut-off could reduce the estimated number of false negatives. The subsampling weights could then be used to estimate the prevalence rate in the full original population that completed only the self-report tools.

Strategy 3. Classifying ‘good-enough’ diagnostic accuracy based on contexts of services

Integrating structured clinical interviews with self-report tools adds complexity for classifying what counts as diagnostic accuracy. It is neither realistic nor clinically necessary that primary healthcare workers diagnose patients exactly as they would be categorized by a structured clinical interview. For example, it is unreasonable to expect that a primary healthcare worker after one week of mental health training should achieve SCID-level distinctions among major depressive disorder, cyclothymia and adjustment disorder with depressed mood. Therefore, rather than focusing on perfect diagnostic matches, we propose a flexible approach with ‘good-enough’ diagnostic synergy between a primary healthcare worker’s conclusion and structured clinical interview outcomes. Good-enough diagnoses will vary based on the types of treatments available, the potential risks associated with different conditions and treatments, and the social implications of misdiagnosis. Good-enough does not refer to allowing for a certain percentage of errors, but instead it reflects that diagnoses from a class of similar conditions may be close-enough to count as correct because the treatments are similar.

In LMICs, the range of available mental health treatments is limited. Pharmacological and psychological interventions recommended for depression and anxiety overlap, suggesting that a primary healthcare worker’s diagnosis of one condition could be adequate even if the clinical diagnosis is the other (Patel, Reference Patel2001). Conversely, for conditions with higher-risk treatment implications, such as psychosis, diagnostic specificity becomes important. A misdiagnosis of psychosis may lead to the prescription of antipsychotic medications, which carry significant potential for adverse effects for persons who do not have the condition (Coulter et al., Reference Coulter, Baker and Margolis2019). This has heightened importance in resource-limited settings, where patients often lack regular access to follow-up care to monitor and mitigate potentially incorrect treatments.

The WHO mhGAP-IG is an example of simplifying diagnostic categories for a good-enough approach to clinical care (World Health Organization, 2016). The mhGAP-IG uses streamlined diagnostic categories that allow primary healthcare workers to treat mental health conditions without necessitating exhaustive distinctions. The diagnostic categories in mhGAP-IG 2.0 are depression, psychosis, epilepsy, dementia, disorders due to substance use, self-harm/suicide, other significant mental health complaints and child and adolescent mental and behavioural disorders (World Health Organization, 2016). The psychosis module includes both psychosis and mania, and they may be treated similarly with antipsychotics when other options are not available. Similarly, in the first two versions of mhGAP-IG, there was not a separate module for anxiety. For many anxiety conditions, treatment is comparable to depression guidelines for psychotherapy and/or SSRIs. In summary, diagnostic distinctions can be adjusted based on the treatments available. Figures 2 and 3 provide an example of categorizing good-enough diagnoses when working with categories of depression, anxiety, psychosis and alcohol use disorder in a low-resource setting.

Figure 2.

Examples of ‘good-enough’ diagnostic concordance between mental health specialist’s structured clinical interview and primary healthcare worker’s diagnosis. Green sections refer to required concordance, and yellow sections can be discordant. (a) Depression or anxiety conditions can be considered accurate with any combination of depression or anxiety diagnoses because of the similar treatment in low-resource settings. (b) Psychosis diagnoses by healthcare workers would be accurate if any of the psychosis related conditions are positive on the structured clinical interview, including mania, schizophrenia or other psychosis, regardless of any discordance on the depression and anxiety conditions. (c) Substance use conditions require concordance with the structured clinical interview, but discordance on depression and anxiety conditions is acceptable.

Figure 3.

Additional examples of ‘good-enough’ diagnostic concordance: (d) for substance use conditions co-occurring with psychosis, this requires that both the substance use condition and psychosis would be indicated, e.g., alcohol withdrawal with features of psychosis, acute intoxication with a substance with psychotic features, or persons with psychosis who have a comorbid substance use condition. (e) For other conditions, this will depend on the condition and context regarding what is considered an acceptable overlap, e.g., PTSD on the structured clinical interview could be acceptable if depression or anxiety is diagnosed by the healthcare worker because of similar treatment. (f) For no mental health condition, there must be agreement between the clinician’s interview and healthcare worker’s diagnosis that no mental health treatment is needed.

To guide good-enough diagnostic accuracy research, we propose four considerations for what may constitute clinically meaningful diagnoses within primary care settings. First, determine whether specific treatment outcomes are contingent on an exact diagnosis, especially when available treatments overlap across diagnostic categories. Diagnoses should parallel the specificity needed for treatment within each setting, recognizing that a few simplified diagnostic categories may suffice if resources are constrained. Second, assess the risk associated with treatment, as higher-risk treatments warrant stricter diagnostic precision. Third, consider the social implications of diagnoses, as misdiagnoses that lead to social harm demand more careful evaluation. Finally, evaluate the resource implications of both incorrect diagnoses (false positives) and missed diagnoses (false negatives) to balance diagnostic thoroughness with sustainable use of healthcare resources.